facebook/MusicGen · Following the exact melody of the reference file

Hello all,

I am trying to instruct MusicGen to follow the EXACT same chord progression and melody from the reference file. And also, for the resulting file to be in sync (time-wise) with the reference file. The reference file contains original music that's comprised of the vocal, bass, and drums. I am trying to get MusicGen to follow the melody of the vocal. I couldn't do it as there are always random notes (not in key), plus the timing is off.
I tried feeding it the stem of the original vocal only, as well as the whole original track. I tried altering all the parameters (topp/topk/temperature/etc) but I wasn't able to get a satisfactory result. Is there a parameter combination that would force the MusicGen to closely follow the melody/beat of the reference file?
Maybe I need a different tool - a tool that would simply convert one instrument to another. Do you know of any that could do that?

This was one of the prompts that I was using:

indian style folk music with Sitar, veena, tabla percussions, sarangi, sarod, mridangam, pakhawaj, dholak, bpm: 83, key: Gmin, time signature: 4/4, duration the same as reference file, follow chord progression of the reference file, sensual, simple chord progression

Any help is welcome. Thanks in advance!

-Mick