Fine Tuning Molmo

#3
by chrishoertnagl - opened

Really cool work!
Is it possible to futher fine-tune the model e.g. on an OCR dataset or something? Are there any notebooks or examples you could share?

Thank you! We will release full training code for these models but we do not have that ready yet. For now these models do support a forward pass and backpropagation so you can place them into a standard torch training loop yourself.

Any update about releasing the fine tuning molmo script? thanks in advance

Hey @mavericklsd , we are planning to release the code along with checkpoints and weights by the end of November.

@amanrangapur don't want to be that guy, but can't help it. Is this released yet?

Hey @delip , we're planning to release this week. Stay tuned.

Thanks @amanrangapur and MolMo team!

@amanrangapur I saw the Molmo dataset(s) were released. Is there still a plan to release the training code on GitHub as well this week?

Hey @scm-aiml ! Since it’s the holidays here, we’ll be releasing next week!

Any update on a fine-tuning script? Ive been patiently waiting quite some time. Updates would be appreciated. πŸ™ƒ

Hey @syazvinski , We are not releasing any custom fine-tuning script until next month. I will keep you posted if there is anything around.

Hi @amanrangapur , thank you for the great work. Do you know if there is any timeline for the release of a fine-tuning script? Just to know whether I should wait, or find an alternative approach/model for my project. Thank you!

Hey @chisarie , we have released bunch of training code and stuff on GitHub, and you can fine-tune the model on custom data, you probably need to work on Data Loaders and other things.. As of now we're not on releasing anything like custom fine-tuning script.

All right, thank you for the prompt response!

Sign up or log in to comment