Steps stage 1 incomplete weights?
I was interested in downloading the weights without midtraining, so I scrolled to the last two entries with stage1 in the branches, but the number of weight files is not 29 as should be. Maybe I didn't get right how to get the weights?
Hey @KnutJaegersberg , these are the last 2 checkpoints from stage1 checkpoints: https://huggingface.co/allenai/OLMo-2-0325-32B/tree/stage1-step721901-tokens6056B and https://huggingface.co/allenai/OLMo-2-0325-32B/tree/stage1-step721000-tokens6049B.
And I have checked this out: step 97000 and 98000, they are incomplete. I will reupload those. Thanks for bringing this to our attention.
I've tried using https://huggingface.co/allenai/OLMo-2-0325-32B/tree/stage1-step721901-tokens6056B but it only got me gibberish. it's weird, I also tried a gguf file I found on hf of that same checkpoint that worked.
another point is, I'd be interested in the performance of the weights that didn't have midtraining. it's just interesting.