nanotron
/

doremi-llama-2.5b-optimized-weights

Model card Files Files and versions

doremi-llama-2.5b-optimized-weights / 70000 /optimizer /optimizer_config.json

neuralink's picture

neuralink HF Staff

add the 70k checkpoint

1361151 about 1 year ago

history blame contribute delete

124 Bytes

{"type": "OptimizerFromGradientAccumulator", "parallelism": {"tp_size": "8", "dp_size": "8", "pp_size": "1"}, "configs": {}}