JayHyeon
/

Qwen2.5-0.5B-SFT-2e-5-2ep-DPO_1e-6-3ep_0alp_0lam

Text Generation

Generated from Trainer

text-generation-inference

Model card Files Files and versions Community

Qwen2.5-0.5B-SFT-2e-5-2ep-DPO_1e-6-3ep_0alp_0lam

Ctrl+K

Ctrl+K

1 contributor

History: 7 commits

JayHyeon's picture

Training in progress, step 2910

2083dd8 verified 5 months ago

.gitattributes

1.57 kB

Training in progress, step 500 5 months ago
added_tokens.json

605 Bytes

Training in progress, step 500 5 months ago
config.json

762 Bytes

Training in progress, step 500 5 months ago
merges.txt

1.67 MB

Training in progress, step 500 5 months ago
model.safetensors

1.26 GB
LFS

Training in progress, step 2910 5 months ago
special_tokens_map.json

616 Bytes

Training in progress, step 500 5 months ago
tokenizer.json

11.4 MB
LFS

Training in progress, step 500 5 months ago
tokenizer_config.json

7.26 kB

Training in progress, step 500 5 months ago
training_args.bin
Detected Pickle imports (15)
- "torch.device",
- "trl.trainer.dpo_config.FDivergenceType",
- "transformers.integrations.deepspeed.HfTrainerDeepSpeedConfig",
- "transformers.integrations.deepspeed.HfDeepSpeedConfig",
- "trl.trainer.dpo_config.DPOConfig",
- "transformers.training_args.OptimizerNames",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.HubStrategy",
- "torch.bfloat16",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "accelerate.utils.dataclasses.DeepSpeedPlugin",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.trainer_utils.SchedulerType",
- "accelerate.state.PartialState",
- "transformers.trainer_utils.IntervalStrategy"
How to fix it?
7.67 kB
LFS

Training in progress, step 500 5 months ago
vocab.json

2.78 MB

Training in progress, step 500 5 months ago