yusuke111
/

myBit-Llama2-jp-127M-2B4TLike-wiki-aozora-sort-swallow-tokenizer

Text Generation

Generated from Trainer

Model card Files Files and versions

myBit-Llama2-jp-127M-2B4TLike-wiki-aozora-sort-swallow-tokenizer

516 MB

1 contributor

History: 2 commits

yusuke111's picture

Training in progress, step 500

4262202 verified 5 months ago

.gitattributes

1.52 kB

initial commit 5 months ago
config.json

886 Bytes

Training in progress, step 500 5 months ago
model.safetensors

511 MB
xet

Training in progress, step 500 5 months ago
special_tokens_map.json

434 Bytes

Training in progress, step 500 5 months ago
tokenizer.json

4.38 MB

Training in progress, step 500 5 months ago
tokenizer.model

914 kB
xet

Training in progress, step 500 5 months ago
tokenizer_config.json

1.02 kB

Training in progress, step 500 5 months ago
training_args.bin
Detected Pickle imports (10)
- "accelerate.state.PartialState",
- "transformers.trainer_utils.HubStrategy",
- "torch.device",
- "accelerate.utils.dataclasses.DistributedType",
- "transformers.trainer_utils.SchedulerType",
- "transformers.training_args.TrainingArguments",
- "transformers.trainer_utils.IntervalStrategy",
- "transformers.trainer_pt_utils.AcceleratorConfig",
- "transformers.trainer_utils.SaveStrategy",
- "transformers.training_args.OptimizerNames"
How to fix it?
5.43 kB
xet

Training in progress, step 500 5 months ago