Hugging Face's logo Hugging Face
  • Models
  • Datasets
  • Spaces
  • Posts
  • Docs
  • Enterprise
  • Pricing

  • Log In
  • Sign Up

bikalnetomi
/
rlhf-ppo-llama3-1B-Reward-model-lora-bikal

Transformers
Safetensors
Generated from Trainer
trl
reward-trainer
Model card Files Files and versions Community
rlhf-ppo-llama3-1B-Reward-model-lora-bikal
Ctrl+K
Ctrl+K
  • 1 contributor
History: 2 commits
bikalnetomi's picture
bikalnetomi
bikalnetomi/RLHF-PPO-RewardModel-LLama3-1B-v2
c98b2f1 verified 5 months ago
  • .gitattributes
    1.57 kB
    bikalnetomi/RLHF-PPO-RewardModel-LLama3-1B-v2 5 months ago
  • README.md
    1.79 kB
    bikalnetomi/RLHF-PPO-RewardModel-LLama3-1B-v2 5 months ago
  • adapter_config.json
    774 Bytes
    bikalnetomi/RLHF-PPO-RewardModel-LLama3-1B-v2 5 months ago
  • adapter_model.safetensors
    27.3 MB
    LFS
    bikalnetomi/RLHF-PPO-RewardModel-LLama3-1B-v2 5 months ago
  • special_tokens_map.json
    434 Bytes
    bikalnetomi/RLHF-PPO-RewardModel-LLama3-1B-v2 5 months ago
  • tokenizer.json
    17.2 MB
    LFS
    bikalnetomi/RLHF-PPO-RewardModel-LLama3-1B-v2 5 months ago
  • tokenizer_config.json
    54.7 kB
    bikalnetomi/RLHF-PPO-RewardModel-LLama3-1B-v2 5 months ago
  • training_args.bin

    Detected Pickle imports (9)

    • "transformers.trainer_utils.IntervalStrategy",
    • "transformers.trainer_utils.HubStrategy",
    • "transformers.trainer_pt_utils.AcceleratorConfig",
    • "accelerate.utils.dataclasses.DistributedType",
    • "transformers.training_args.OptimizerNames",
    • "accelerate.state.PartialState",
    • "torch.device",
    • "transformers.trainer_utils.SchedulerType",
    • "trl.trainer.reward_config.RewardConfig"

    How to fix it?

    5.43 kB
    LFS
    bikalnetomi/RLHF-PPO-RewardModel-LLama3-1B-v2 5 months ago