metadata
base_model: meta-llama/Llama-3.1-8B-Instruct
library_name: peft
Llama 7B Uncertainty Calibration Model (Brier Loss)
This model is a fine-tuned version of Llama-3.1-8B-Instruct optimized for uncertainty calibration using Brier score loss.
Model Details
Model Description
- Developed by: liushiliushi
- Model type: Llama fine-tuned with PEFT/LoRA
- Language(s): English
- License: Same as base model (Llama 3.1)
- Finetuned from model: meta-llama/Llama-3.1-8B-Instruct
Uses
Direct Use
This model is optimized for tasks requiring well-calibrated uncertainty estimates.
Training Details
Training Hyperparameters
- Learning rate: 1e-5
- Epochs: 2
- Loss function: Brier score
- Batch size: 16
Framework versions
- PEFT 0.12.0