gguf:

  • q4_k_m
  • 16-bit

This model is based on Meta Llama 3.1 8b, and is governed by the Llama 3.1 license.

Fine-tune using ORPO

Training Details

Training Data

  • dataset: reciperesearch/dolphin-sft-v0.1-preference

Training Procedure

ORPO techniques

Training Hyperparameters

  • Training regime: {{ training_regime | default("[More Information Needed]", true)}}

TrainOutput(global_step=30, training_loss=4.25380277633667, metrics={'train_runtime': 679.3467, 'train_samples_per_second': 0.353, 'train_steps_per_second': 0.044, 'total_flos': 0.0, 'train_loss': 4.25380277633667, 'epoch': 0.015})

Downloads last month
151
GGUF
Model size
8.03B params
Architecture
llama

4-bit

16-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Model tree for EpistemeAI/Dolphin-Llama-3.1-8B-orpo-v0.1-4bit-gguf

Quantized
(241)
this model

Dataset used to train EpistemeAI/Dolphin-Llama-3.1-8B-orpo-v0.1-4bit-gguf