thisnick/Llama-3.1-8B-Instruct-abliterated-FP8-Dynamic

Llama-3.1-8B-Instruct-abliterated

This is an abliterated version of Meta's Llama-3.1-8B-Instruct model, modified to reduce harmful outputs while maintaining general performance.

Model Description

This model uses activation-based ablation techniques to modify the model's behavior regarding potentially harmful content. The technique involves:

1. Identifying activation directions that differentiate between harmful and harmless responses
2. Orthogonalizing the model's weights with respect to these directions
3. Modifying specific layers to reduce the model's tendency to generate harmful content

Model Details

• Base Model: meta-llama/Llama-3.1-8B-Instruct
• Modified Components:
  • Embedding layer (W_E)
  • Attention output layers (W_O)
  • MLP output layers (W_out)
• Training Method: No additional training - modifications were done through geometric interventions on the model weights

Intended Uses

This model is intended for:

• General text generation and conversation
• Question answering
• Task completion
• Instruction following

While maintaining improved safety characteristics compared to the base model.

Limitations

• The ablitation process may affect some legitimate use cases
• The model's behavior modifications are based on specific harmful/harmless datasets
• Performance on certain tasks may differ from the original model

Training Data

The model modifications were guided using:

• Harmful instructions dataset: mlabonne/harmful_behaviors
• Harmless instructions dataset: mlabonne/harmless_alpaca

Ethical Considerations

This model aims to reduce potentially harmful outputs while maintaining functionality. However, users should:

• Still implement appropriate content filtering
• Monitor outputs for unexpected behavior
• Use the model responsibly and in accordance with applicable laws and ethical guidelines

Citation

If you use this model, please cite:

@misc{llama-3.1-8b-instruct-abliterated,
author = {[Your Name]},
title = {Llama-3.1-8B-Instruct-abliterated},
year = {2024},
publisher = {Hugging Face},
journal = {Hugging Face Model Hub},
}