|
|
--- |
|
|
base_model: HuggingFaceTB/SmolLM3-3B |
|
|
library_name: transformers |
|
|
model_name: SmolLM-3B-Code-Specialist-Combined |
|
|
tags: |
|
|
- code-generation |
|
|
- sft |
|
|
- trl |
|
|
- humaneval |
|
|
license: unknown |
|
|
--- |
|
|
|
|
|
# SmolLM-3B Code Specialist Combined |
|
|
|
|
|
A fine-tuned version of [HuggingFaceTB/SmolLM3-3B](https://huggingface.co/HuggingFaceTB/SmolLM3-3B), optimized for code generation and problem-solving. |
|
|
Achieved **+15% improvement** on the HumanEval benchmark. |
|
|
|
|
|
## 📊 Benchmarks |
|
|
|
|
|
| Benchmark | Base Model | Fine-Tuned Model | Improvement | |
|
|
|------------------------|------------|------------------|-------------| |
|
|
| **HumanEval (pass@1)** | 52% | **67%** | **+15%** | |
|
|
|
|
|
## 💻 Quick Start |
|
|
|
|
|
```python |
|
|
from transformers import pipeline |
|
|
|
|
|
prompt = "Write a Python function to check if a number is prime." |
|
|
generator = pipeline("text-generation", model="ViswanthSai/SmolLM-3B-Code-Specialist-Combined") |
|
|
print(generator(prompt, max_new_tokens=128)[0]["generated_text"]) |
|
|
|
