Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,11 @@
|
|
| 1 |
# WhiteRabbitNeo-V3-7B
|
| 2 |
|
| 3 |
-
Private model repository for WhiteRabbitNeo/WhiteRabbitNeo-V3-7B
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
# WhiteRabbitNeo-V3-7B
|
| 2 |
|
| 3 |
+
Private model repository for WhiteRabbitNeo/WhiteRabbitNeo-V3-7B aka [qwen2.5-coder-7B-v4](https://wandb.ai/kindo-ai/kindo-lambda-labs/runs/3mqcjwj7).
|
| 4 |
+
|
| 5 |
+
Link to the [traning config](https://wandb.ai/kindo-ai/kindo-lambda-labs/artifacts/axolotl-config/config-3mqcjwj7/v0/files/axolotl_config_wxdeitrt.yml).
|
| 6 |
+
|
| 7 |
+
- Parameters: 7B
|
| 8 |
+
- Base model: Qwen2.5-Coder-7B
|
| 9 |
+
- Modality: Text-only (for now)
|
| 10 |
+
- Context Length: 32K (128K possible)
|
| 11 |
+
- VRAM: 24GB for a production deployment
|