This model is trained off of Josephgflowers/TinyLlama-v1.1-Agent-Rag-Nerd-v1 which is trained off of the tinyllama v1.1. This model was trained using the tinyllama chat format, zephyr. I trained this model using a vast amount of textbooks are all you need style synthetic datasets as well as some common chat datasets and the Cinder dataset.

Downloads last month
13
Safetensors
Model size
1.1B params
Tensor type
F32
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model's library.