|
--- |
|
license: other |
|
library_name: transformers |
|
--- |
|
# Join our Discord! https://discord.gg/Nbv9pQ88Xb |
|
--- |
|
|
|
[BeaverAI](https://huggingface.co/BeaverAI) proudly presents... |
|
|
|
# Rocinante 12B v1.1 🚀 |
|
|
|
#### A versatile workhorse for any adventure! |
|
|
|
 |
|
|
|
*Finding him so mettlesome, conceived a good omen from his eagerness, believing it a certain presage of his success in the dreadful adventure he was about to achieve.* |
|
|
|
 |
|
|
|
*He steered his course homeward; and Rocinante, as if he had guessed the knight’s intention, began to move with such alacrity and nimbleness, that his hooves scarcely seemed to touch the ground.* |
|
|
|
## Description |
|
|
|
If you would like a pure off-the-rails experience, try [Rocinante 12B v1](https://huggingface.co/TheDrummer/Rocinante-12B-v1) |
|
|
|
 |
|
|
|
Testers have reported: |
|
- Plenty of new and moistier words! |
|
- Richer and distinct prose |
|
- Cranked up creativity |
|
- Engaging and adventure-filled storytelling |
|
|
|
## Arsenal (Supported Chat Templates) |
|
- ChatML for RP |
|
- Alpaca for Story / Instruct Adventure |
|
- Mistral for NeMo |
|
- You can mix it up and see which works best for you. |
|
|
|
## Sampler Suggestions |
|
- Use DRY |
|
- Suggestion: Temp 0.7 for a chill, familiar ride. Temp 1.2 for a nitro boost! |
|
|
|
## Links |
|
- Original: https://huggingface.co/TheDrummer/Rocinante-12B-v1.1 |
|
- GGUF: https://huggingface.co/TheDrummer/Rocinante-12B-v1.1-GGUF |
|
- GGUF (iMatrix): WIP |
|
- EXL2 (4bpw): https://huggingface.co/Statuo/Rocinante-v1.1-EXL2-4bpw |
|
- EXL2 (6bpw): https://huggingface.co/Statuo/Rocinante-v1.1-EXL2-6bpw |
|
- EXL2 (8bpw): https://huggingface.co/Statuo/Rocinante-v1.1-EXL2-8bpw |
|
|
|
## Credit |
|
|
|
Thank you for the compute, Garg! |
|
|
|
Thank you for the Della merge, [MarinaraSpaghetti](https://huggingface.co/MarinaraSpaghetti)! |
|
|
|
Thank you Statuo for the EXL2 quants! |
|
|
|
 |
