Hugging Face's logo

ZeusLabs
/
Chronos-Platinum-72B

Text Generation
Transformers
Safetensors
PyTorch
qwen2
roleplay
storywriting
qwen2.5
finetune
conversational
text-generation-inference
Model card Files Community
4
Chronos-Platinum-72B / README.md
Fizzarolli's picture
Fizzarolli
Create README.md
82f85af verified
preview code
|
raw
history blame
1.38 kB
metadata
tags:
  - roleplay
  - storywriting
  - qwen2.5
  - finetune
  - transformers
  - pytorch

Zeus Labs ~ Chronos-Platinum-72B

image/webp

Instruct Template

This model uses ChatML - below is an example. It is a preset in many frontends.

<|im_start|>system
You are a helpful assistant<|im_end|>
<|im_start|>user
Hello there!<|im_end|>
<|im_start|>assistant
Hi! I'm an AI assistant, designed to help people like you with all sorts of tasks. Is there anything you need help with?<|im_end|>
<|im_start|>user
I was wondering how transformers work?<|im_end|>
<|im_start|>assistant

Quantization

Please note that we tested this model with a 4.5bpw EXL2 quant. Results are not expected to be the same when going below this quanitzation.

LlamaCPP

TODO!

Exllama2

TODO!

FP8

TODO!

Sampling Settings

Here are some settings that work well with this model:

TODO!

Credit

Thank you to my team consisting of @Fizzarolli, @ToastyPigeon and myself @elinas.

Additional Details

If you have any questions or concerns, please post in the community tab.

DISCLAIMER: Outputs generated by the model are not reflective of our views.