Nitrals-Quants
/

Nemotron-15b-Thinker-v0.1-4.0bpw-exl2

Model card Files Files and versions Community

Nemotron-15b-Thinker-v0.1-4.0bpw-exl2 / README.md

Nitral-AI's picture

Upload folder using huggingface_hub

52942e3 verified 2 months ago

|

history blame contribute delete

357 Bytes

metadata

license: other
language:
  - en
tags:
  - autoquant
  - exl2

Base Model https://huggingface.co/ServiceNow-AI/Apriel-Nemotron-15b-Thinker

phase 1: https://huggingface.co/Nitral-AI/Nemotron-15b-Thinker-instruct

phase-2 test chatml (this model)

Data: 1024 reasoning RP multi-turn chat pairs.

BS 32, Rank 64, Lr 2e-4, 2 epochs. 8192 context.