Text Generation
GGUF
imatrix
yayoimizuha's picture
Update README.md
3ad815d verified
---
datasets:
- TFMC/imatrix-dataset-for-japanese-llm
pipeline_tag: text-generation
license: other
license_name: nvidia-open-model-license
license_link: >-
https://developer.download.nvidia.com/licenses/nvidia-open-model-license-agreement-june-2024.pdf
base_model: nvidia/Nemotron-4-340B-Instruct
---
[nvidia/Nemotron-4-340B-Instruct](https://huggingface.co/nvidia/Nemotron-4-340B-Instruct) から変換.
[TFMC/imatrix-dataset-for-japanese-llm](https://huggingface.co/datasets/TFMC/imatrix-dataset-for-japanese-llm) を使用してimatrixデータを生成。
詳細は[ここ](https://github.com/ggerganov/llama.cpp/issues/7966#issuecomment-2227104693)のissueを追ってください。