GGUF
English
Japanese
conversational

plamo-2-translate-gguf

pfnetさんが公開しているplamo-2-translateのggufフォーマット変換版です。

imatrixのデータはTFMC/imatrix-dataset-for-japanese-llmを使用して作成しました。

Usage

git clone https://github.com/ggml-org/llama.cpp.git
cd llama.cpp
cmake -B build -DGGML_CUDA=ON
cmake --build build --config Release
build/bin/llama-cli -m 'plamo-2-translate-gguf' -n 128 -c 128 -p '<|plamo:op|>dataset\ntranslation\n\n<|plamo:op|>input lang=English\nWrite the text to be translated here.\n<|plamo:op|>output lang=Japanese' -no-cnv
Downloads last month
675
GGUF
Model size
9.53B params
Architecture
plamo2
Hardware compatibility
Log In to view the estimation

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for mmnga/plamo-2-translate-gguf

Base model

pfnet/plamo-2-8b
Quantized
(1)
this model

Dataset used to train mmnga/plamo-2-translate-gguf