About 13.5M tokens total of mixed instruct and RP data.

Both RP datasets and the inkstruct include system prompts to help g3 understand the system role (via <start_of_turn>system).

datasets:
  - path: ToastyPigeon/some-rp-extended
    type: customgemma-regex
  - path: allura-org/inkstructmix-v0.2.1a-system-reasoning-separated
    type: customgemma-regex
    data_files: inkstruct-system.json
    split: train[:750]
  - path: ToastyPigeon/unalign-v2
    type: customgemma-regex
    split: train[:50%]
  - path: ToastyPigeon/synth-rp
    split: train[:20%]
    type: customgemma-regex
Downloads last month
73
Safetensors
Model size
11.8B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for ToastyPigeon/g3-12b-rp-system-v0.1

Finetuned
(16)
this model
Merges
1 model
Quantizations
3 models