license: apache-2.0
a LoRA fine-tuned model with Japanese dataset
LoRA Experiment
Base Model
https://huggingface.co/BlinkDL/rwkv-4-raven/tree/main
RWKV-4-Raven-7B-v10-Eng89%25-Jpn10%25-Other1%25-20230420-ctx4096.pth
Dataset
https://huggingface.co/datasets/kunishou/hh-rlhf-49k-ja
https://huggingface.co/datasets/kunishou/databricks-dolly-15k-ja