Second_test_LLM_3 / README.md
Magjot's picture
Upload 2 files
9dc5f49 verified

transformers>=4.41.0 torch>=2.2.0 peft>=0.10.0 accelerate>=0.30.0


language: - yo - ig tags: - translation - text-generation - nigerian-languages - causal-lm - peft - lora pipeline_tag: text-generation license: apache-2.0

πŸ‡³πŸ‡¬ Nigerian Language LLM – Yoruba to Igbo Translator

This is a fine-tuned version of google/gemma-2b-it using Low-Rank Adaptation (LoRA) for Yoruba β†’ Igbo translation.

🧠 Model Details

  • Base Model: google/gemma-2b-it
  • Fine-tuned with: PEFT (LoRA), using q_proj and v_proj
  • Task: Causal Language Modeling
  • Use Case: Translate Yoruba sentences to Igbo with cultural awareness
  • Training Data: Nigerian bilingual dataset from mydialecta/Dialecta_dataset

πŸ—£οΈ Example Prompt