ValueError During SFT Fine-tuning with Gamma3 Model
#5
by
rfhshfhs
- opened
Problem Description
Encountering ValueError: Processor was not found error when performing SFT (Supervised Fine-Tuning) on Gamma3 model using LLaMA-Factory.
Environment
LLaMA-Factory Version: 0.9.3
Python Version: 3.10
Operating System: Linux
Model: Gamma3
Training Type: SFT (Supervised Fine-Tuning)
Hardware: GPU
Error Details
Error Message
Full Stack Trace
Error Location
The error occurs during the data preprocessing stage of SFT workflow, specifically in the _get_preprocessed_dataset function within data/loader.py.
This comment has been hidden (marked as Spam)
You might need to use gemma2 template for fine-tuning the gemma3-270m-it model because it is not multimodal