microsoft/Phi-4-multimodal-instruct · transformers-4.50 or higher

May 23

•

model = AutoModelForCausalLM.from_pretrained("microsoft/Phi-4-multimodal-instruct", trust_remote_code=True)
breaks with this error

AttributeError: 'Phi4MMModel' object has no attribute 'prepare_inputs_for_generation'

it's normal since prepare_inputs_for_generation() is from GenerationMixin and PreTrainedModel will NOT inherit from GenerationMixintransformers-4.50

Suggestion: Either

add GenerationMixin to Phi4MMModel
or
create a dummy prepare_inputs_for_generation() method under Phi4MMModel class

Chuntianli

May 23

same

sc0ttypee

May 25

same

jangmin

May 27

same .plz fix it.

Lexius

27 days ago

I created a fork where I fixed the issue by adding a dummy function prepare_inputs_for_generation() as suggested by @mqpham : https://huggingface.co/Lexius/Phi-4-multimodal-instruct

RhiteshKS

19 days ago

Thanks to @Lexius ! works like a charm.

TemryL

17 days ago

Using transformers==4.51.3 works too

mqpham

15 days ago

yeah, phi-4 was implemented in transformers intead of using Microsoft implementation