How to deploy on inference endpoints?
#3
by
brianjking
- opened
Hi @HuggingFaceM4-- How do you deploy idefics2 on an inference endpoint?
When I try it tells me I'm missing a custom handler.py.
Thanks!
I don't know but see this discussion https://huggingface.co/HuggingFaceM4/idefics2-8b/discussions/32#6643227eccd23856c6de95a8 in case someone answers
I answered in the other thread, the same settings worked for idefics2-8b-chatty. https://huggingface.co/HuggingFaceM4/idefics2-8b/discussions/32#6655b586202bd95576ebca9a