What does "use as API" mean in README?

#1
by tastypear - opened

I see the phrase "Recommend to use as API" in the README file. Are you referring to the Gradio API?

BTW, I tried to create an OpenAI-compatible interface using client = InferenceClient("google/gemma-3-27b-it") and fastapi, but it didn't work. The requests were automatically routed to the HuggingFace Serverless Interface and failed to respond. Very strange.

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment