Can we use open router?

#24
by vivoilpazzo2 - opened

Hello how can we self host it and switch to open router instead of HF?

It's open source so yes you can do whatever you want with the code (it would be quite easy to switch to any open ai compatible api)

@victor Hi to use openrouter api, do we simply need to modify the .env file ?
I was a bit confused about the inferencing provider Nebius, Sambanova, ...

@victor Hi to use openrouter api, do we simply need to modify the .env file ?

No you need to modify the code directly (custom endpoints not supported) but that should be quite easy

enzostvs changed discussion status to closed
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment