Function calling?

#1
by kyleyancey - opened

Can you use OpenAI's function calling with this library? I'd like to allow the realtime voice to control some functions on a web page or a server.

Yes it should be possible. For example, in this demo:

https://fastrtc.org/#__tabbed_1_2

you can modify the llm call to do function calling.

If you build a demo for this please add a PR to add it to the demo directory - https://github.com/freddyaboulton/fastrtc/tree/main/demo

freddyaboulton changed discussion status to closed

Feel free also to join the discord to discuss this further! https://discord.gg/TSWU7HyaYu

Actually see this smolagents demo, it's very close to function calling: https://github.com/freddyaboulton/fastrtc/blob/main/demo/talk_to_smolagents/app.py

Your need to confirm your account before you can post a new comment.

Sign up or log in to comment