Tool calling no stream

#4
by yuchenxie - opened

can someone explain to me what it meant that tool calling cannot be streamed? My understanding is that I would have to add the stream: "false" flag when I call the api? If im working with Roocode or Cline with dynamic autonomous tool calling do I have to turn stream off?

NVIDIA org

Our current tool-parser which returns the tool-call in OAI format only works with stream: "false" for now.

Sign up or log in to comment