Added first token latency and replaced latency with total generation time.

#2
by KingNish - opened
Cannot merge
This branch has merge conflicts in the following files:
  • src/lib/components/InferencePlayground/InferencePlayground.svelte
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment