Interface: TextGenerationStreamToken

Properties

id

• id: number

Token ID from the model tokenizer

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:9

---

logprob

• logprob: number

Logprob

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:13

---

special

• special: boolean

Is the token a special token Can be used to ignore tokens when concatenating

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:18

---

text

• text: string

Token text

Defined in

inference/src/tasks/nlp/textGenerationStream.ts:11

< > Update on GitHub