LLMReply
Summarizes LLM metrics.
typeName
enum<string>
requiredAvailable options:
LLMChunk
, LLMReply
isFinal
boolean
Indicates if this is the final chunk.
userInput
required
The user input.
success
boolean
requiredIndicates if the request was successful.
ttftMsec
number
requiredThe time in milliseconds to produce the first token of generated content.
ttltMsec
number
requiredThe time in milliseconds to produce the last token of generated content.
tokenCount
number
requiredThe number of tokens in the generated content.
wordCount
number
requiredThe number of words in the generated content.
enOutput
string
The generated content in English, provided by Sutra models when input is not English.