@simon first of all thank you very much.
In your llm logs output you have "total_tokens". I do not have it, I have a lot of time "totalTokenCount": 3522"
https://gist.github.com/aborruso/6004d5daacc1a7096a07b2af381dec2b
Am I doing something wrong
Top-level
@simon first of all thank you very much. In your llm logs output you have "total_tokens". I do not have it, I have a lot of time "totalTokenCount": 3522" https://gist.github.com/aborruso/6004d5daacc1a7096a07b2af381dec2b Am I doing something wrong 2 comments
@simon Sorry, another stupid question: and in my case I have to add up all the totalTokenCounts? Thank you |
@aborruso that output is different for different models - I have a future plan to normalize those and store them separately in the database