Repository navigation
Proper count tokens for conversation / message level #1033
Description
Contact Details
What is your question?
How can I properly get the input and output token numbers for a conversation or a message?
In the Mongo database, thez messages.tokenCount value is null for the non-user messages, am I search it in the wrong place?
Is there a detailed documentation available for the database schama, and its content?
More Details
I try to sum the tokens used by a specified conversation or a specified message stored in the chat database (I use mongo).
What is the main subject of your question?
Other
Screenshots
No response
Code of Conduct
- I agree to follow this project's Code of Conduct
Activity