Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

accumulate total tokens spent referenced with prompt names #71

Open
h1alexbel opened this issue Apr 5, 2024 · 2 comments
Open

accumulate total tokens spent referenced with prompt names #71

h1alexbel opened this issue Apr 5, 2024 · 2 comments
Assignees
Labels
help wanted Extra attention is needed

Comments

@h1alexbel
Copy link
Contributor

No description provided.

Copy link

github-actions bot commented Apr 5, 2024

@h1alexbel the issue body is empty, please provide more details for this problem.

@h1alexbel
Copy link
Contributor Author

let's accumulate the total token spent of the LLM we use. I suggest to stick to this formatting:

total token spent: 7

analysis: 1
validate: 1
validate.json: 1
top: 1
candidate.json: 1
suggestions: 1
suggestions.json: 1

we even can render more attractive graph or table with this information

@h1alexbel h1alexbel added the help wanted Extra attention is needed label Apr 5, 2024
@h1alexbel h1alexbel self-assigned this Apr 10, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
help wanted Extra attention is needed
Projects
None yet
Development

No branches or pull requests

1 participant