Cost tracking - [main]

[enricoros]

There must be a way to track costs on the backend and frontend, to predict costs of the operations before running them (to a level of confidence, as output tokens are of course unknown), and having an "economy mode" (with various toggleable features), and also running statistics on token usage, etc.

Tracking the following:

• Usage meter & Cost Estimates #341
• [Roadmap] UX Improvements to incentivise token savings #271

[lightningRalf]

As reference / inspiration or adoption of the sdks:
https://github.com/langfuse

[enricoros]

1.16.0 shows costs when hovering the token counter in the chat.