Implement usage data for streaming chats #44112
Labels
Client
This issue points to a problem in the data-plane of the library.
customer-reported
Issues that are reported by GitHub users external to the Azure organization.
needs-team-attention
This issue needs attention from Azure service team or SDK team
OpenAI
question
The issue doesn't require a change to the product in order to be resolved. Most issues start as that
Service Attention
This issue is responsible by Azure service team.
Library name
Azure.AI.OpenAI
Please describe the feature.
Currently you can't get the usage data if you're using the streaming option for ChatRequests (
GetChatCompletionsStreamingAsync
). This seems to be possible with Open AI's API - see here. It would be great if we could do the same, so we can keep track of our own usage per request.The text was updated successfully, but these errors were encountered: