Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[QUERY] using 1106 0125 models which support parallel function calling. #40039

Open
sravanthi-tl opened this issue May 5, 2024 · 2 comments
Open
Assignees
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-triage This issue needs the team to triage. OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that

Comments

@sravanthi-tl
Copy link

OpenAIServiceVersion seems to be an enum with few models.
Is there a way 1106 0125 models which have support for parallel function calling can be used.
These version enum constants are not present.

Class in query: https://github.com/Azure/azure-sdk-for-java/blob/main/sdk/openai/azure-ai-openai/src/main/java/com/azure/ai/openai/OpenAIServiceVersion.java

Models in request : https://techcommunity.microsoft.com/t5/ai-azure-ai-services-blog/azure-openai-service-launches-gpt-4-turbo-and-gpt-3-5-turbo-1106/ba-p/3985962

Model availability in region: https://learn.microsoft.com/en-gb/azure/ai-services/openai/concepts/models

@github-actions github-actions bot added Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-triage This issue needs the team to triage. OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that labels May 5, 2024
@joshfree
Copy link
Member

joshfree commented May 6, 2024

@mssfang could you please follow up?

@mssfang
Copy link
Member

mssfang commented May 14, 2024

Hi @sravanthi-tl
As I know, Azure OpenAI supports those listed versions at current stage.
https://github.com/Azure/azure-rest-api-specs/blob/main/specification/cognitiveservices/OpenAI.Inference/main.tsp#L43

And the service retires older versions described in https://learn.microsoft.com/en-us/azure/ai-services/openai/api-version-deprecation

I think you may be confused at between model version and the service API version
The enum values in OpenAIServiceVersion is the service API version but gpt-4-turbo and gpt-3.5-turbo-1106 is the model version.

You can request with request model version in service API version (depends on the model version available and service API version supported).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
Client This issue points to a problem in the data-plane of the library. customer-reported Issues that are reported by GitHub users external to the Azure organization. needs-team-triage This issue needs the team to triage. OpenAI question The issue doesn't require a change to the product in order to be resolved. Most issues start as that
Projects
None yet
Development

No branches or pull requests

3 participants