Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

I make completion request to GPT-4__0125-preview and gpt35turbo 0613 successfully. If AOAI models still support Completions API? #122524

Closed
zh0903 opened this issue May 15, 2024 · 9 comments

Comments

@zh0903
Copy link

zh0903 commented May 15, 2024

If AOAI models still support Completions API?

This doc mentioned: "GPT-3.5 Turbo versions 0613 and 1106 only support the Chat Completions API."
"GPT-4 and GPT-4 Turbo models ..... These models can only be used with the Chat Completion API."

But I make completion request to GPT-4__0125-preview and gpt35turbo 0613 successfully.
How is the completion function of the current model managed?

completion request ID:
0d013d55-ef05-4377-ae0d-b8ea37265cea
07f06c6f-7d00-4bdc-bd33-735df4581899
0fb5f56f-cd07-4c22-9080-2e9909440109
88ecb708-a7ef-4f19-96a4-865d53ff6c49
e1723e87-6747-4340-ac2e-21f67ffdabc9


Document Details

Do not edit this section. It is required for learn.microsoft.com ➟ GitHub issue linking.

@PesalaPavan
Copy link
Contributor

@zh0903
Thanks for your feedback! We will investigate and update as appropriate.

@Naveenommi-MSFT
Copy link
Contributor

Hi @zh0903
GPT-3.5 Turbo is used with the Chat Completion API. GPT-3.5 Turbo version 0301 can also be used with the Completions API. GPT-3.5 Turbo versions 0613 and 1106 only support the Chat Completions API. Please refer this below link for your reference.

https://learn.microsoft.com/en-us/answers/questions/1524621/gpt-35-turbo-0613-does-not-support-chat-completion

@zh0903
Copy link
Author

zh0903 commented May 17, 2024

I make completion request to GPT-4__0125-preview and gpt35turbo 0613 successfully.
How is the completion function of the current model managed?

Would you be so kind as to check backend logs of following request ID?
completion request ID:
0d013d55-ef05-4377-ae0d-b8ea37265cea
07f06c6f-7d00-4bdc-bd33-735df4581899
0fb5f56f-cd07-4c22-9080-2e9909440109
88ecb708-a7ef-4f19-96a4-865d53ff6c49
e1723e87-6747-4340-ac2e-21f67ffdabc9

@Naveenommi-MSFT
Copy link
Contributor

@zh0903
Thank you for bringing this to our attention.
I've delegated this to content author @mrbullwinkle, who will review it and offer their insightful opinions.

@Naveenommi-MSFT
Copy link
Contributor

@mrbullwinkle
Could you please review add comments on this, update as appropriate.

@mrbullwinkle
Copy link
Contributor

Adding @gojira for awareness.

@mrbullwinkle
Copy link
Contributor

@zh0903 can you provide the region the resource you are seeing this behavior in, as well as the api-version you are using when making the completion calls?

If you open a support case they can run down that info from your request ids and troubleshoot further with you, but I can quick test to see if I am able to repro on my end if you provide region/api version. If you are able to make completion calls with those models instead of just chat completion calls that would indicate a misconfiguration/bug.

@zh0903
Copy link
Author

zh0903 commented May 21, 2024

@mrbullwinkle
region: northcentralus
AOAI resource name : NCUS-DOGFOOD
api-version:2024-04-01-preview

Program manager shirk anwsering my question.

@mrbullwinkle
Copy link
Contributor

@zh0903 I didn't realize you were internal to MSFT. Ping me internally on teams or e-mail: alias = mbullwin and I can help you.

@zh0903 zh0903 closed this as completed May 22, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

4 participants