Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Azure SDK Review - [Introduction to MaaS Client Library (SDK)] #7385

Open
azure-sdk opened this issue Apr 1, 2024 · 4 comments
Open

Azure SDK Review - [Introduction to MaaS Client Library (SDK)] #7385

azure-sdk opened this issue Apr 1, 2024 · 4 comments
Labels
needs-triage This is a new issue that needs to be triaged to the appropriate team.

Comments

@azure-sdk
Copy link
Collaborator

New SDK Review meeting has been requested.

Service Name: MaaS Client Library (SDK)
Review Created By: Darren Cohen
Review Date: 04/11/2024 02:05 PM PT

Release Plan:1253
Hero Scenarios Link: Not Provided
Architecture Diagram Link: Not Provided
Core Concepts Doc Link: Not Provided
APIView Links:

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority.
The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through format review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

Detailed meeting information and documents provided can be accessed here

@github-actions github-actions bot added the needs-triage This is a new issue that needs to be triaged to the appropriate team. label Apr 1, 2024
@azure-sdk
Copy link
Collaborator Author

Meeting updated by Darren Cohen

Service Name: MaaS Client Library (SDK)
Review Created By: Darren Cohen
Review Date: 04/11/2024 02:05 PM PT

Hero Scenarios Link: here
Architecture Diagram Link: Not Provided
Core Concepts Doc Link: here
APIView Links:

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority.
The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through format review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

Detailed meeting information and documents provided can be accessed here

@azure-sdk
Copy link
Collaborator Author

Meeting updated by Darren Cohen

Service Name: MaaS Client Library (SDK)
Review Created By: Darren Cohen
Review Date: 04/11/2024 02:05 PM PT

Hero Scenarios Link: here
Architecture Diagram Link: Not Provided
Core Concepts Doc Link: here
APIView Links:

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority.
The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through format review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

TypeSpec PR: Azure/azure-rest-api-specs#28438
Python client library PR: Azure/azure-sdk-for-python#34937

Detailed meeting information and documents provided can be accessed here

@azure-sdk
Copy link
Collaborator Author

Meeting updated by Darren Cohen

Service Name: MaaS Client Library (SDK)
Review Created By: Darren Cohen
Review Date: 04/11/2024 02:05 PM PT

Hero Scenarios Link: here
Architecture Diagram Link: Not Provided
Core Concepts Doc Link: here
APIView Links: Python,

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority.
The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through format review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

TypeSpec PR: Azure/azure-rest-api-specs#28438
Python client library PR: Azure/azure-sdk-for-python#34937

Detailed meeting information and documents provided can be accessed here

@azure-sdk
Copy link
Collaborator Author

Meeting updated by Darren Cohen

Service Name: MaaS Client Library (SDK)
Review Created By: Darren Cohen
Review Date: 04/11/2024 02:05 PM PT

Hero Scenarios Link: here
Architecture Diagram Link: Not Provided
Core Concepts Doc Link: here
APIView Links: Python,

Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority.
The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through formal review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.

TypeSpec PR: Azure/azure-rest-api-specs#28438

Python client library PR: Azure/azure-sdk-for-python#34937

A few slides I will show at the start of the meeting: https://microsoft-my.sharepoint.com/:p:/p/dcohen/EejE6eAFKMtNqDncs6FAZ3gBbEaXXwfA1TLaUCsePPbbFQ?e=btDPst

Detailed meeting information and documents provided can be accessed here

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
needs-triage This is a new issue that needs to be triaged to the appropriate team.
Projects
None yet
Development

No branches or pull requests

1 participant