New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Azure SDK Review - [Introduction to MaaS Client Library (SDK)] #7385
Comments
Meeting updated by Darren Cohen Service Name: MaaS Client Library (SDK) Hero Scenarios Link: here Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority. Detailed meeting information and documents provided can be accessed here |
Meeting updated by Darren Cohen Service Name: MaaS Client Library (SDK) Hero Scenarios Link: here Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority. TypeSpec PR: Azure/azure-rest-api-specs#28438 Detailed meeting information and documents provided can be accessed here |
Meeting updated by Darren Cohen Service Name: MaaS Client Library (SDK) Hero Scenarios Link: here Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority. TypeSpec PR: Azure/azure-rest-api-specs#28438 Detailed meeting information and documents provided can be accessed here |
Meeting updated by Darren Cohen Service Name: MaaS Client Library (SDK) Hero Scenarios Link: here Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority. TypeSpec PR: Azure/azure-rest-api-specs#28438 Python client library PR: Azure/azure-sdk-for-python#34937 A few slides I will show at the start of the meeting: https://microsoft-my.sharepoint.com/:p:/p/dcohen/EejE6eAFKMtNqDncs6FAZ3gBbEaXXwfA1TLaUCsePPbbFQ?e=btDPst Detailed meeting information and documents provided can be accessed here |
New SDK Review meeting has been requested.
Service Name: MaaS Client Library (SDK)
Review Created By: Darren Cohen
Review Date: 04/11/2024 02:05 PM PT
Release Plan:1253
Hero Scenarios Link: Not Provided
Architecture Diagram Link: Not Provided
Core Concepts Doc Link: Not Provided
APIView Links:
Description: We are writing a Python client library for 1st and 3rd party Large Language Models (LLM) hosted by Azure AI, which will cover the two offerings: Model as a Service (MaaS) and Model as a Platform (MaaP). These services can host any model from the LLM catalog, using the same REST API. The REST API is a subset of the Azure Open AI REST API, with some minimal changes. Python library is a top priority, so we want to go to public preview with it first ASAP. C# client library is next in priority.
The Azure ML service team is NOT using TypeSpec to define the REST API, and have not gone through formal review with this tool. For the release of the Python client library, we will go through format review. TypeSpec files were written for the sole purpose of auto-generation of client libraries.
Detailed meeting information and documents provided can be accessed here
The text was updated successfully, but these errors were encountered: