Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Python: Semantic Kernel Planners not working with Huggingface AI Service #6091

Open
Sruinard opened this issue May 1, 2024 · 0 comments
Open
Assignees
Labels
planner Anything related to planner or plans python Pull requests for the Python Semantic Kernel

Comments

@Sruinard
Copy link

Sruinard commented May 1, 2024

Objective: better experience for developers leveraging opensource models

Many of the examples leverage (Azure) OpenAI, but seem to have not been tested with other model providers.
Planners are one such example. I would expect functions to be executed, results parsed and leveraged in further reasoning.
Even a simple example of retrieving current date + time is not working/executing.

I have created an example here: huggingface-with-planners

Additional note:

  • I believe the main thing is that we should expose more control through the generation config.
  • We probably want to be able to set/overwrite the default execution_settings for an ai-service.
  • For the planner, we should be able to control the stopping criteria and how the results of the ai-service are returned (i.e. prompt + generated context or just generated content)
@markwallace-microsoft markwallace-microsoft added python Pull requests for the Python Semantic Kernel triage labels May 1, 2024
@github-actions github-actions bot changed the title Semantic Kernel Planners not working with Huggingface AI Service Python: Semantic Kernel Planners not working with Huggingface AI Service May 1, 2024
@moonbox3 moonbox3 self-assigned this May 7, 2024
@moonbox3 moonbox3 added planner Anything related to planner or plans and removed triage labels May 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
planner Anything related to planner or plans python Pull requests for the Python Semantic Kernel
Projects
Status: No status
Development

No branches or pull requests

3 participants