Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add documentation for google vertex ai backend #93

Open
wants to merge 2 commits into
base: main
Choose a base branch
from

Conversation

mfahlandt
Copy link

@mfahlandt mfahlandt commented Feb 25, 2024

πŸ“‘ Description

Adds documentation for feature PR984

βœ… Checks

  • My pull request adheres to the code style of this project
  • My code requires changes to the documentation
  • I have updated the documentation as required
  • All the tests have passed

β„Ή Additional Information

Signed-off-by: Mario Fahlandt <mfahlandt@pixel-haufen.de>
Copy link

netlify bot commented Feb 25, 2024

βœ… Deploy Preview for meek-marigold-103c48 ready!

Name Link
πŸ”¨ Latest commit c4af680
πŸ” Latest deploy log https://app.netlify.com/sites/meek-marigold-103c48/deploys/65f837f5804007000899a39e
😎 Deploy Preview https://deploy-preview-93--meek-marigold-103c48.netlify.app
πŸ“± Preview on mobile
Toggle QR Code...

QR Code

Use your smartphone camera to open QR code link.

To edit notification comments on pull requests, go to your Netlify site configuration.

@@ -2,14 +2,15 @@

A Backend (also called Provider) is a service that provides access to the AI language model. There are many different backends available for K8sGPT. Each backend has its own strengths and weaknesses, so it is important to choose the one that is right for your needs.

Currently, we have a total of 8 backends available:
Currently, we have a total of 9 backends available:
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We will need to update this once the Hugging Face Docs is merged

- To use [Google Vertex AI](https://cloud.google.com/vertex-ai?#build-with-gemini) you need to be authorized via [Google Cloud SDK](https://cloud.google.com/sdk/install).
The [Vertex AI API](https://console.cloud.google.com/apis/library/vertex-ai.googleapis.com) needs to be enabled.

> Note: Vertex AI Gemini API is currently available in these [regions](https://cloud.google.com/vertex-ai/docs/generative-ai/model-reference/gemini?hl=de#http_request)
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Is this expected to change? Maybe write something more along the lines of:
"Verify that the Vertex AI Gemini API is available in your region"

This makes it sound more timeless independent to how things change on the Google side :)

Copy link
Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Agree to some degree, the only issue I have is, you can basically use the other regions to debug clusters not in this region. I added a more clarification hope this fits!

Copy link
Member

@AnaisUrlichs AnaisUrlichs left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Two small comments, otherwise, looks good to me

Signed-off-by: Mario Fahlandt <mfahlandt@pixel-haufen.de>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

2 participants