Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add llama2 llm #1116

Closed
wants to merge 13 commits into from
Closed

Conversation

ErdemOzgen
Copy link
Contributor

  • Added ollama with docker container
  • GPTVulnerabilityReportGenerator : Retrieves an OpenAI API key and sets the model to 'gpt-3.5-turbo'. If the API key is not available, it initializes an Ollama instance for local use.
  • GPTAttackSuggestionGenerator: Similar to the GPTVulnerabilityReportGenerator, it retrieves an OpenAI API key and sets the model to 'gpt-3.5-turbo', or initializes an Ollama instance if the API key is not available.
  • Changed makefile make up and make down sections.
  • After docker container up it will run command to pull llama2-uncensored llm model and serve model.

This PR fixes #1035.

@ErdemOzgen
Copy link
Contributor Author

Based on my understanding, the two failed GitHub Actions are facing distinct issues. The problem does not pertain to a Pull Request (PR). The issue with pulling the Docker image is due to an Error: Username and password required. Meanwhile, the Auto Comment action is encountering a different problem, which could potentially be resolved by ensuring that the GitHub token being used has the appropriate permissions.

@AnonymousWP
Copy link
Collaborator

Uhm, I compared with #1096, but what's the difference? I can't spot any difference when I tried to compare it using the GitHub feature.

@AnonymousWP
Copy link
Collaborator

AnonymousWP commented Dec 8, 2023

Based on my understanding, the two failed GitHub Actions are facing distinct issues. The problem does not pertain to a Pull Request (PR). The issue with pulling the Docker image is due to an Error: Username and password required. Meanwhile, the Auto Comment action is encountering a different problem, which could potentially be resolved by ensuring that the GitHub token being used has the appropriate permissions.

Would you be able to fix this by a new PR? I understand some can't be fixed due to insufficient permissions, though.

@psyray psyray mentioned this pull request Dec 8, 2023
@ErdemOzgen
Copy link
Contributor Author

ErdemOzgen commented Dec 9, 2023

Based on my understanding, the two failed GitHub Actions are facing distinct issues. The problem does not pertain to a Pull Request (PR). The issue with pulling the Docker image is due to an Error: Username and password required. Meanwhile, the Auto Comment action is encountering a different problem, which could potentially be resolved by ensuring that the GitHub token being used has the appropriate permissions.

Would you be able to fix this by a new PR? I understand some can't be fixed due to insufficient permissions, though.

@AnonymousWP You can check this PR
Also fetch my current PR; needs to workflow approval again.

@psyray
Copy link
Collaborator

psyray commented Dec 16, 2023

This need to be tested, @yogeshojha You could test it ?

@yogeshojha
Copy link
Owner

Hi @ErdemOzgen,

Thank you for the excellent work.

I am closing this as I have already merged your changes through this MR
#1259

Thanks

@yogeshojha yogeshojha closed this May 12, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
release/2.1.0 Waiting for Merge Already Worked, waiting to merge
Projects
None yet
Development

Successfully merging this pull request may close these issues.

feat: GPT4All, Open-source large language models that run locally on your CPU and nearly any GPU
4 participants