Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[BUG] Gibberish output after few messages when using dolphin-llama3:70b on ollama. #2206

Open
3 tasks done
Mikhael-Danilov opened this issue May 9, 2024 · 2 comments
Open
3 tasks done
Labels
🐛 Bug [ISSUE] Ticket describing something that isn't working 🐧 Linux [ISSUE] The Environment is on Linux

Comments

@Mikhael-Danilov
Copy link

Environment

🐧 Linux

System

ubuntu 22.04

Version

SillyTavern 1.11.8 'release' (204a934)

Desktop Information

node --version
v12.22.9

ollama --version
ollama version is 0.1.34

Model: dolphin-llama3:70b 39cf3e48a70

Describe the problem

After few messages, chat start output gibberish like:
\\\ },""#im)//­ &#�..�\'\x,8\,\ for\ ""

Few first message are fine,

Additional info

No response

Please tick the boxes

@Mikhael-Danilov Mikhael-Danilov added the 🐛 Bug [ISSUE] Ticket describing something that isn't working label May 9, 2024
@github-actions github-actions bot added the 🐧 Linux [ISSUE] The Environment is on Linux label May 9, 2024
@Cohee1207
Copy link
Member

Settings and prompt presets used?

@Mikhael-Danilov
Copy link
Author

Llama 3 Instruct, tried the other with no visible changes in results.
Also tried different context length, with no visible effect.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
🐛 Bug [ISSUE] Ticket describing something that isn't working 🐧 Linux [ISSUE] The Environment is on Linux
Projects
None yet
Development

No branches or pull requests

2 participants