Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

add deepseek online models #1765

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

jiangfy-ihep
Copy link
Contributor

@jiangfy-ihep jiangfy-ihep commented May 8, 2024

this PR added support to deepseek online models

modified: config.py
modified: request_llms/bridge_all.py
new file: request_llms/bridge_deepseek.py

@whz-pku
Copy link

whz-pku commented May 9, 2024

请问是把您修改的文件复制进去就可以使用deepseek了嘛

@whz-pku
Copy link

whz-pku commented May 9, 2024

请问是把您修改的文件复制进去就可以使用deepseek了嘛

成功了,多谢大佬!!!!

@yunzhichen
Copy link

request_llms/bridge_deepseek.py

请问详细如何修改?

@xiaofeiyukkk
Copy link

[Local Message] 异常

Traceback (most recent call last):
File ".\request_llms\bridge_deepseek.py", line 208, in predict
chunk = next(stream_response)
^^^^^^^^^^^^^^^^^^^^^
StopIteration

{"detail":"Invalid max_tokens value, the valid range of max_tokens is [0, 4096]"}

系统win10,python 3.11.9
你好,python换过3.12也是同样的错误

@binary-husky
Copy link
Owner

目前和这个pr有一点重叠:
#1782

@binary-husky
Copy link
Owner

我过两天整合一下

@2021533097
Copy link

[Local Message] 异常

Traceback (most recent call last): File ".\request_llms\bridge_deepseek.py", line 208, in predict chunk = next(stream_response) ^^^^^^^^^^^^^^^^^^^^^ StopIteration

{"detail":"Invalid max_tokens value, the valid range of max_tokens is [0, 4096]"}

系统win10,python 3.11.9 你好,python换过3.12也是同样的错误

You are required to make modifications to the code within the bridge_deepseek.py file. More precisely, you should adjust the value of "tokens" on line 323 of bridge_deepseek.py, ensuring it falls within the range of 0 to 4096.

@IcyFeather233
Copy link

IcyFeather233 commented May 24, 2024

按照这种方式修改,翻译arxiv论文的插件似乎不能多线程翻译,只能一条一条翻译,需要再加上这个配置:#1762

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

8 participants