Issues: open-compass/opencompass
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Author
Label
Projects
Milestones
Assignee
Sort
Issues list
storycloze_gen 测试不通过,显示torch.distributed.elastic.multiprocessing.api.SignalException [Feature]
#1142
opened May 12, 2024 by
dh12306
1 task
/home/wumao/opencompass-main/opencompass/summarizers/needlebench.py 的sizes是不是少了一个128k [Bug] [Feature]
#1132
opened May 10, 2024 by
1518630367
1 task done
[Bug] Base classes use
@abstractmethod
without subclassing from abc.ABC
#1124
opened May 8, 2024 by
acylam
2 tasks done
[Feature] 请问在使用VLLM测评模型humaneval时,batch_size 不同导致 测评结果有区别是为什么?
#1097
opened Apr 26, 2024 by
noforit
1 task
[Feature] 是否可以对arc-e和arc-c的base模型评估增加25-shot with choice
#1082
opened Apr 24, 2024 by
siftxxx
1 task
[Bug] There is a large gap in the partial subset of the long text evaluation data set
#1061
opened Apr 19, 2024 by
bullw
2 tasks done
为什么基于openai api部署的llama2-7b-chat-hf,在MMLU数据集上测试精度远低于官方数据
#1037
opened Apr 11, 2024 by
wz0424
2 tasks done
[Bug] AttributeError: module 'pkgutil' has no attribute 'ImpImporter'. Did you mean: 'zipimporter'?
#1007
opened Mar 28, 2024 by
A-A-T-i-P
2 tasks done
Previous Next
ProTip!
Exclude everything labeled
bug
with -label:bug.