Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Have you tried different prompts in bi-encode model #36

Open
ttjjlw opened this issue Jun 18, 2023 · 1 comment
Open

Have you tried different prompts in bi-encode model #36

ttjjlw opened this issue Jun 18, 2023 · 1 comment

Comments

@ttjjlw
Copy link

ttjjlw commented Jun 18, 2023

hi
Have you tried different prompts in bi-encode model. in your paper? i only find you tried different prompts in cross-encode model
thanks

@Muennighoff
Copy link
Owner

for the bi-encoder i only tried the actual text itself surrounded by special tokens. I did not try adding additional text - I imagine that task-specific text like done in recent work could help. I tried a few different special tokens results of which are in the appendix I think & the brackets worked best

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants