Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

[MODEL EVALUATION REQUEST] Jamba #359

Open
8 tasks done
KennethEnevoldsen opened this issue Mar 29, 2024 · 1 comment
Open
8 tasks done

[MODEL EVALUATION REQUEST] Jamba #359

KennethEnevoldsen opened this issue Mar 29, 2024 · 1 comment
Labels
large model (>7B) This model has more than 7B parameters, requiring more than an RTX 4090 GPU to evaluate. model evaluation request Request to evaluate a model and add it to the leaderboard(s)

Comments

@KennethEnevoldsen
Copy link
Collaborator

KennethEnevoldsen commented Mar 29, 2024 •
edited by saattrupdan

Model ID

ai21labs/Jamba-v0.1

Model type

Decoder model (e.g., GPT)

Model languages

  • Danish
  • Swedish
  • Norwegian (Bokmål or Nynorsk)
  • Icelandic
  • Faroese
  • German
  • Dutch
  • English

Merged model

Not a merged model
@KennethEnevoldsen
Copy link
Collaborator Author

@saattrupdan would love to see it evaluated for Danish as well to see how it compares with mistral as a base.

@saattrupdan saattrupdan changed the title Jamba [MODEL EVALUATION REQUEST] Jamba Apr 11, 2024
@saattrupdan saattrupdan added model evaluation request Request to evaluate a model and add it to the leaderboard(s) large model (>7B) This model has more than 7B parameters, requiring more than an RTX 4090 GPU to evaluate. labels Apr 11, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
large model (>7B) This model has more than 7B parameters, requiring more than an RTX 4090 GPU to evaluate. model evaluation request Request to evaluate a model and add it to the leaderboard(s)
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
2 participants
@KennethEnevoldsen @saattrupdan