Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Create and use a training script for LUKE Question Answering Model #171

Open
SawyerCzupka opened this issue Apr 4, 2023 · 0 comments
Open
Assignees
Labels
NLP Natural Language Processing or ML algorithm dev

Comments

@SawyerCzupka
Copy link
Collaborator

LUKE is a transformer model that is especially good at question answering tasks, but the publicly available checkpoints on huggingface.co have not been fine-tuned for question answering yet. To make it possible to integrate this model into the scope pipeline, a script should be made to fine-tune the model on the Stanford Squad dataset and use the script to quickly train the model on the William and Mary HPC.

@SawyerCzupka SawyerCzupka self-assigned this Apr 4, 2023
@SawyerCzupka SawyerCzupka added the NLP Natural Language Processing or ML algorithm dev label Apr 4, 2023
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
NLP Natural Language Processing or ML algorithm dev
Projects
SCOPE Spring 2023
Awaiting triage
Development

When branches are created from issues, their pull requests are automatically linked.

1 participant