We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
is there any code for training tinyllama, I just saw the code for llama inference.
The text was updated successfully, but these errors were encountered:
There's a 500$ bounty for "Training TinyLlama with >50% MFU"
Sorry, something went wrong.
so there is no any basic training code with low MFU to use, right?
maybe I should add the baseline code for tinyllama training?
Go for it 😄 If you put up a PR for the baseline code, I'm sure others would help you achieve >50% MFU if you haven't already gotten it.
No branches or pull requests
is there any code for training tinyllama, I just saw the code for llama inference.
The text was updated successfully, but these errors were encountered: