This repository has been archived by the owner on May 14, 2024. It is now read-only.

Integration with huggingface #12

Open

arsalan993 opened this issue Dec 3, 2021 · 1 comment

arsalan993 commented Dec 3, 2021

If somehow we can integrate this with hugging face models while doing inference then its job is done for production-level deployments.

Owner

rentruewang commented Dec 5, 2021

Agreed. Will work on it when I have the time.

tlby mentioned this issue

Trainer batch size auto scaling huggingface/transformers#14200

Closed

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.