How to load the checkpoints into a HF model?

[jmkuebler]

Thanks for releasing the intermediate checkpoints. It is though not clear to me how they were created and hence how to load them properly.
To be concrete:
How can I load a HF model that has weights of one of the intermediate checkpoints? (assuming I have all and only the files corresponding to a checkpoint in a local folder already)

Thank you