Skip to content

Latest commit

 

History

History
3 lines (3 loc) · 350 Bytes

README.md

File metadata and controls

3 lines (3 loc) · 350 Bytes

RoBERT Recurrence over BERT

pyTorch implementation of Recurrence over BERT (RoBERT) based on this paper https://arxiv.org/abs/1910.10781 and comparison with pyTorch implementation of other Hierarchical Methods (Mean Pooling and Max Pooling) and Truncation Methods (Head Only and Tail Only) presented in this paper https://arxiv.org/abs/1905.05583