Supervised-NLP-from-Facebook-AI-Team

‪From BERT to roBERTa, now No 1 on GLUE benchmark. It’s a self-supervised NLP system from Facebook AI team.

‪This is a proof of collaborative research. Facebook built on Google AI BERT to release a robustly optimized system that was trained longer, on more data. ‬

‪Beats XLNet by 0.1‬

https://arxiv.org/abs/1810.04805