Pinned

1. transformer-from-scratch transformer-from-scratch Public

   Well documented, unit tested, type checked and formatted implementation of a vanilla transformer - for educational purposes.

   Python 185 37

2. calibration-on-disagreement-data calibration-on-disagreement-data Public

   Code accompanying the EMNLP 2022 paper "Stop Measuring Calibration When Humans Disagree" in which we show problems with popular calibration metrics like ECE in settings where more than one answer i…

   Jupyter Notebook 3 1

3. dmg-illc/nlg-uncertainty-probes dmg-illc/nlg-uncertainty-probes Public

   Code to probe Natural Language Generation (NLG) systems for their uncertainty, and to evaluate it against human production variability (i.e., aleatoric uncertainty)

   Jupyter Notebook 3 3