Popular repositories

1. NeuroSurgeon NeuroSurgeon Public

   NeuroSurgeon is a package that enables researchers to uncover and manipulate subnetworks within models in Huggingface Transformers

   Python 33 1

2. Compositional_Subnetworks Compositional_Subnetworks Public

   Code for the paper Break It Down: Evidence for Structural Compositionality in Neural Networks, presented at NeurIPS 2023

   Python 6

3. Representations_Of_Syntax Representations_Of_Syntax Public

   Code and Resources for the paper 'Representations of Syntax [MASK] Useful: Effects of Constituency and Dependency Structure in Recursive LSTMs' by Lepori, Linzen, and McCoy

   Python 5 1

4. Picking_BERTs_Brain Picking_BERTs_Brain Public

   Code and Data for Picking BERT's Brain: Probing for Linguistic Dependencies in Contextualized Embeddings Using Representational Similarity Analysis by Michael Lepori and R. Thomas McCoy, presented …

   Python 4 1

5. Circuit_Probing Circuit_Probing Public

   Codebase for Uncovering Causal Variables in Transformers Using Circuit Probing

   Jupyter Notebook 3 2

6. TreeTransformers TreeTransformers Public

   Modified transformer architecture, replacing linear positional encodings with tree-based positional encodings.

   Python 1