Skip to content

Pehlevan-Group/kernel-generalization

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Theory of Kernel Generalization

Experiments and figures of the paper "Spectral Bias and Task-Model Alignment Explain Generalization in Kernel Regression and Infinitely Wide Neural Networks" https://arxiv.org/abs/2006.13198

Paper experiments:

Synthetic Data - Gaussian Regression: Open In Colab

Synthetic Data - NTK Regression and NN: Open In Colab

Synthetic Data - Synthetic Kernel Regression: Open In Colab

Real Data - Gaussian Regression: Open In Colab

Numerical Computation of NTK Eigenvalues: Open In Colab

Recreate the figures using precomputed data:

Fig. 1 and Fig. SI.10: Open In Colab

Fig. 2 and Fig. SI.1: Open In Colab

Fig. 3, Fig. 4, Fig. SI.2: Open In Colab

Fig. 5 and Fig. SI.5: Open In Colab

Fig. 6, Fig. SI.8, Fig. SI.9: Open In Colab

Fig. SI.6 and Fig. SI.7: Open In Colab and Open In Colab