Skip to content
#

kan

Here are 20 public repositories matching this topic...

High order and sparse layers in pytorch. Lagrange Polynomial, Piecewise Lagrange Polynomial, Piecewise Discontinuous Lagrange Polynomial (Chebyshev nodes) and Fourier Series layers of arbitrary order. Piecewise implementations could be thought of as a 1d grid (for each neuron) where each grid element is Lagrange polynomial. Both full connected a…

  • Updated May 30, 2024
  • Python

An implementation of the KAN architecture using learnable activation functions for knowledge distillation on the MNIST handwritten digits dataset. The project demonstrates distilling a three-layer teacher KAN model into a more compact two-layer student model, comparing the performance impacts of distillation versus non-distilled models.

  • Updated May 11, 2024
  • Python

Improve this page

Add a description, image, and links to the kan topic page so that developers can more easily learn about it.

Curate this topic

Add this topic to your repo

To associate your repository with the kan topic, visit your repo's landing page and select "manage topics."

Learn more