We implement the sparse sketch reducer (S2 Reducer) on pytorch 1.9. Folder LSTM/ contains the LSTM training code, which is a custom training code based on 'PowerSGD'. Folder GNMT/ contains the GNMT-8/16 training code, which is a custom training code based on the benchmark of MLPref. These two models yield sparse gradient from embedding matrix. ./codings contains the main code of sparse-sketch.
GeKeShi/Sparse_Sketch_Reducer
This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository.
About
No description, website, or topics provided.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published