Skip to content

We explore improving sparse matrix operation efficiency using the Compressed Sparse Row (CSR) format. In the process, we explore an application of the Lanczos algorithm in efficiently computing a low–rank approximation of SVD for sparse matrices.

aneeshdurai/sparse_data_final_project

Repository files navigation

Efficient data handling is widely used in machine learning especially with the increasing prevalence of large and sparse datasets. In this paper, we explore improving sparse matrix operation efficiency using the Compressed Sparse Row (CSR) format. Focusing on Linear Regression techniques and Singular Value Decomposition (SVD), we investigate methods to optimize these operations for sparse matrices. In the process, we explore an application of the Lanczos algorithm in efficiently computing a low–rank approximation of SVD for sparse matrices. Our approach demonstrates notable improvements and thus can contribute to a wide array of practices done in larger scales by data engineers.

About

We explore improving sparse matrix operation efficiency using the Compressed Sparse Row (CSR) format. In the process, we explore an application of the Lanczos algorithm in efficiently computing a low–rank approximation of SVD for sparse matrices.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published