Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Investigate alternatives for faster (joint) embeddings lookup #1036

Open
gabrielspmoreira opened this issue Mar 24, 2023 · 0 comments
Open

Comments

@gabrielspmoreira
Copy link
Member

gabrielspmoreira commented Mar 24, 2023

@vysarge has done a number of benchmark and profiling experiments using using synthetic data comparing Merlin Models. In particular, she compared DLRM with the JoC DLRM TF implementation, whose experiments results can be found in this spreadsheet (Nvidia internal only).

She noticed in particular that MM implementation uses TF embedding API functions, while JoC uses a custom joint embedding that fuses embedding tables together and performs embeddings jointly with one call [code link], which is faster

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant