Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Move encoders to backend. #37

Open
marty1885 opened this issue Jul 10, 2019 · 0 comments
Open

Move encoders to backend. #37

marty1885 opened this issue Jul 10, 2019 · 0 comments
Labels
optimization make stuff faster!

Comments

@marty1885
Copy link
Member

One of the bottleneck Etaler have is that encoding is done in the frontend. Which is easy to implement. You encode the SDR into an array and call Tensor() to copy whatever data is in that array into a real Tensor. But this is very slow. On CPU, there is at least one extra array copy and memory allocation. One GPU, the current code path copies the entire array over PCIe to the GPU.

So the obvious solution is to move the responsibility of encoding data to the backend. But could we do so in an elegant way? And we need to maintain the high expandability.

@marty1885 marty1885 added the optimization make stuff faster! label Jul 10, 2019
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
optimization make stuff faster!
Projects
None yet
Development

No branches or pull requests

1 participant