Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We鈥檒l occasionally send you account related emails.

Already on GitHub? Sign in to your account

[GraphBolt] There should be an easy way to use fp16 or bf16 #7334

Open
mfbalin opened this issue Apr 20, 2024 · 0 comments
Open

[GraphBolt] There should be an easy way to use fp16 or bf16 #7334

mfbalin opened this issue Apr 20, 2024 · 0 comments
Labels
feature request Feature request

Comments

@mfbalin
Copy link
Collaborator

mfbalin commented Apr 20, 2024

馃敤Work Item

IMPORTANT:

  • This template is only for dev team to track project progress. For feature request or bug report, please use the corresponding issue templates.
  • DO NOT create a new work item if the purpose is to fix an existing issue or feature request. We will directly use the issue in the project tracker.

Project tracker: https://github.com/orgs/dmlc/projects/2

Description

In our examples, there should be an easy way to switch to lower precision for feature storage and/or training.

Let's say we load a dataset and the memory consumption is high. The user may want to cast the features tensor to float16 or bfloat16. However, it is not easy to do that with our existing abstractions. Either the Feature or TorchBasedFeature class or the BuiltinDataset should have a way to specify the feature datatype either during loading or cast after loading.

@mfbalin mfbalin added the feature request Feature request label Apr 20, 2024
@mfbalin mfbalin changed the title [GraphBolt] There should be an easy way to cast to fp16 or bf16 [GraphBolt] There should be an easy way to use fp16 or bf16 Apr 20, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
feature request Feature request
Projects
Status: 馃彔 Backlog
Development

No branches or pull requests

1 participant