Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Using NNI with nn-Meter #117

Open
singagan opened this issue Apr 7, 2023 · 4 comments
Open

Using NNI with nn-Meter #117

singagan opened this issue Apr 7, 2023 · 4 comments

Comments

@singagan
Copy link

singagan commented Apr 7, 2023

Hi, seems like your ProxylessNAS example is not supported by NNI anymore as they have moved to a completely different backend (instead of retiarri). Please, do you have an updated example that works with the newer version?
https://github.com/microsoft/nni/blob/master/nni/nas/hub/pytorch/proxylessnas.py

Thanks.

@JiahangXu
Copy link
Collaborator

Thanks for raising this issue. Here is the latest version of Hardware-aware NAS, and nn-meter performs as a (profiler)[https://nni.readthedocs.io/en/latest/reference/nas.html#nni.nas.profiler.pytorch.nn_meter.NnMeterProfiler] in new architecture. You can try newer versions of NnMeterProfiler now. Notice that you should use the dev version of nn-Meter and NNI.

Thanks.
Jiahang

@singagan
Copy link
Author

Thanks a lot! I have two questions:

  1. Is it possible to add multiple objectives like both latency (using nn-meter) and model size which doing search with ProxylessNAS?
  2. Is there a significant difference between the new nni architecture and retiarrii for HW-aware NAS?

@JiahangXu
Copy link
Collaborator

Hi, thanks for your interests to NNI and nn-Meter. Let me defer to my colleague as the main maintainer of NNI NAS module to answer these questions. @ultmaster Thanks a lot Yuge!

@matluster
Copy link

  1. You need a new (probably custom defined profiler).
  2. NNI NAS 3.0 is an upgraded version of Retiarii NAS. The old version is out-of-date and won't be maintained any more.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants