Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider reorganizing file layout to shorten path lengths #1032

Open
scdub opened this issue Dec 8, 2022 · 0 comments
Open

Consider reorganizing file layout to shorten path lengths #1032

scdub opened this issue Dec 8, 2022 · 0 comments
Assignees
Labels
bug Something isn't working

Comments

@scdub
Copy link

scdub commented Dec 8, 2022

Describe the bug
The current package includes path names upwards of 150 characters such as default_8bit_cluster_preserve_quantize_scheme.py which are in turn relatively short files deep in a hierarchy. On Windows, the default limitation for paths is 260 characters as defined by MAX_PATH. While it is possible to modify this on a per-call basis, by default the Python ecosystem's tooling does not make this process simple for end users and there are a variety of tools still limited to the 260 character MAX_PATH. When you combine the path lengths of this repository with a location in a users' profile such as C:\Users\person-fullname\AppData\Local\Python\environments\deep-learning-environment\Lib\site-packages the limit can be exceeded.

Motivation
I work in a context where users can create environments in arbitrary locations and we want to use this package, the workaround we've found for the time being is to repack this repository as a Python egg and inject that into the environment at runtime, but would prefer to be able to use it as a direct Python dependency. Note that this limitation is specific to Windows, fortunately MacOS defaults to a MAXPATHLEN of 1024 and Linux values are typically 1024 or higher.

System information

TensorFlow version (installed from source or binary): All versions

TensorFlow Model Optimization version (installed from source or binary): All versions, specifically found working with v0.7.3.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

No branches or pull requests

2 participants