Fix auxlib.logz.stringify excess memory allocation #13628
Merged
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
This addresses the excess resource usage observed in gh-13541.
Essentially, the whole
repodata.json
is parsed viarequests.Response.json
and then dumped into a formatted string -- with both parts allocating multiple GB in RAM for large channels likeconda-forge
.All this happens in a context only for (intended) debug logging output which is meant to constrain the log message length (and in turn memory usage); the proposed changes just apply the intended size constraints.
(It only handles the severe run time impact but doesn't fix the underlying cause for gh-13541.)
Checklist - did you ...
news
directory (using the template) for the next release's release notes?[ ] Add / update outdated documentation?