You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A community user recently bumped up against a 64 KB buffer in Zed's "line" reader which led to addressing brimdata/zed#5043 to bump that up to 25 MB. Now that the Zed layer is no longer as limiting, I happened to try loading some large values into Zui and found it seems to have a limit when it comes to displaying values larger than about 2 MB.
The repro video below shows the exact moment where the limit is reached. For the largest value that's known to work, we create and populate a pool with a 2097153-character string and then another pool with a 2097154-character string. As you you can see, the 2097153-character string gets rendered ok, but the 2097154-character string is blank.
$ zed create -use 2097153
$ perl -E 'say "=" x 2097152' | zed load -i line -
$ zed create -use 2097154
$ perl -E 'say "=" x 2097153' | zed load -i line -
Repro.mp4
This doesn't preclude the user from working with the data if they know what's in there, e.g., slicing the first 50 characters out of the string that could not be displayed in full:
The text was updated successfully, but these errors were encountered:
I made 24MB data for testing. Only in one line, but even though the data is imported and it is written that one line is imported, no data is displayed.
Repro is with Zui commit 445bdf1.
A community user recently bumped up against a 64 KB buffer in Zed's "line" reader which led to addressing brimdata/zed#5043 to bump that up to 25 MB. Now that the Zed layer is no longer as limiting, I happened to try loading some large values into Zui and found it seems to have a limit when it comes to displaying values larger than about 2 MB.
The repro video below shows the exact moment where the limit is reached. For the largest value that's known to work, we create and populate a pool with a 2097153-character string and then another pool with a 2097154-character string. As you you can see, the 2097153-character string gets rendered ok, but the 2097154-character string is blank.
Repro.mp4
This doesn't preclude the user from working with the data if they know what's in there, e.g., slicing the first 50 characters out of the string that could not be displayed in full:
The text was updated successfully, but these errors were encountered: