Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Value not displayed if > ~2MB #3016

Open
philrz opened this issue Feb 23, 2024 · 1 comment
Open

Value not displayed if > ~2MB #3016

philrz opened this issue Feb 23, 2024 · 1 comment

Comments

@philrz
Copy link
Contributor

philrz commented Feb 23, 2024

Repro is with Zui commit 445bdf1.

A community user recently bumped up against a 64 KB buffer in Zed's "line" reader which led to addressing brimdata/zed#5043 to bump that up to 25 MB. Now that the Zed layer is no longer as limiting, I happened to try loading some large values into Zui and found it seems to have a limit when it comes to displaying values larger than about 2 MB.

The repro video below shows the exact moment where the limit is reached. For the largest value that's known to work, we create and populate a pool with a 2097153-character string and then another pool with a 2097154-character string. As you you can see, the 2097153-character string gets rendered ok, but the 2097154-character string is blank.

$ zed create -use 2097153
$ perl -E 'say "=" x 2097152' | zed load -i line -

$ zed create -use 2097154
$ perl -E 'say "=" x 2097153' | zed load -i line -
Repro.mp4

This doesn't preclude the user from working with the data if they know what's in there, e.g., slicing the first 50 characters out of the string that could not be displayed in full:

image

@SoftTools59654
Copy link

I also wanted to report a similar problem

Problem reading data as one line

I made 24MB data for testing. Only in one line, but even though the data is imported and it is written that one line is imported, no data is displayed.

1.zip

image

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants