New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

xsv fixlengths never finishes on some input #312

Open

seamusabshere opened this issue Feb 2, 2023 · 1 comment

seamusabshere commented Feb 2, 2023

$ xsv stats bad.csv
CSV error: record 1501690 (line: 1501690, byte: 419783925): found record with 39 fields, but the previous record has 38 fields

$ csvclean bad.csv > fixed.csv
CSV contains fields longer than maximum length of 131072 characters. Try raising the maximum with the field_size_limit parameter, or try setting quoting=csv.QUOTE_NONE.

$ xsv fixlengths bad.csv > fixed.csv
^C

xsv fixlengths never finishes

(csvclean is from https://csvkit.readthedocs.io/en/1.1.0/scripts/csvclean.html)

The text was updated successfully, but these errors were encountered:

Owner

BurntSushi commented Feb 2, 2023

Well there's not much I can do about the bug if you don't share the input that reproduces the problem...

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment