Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

delimiter detection error #58

Open
tooptoop4 opened this issue May 4, 2022 · 4 comments
Open

delimiter detection error #58

tooptoop4 opened this issue May 4, 2022 · 4 comments

Comments

@tooptoop4
Copy link

For a pipe delimited file it is being detected as space delimited when i feed in around 1000 rows (however csv lib correctly detects pipe), if i only feed in 100 rows then clevercsv is also able to detect pipe

ie like below data but 55 columns wide
"Private Company"|"Point Rd"

@GjjvdBurg
Copy link
Collaborator

Hi @tooptoop4, thanks for reporting this issue. Are you able to share the file? I may be able to fix the problem

@tooptoop4
Copy link
Author

unfortunately it contains private data

@tooptoop4
Copy link
Author

i have another case where 100 rows seems more accurate (it correctly picks , ) but 1200 rows picks \

@GjjvdBurg
Copy link
Collaborator

Results can be a bit noisy if you don't read the entire file. Theoretically, it might be the case that the "key" to reading the file correctly is only the last row. Therefore, if time allows, it's generally recommended to detect the dialect using the entire file. If you have a case where detection fails on the entire file, please let me know

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants