Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Ignore lines are start and end of file #72

Open
psychemedia opened this issue Oct 14, 2020 · 1 comment
Open

Ignore lines are start and end of file #72

psychemedia opened this issue Oct 14, 2020 · 1 comment

Comments

@psychemedia
Copy link

Lots of CSV files have informally declared metadata in the first few lines of the file, and footnotes at the end. It would be useful to have an explicit way of declaring that N lines at the start of the file and M lines at the end are to be ignored.

@ryancheley
Copy link

I was working with someone using datasette and caves-to-SQLite just yesterday and came across this exact problem. I wrote myself a note to write up an issue, but it seems it’s already here.

@simonw I can take a try at writing a fix for this if that’s something you think would be helpful. One thing I think may be blocking implementation though would be #69 as I think that the engine for importing the data uses pandas and the idea I have for a fix would involve that, BUT if the import part is going to switch to SQLite-utils then maybe this issue can be incorporate into that update?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants