Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

FR: 0_append for csvs #3044

Open
mike-lawrence opened this issue Jun 3, 2021 · 0 comments
Open

FR: 0_append for csvs #3044

mike-lawrence opened this issue Jun 3, 2021 · 0 comments

Comments

@mike-lawrence
Copy link
Contributor

Excuse my general C naivete but would it be possible at all to have stan write it's csvs using O_APPEND mode whereby thw writer looks for the end of the file before every write? While waiting for the proper IO refactor I've been coding a csv->Inference Data converter that watches the csvs as they're created, grabs any new content then runs truncate -s 0 on the file to save on disk space. I can obviously skip the truncation part if it turns out that the csv writer here can't do O_APPEND or if there's a non-negligible implementation or performance cost, but thought I'd check.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant