Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

.ToTextFileValue fails when output is bigger than 2GB #476

Open
Radamonas opened this issue Oct 19, 2023 · 2 comments
Open

.ToTextFileValue fails when output is bigger than 2GB #476

Radamonas opened this issue Oct 19, 2023 · 2 comments

Comments

@Radamonas
Copy link

.ToTextFileValue extension method fails when result output is bigger than 2GBs. We worked around with .Chunk() and then .Do(), but due to this lost elegancy of using file definition.

Is there a more elegant way to resolve this? As for ETL processes it is important to have possibility extract big data files.

@paillave
Copy link
Owner

For this specific issue, your workaround is a decent way to do.
What I would actually do is to inject a StreamWritter in the process, and use the ResolveAndDo to get this StreamWritter and write the issued line.

@paillave
Copy link
Owner

(sorry for this terrible delay... personnal issues here :( )

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants