Error \copy csv file size greater than 500MB

[lessdantu]

if agrclaimsystemlog.csv size is less than 500MB, the data can be uploaded successfully, otherwise the upload will fail, display 'killed'.

usql postgres://admin:@127.0.0.1:5432/jquerydb?sslmode=disable <<EOF
\copy csv://. postgres://admin:@127.0.0.1:5432/jquerydb?sslmode=disable 'select * from agrclaimsystemlog' 'update_pkvalue'
EOF

Connected with driver postgres (PostgreSQL 9.4.26)

[nineinchnick]

For such huge files, I'd recommend using native PostgreSQL tools, which should have better performance anyway. PostgreSQL supports copying from CSV files:

COPY update_pkvalue FROM '/path/to/csv/agrclaimsystemlog.csv' WITH (FORMAT csv);

[davidfetter]

For such huge files, I'd recommend using native PostgreSQL tools, which should have better performance anyway. PostgreSQL supports copying from CSV files:

COPY update_pkvalue FROM '/path/to/csv/agrclaimsystemlog.csv' WITH (FORMAT csv);

That works exactly and only when the csv file is on the same machine as the DB, so kiss it goodbye unless you have a shell on that DB box, which is to say all the cloud-based forks of PostgreSQL and probably a lot of others, seeing as people avoid, for very good reason, giving out shell access to all and sundry on DB machines.