Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Supports remote backup push from PostgreSQL 15 or later (#1385) #1595

Open
wants to merge 1 commit into
base: master
Choose a base branch
from

Conversation

tangtx3
Copy link

@tangtx3 tangtx3 commented Nov 16, 2023

Database name

PostgreSQL

Pull request description

Supports remote backup push from PostgreSQL 15 or later (#1385)

Describe what this PR fix

  • In the streamFromPostgres method, CopyData case adds data receiving processing from pgsql version 15 or later.
  • In the streamFromPostgres method, add NoticeResponse case.
  • Troubleshoot EOF problems caused by the last zeroBlock message sent from pgsql15 or later.
  • Add test for Supports remote backup push from PostgreSQL 15 or later

Please provide steps to reproduce (if it's a bug)

wal-g backup-push
ERROR: 2023/11/16 10:37:36.274535 unexpected response: &{%!t(string=ERROR) %!t(string=ERROR) %!t(string=42601) %!t(string=syntax error) %!t(string=) %!t(string=) %!t(int32=0) %!t(int32=0) %!t(string=) %!t(string=) %!t(string=) %!t(string=) %!t(string=) %!t(string=) %!t(string=) %!t(string=repl_scanner.l) %!t(int32=247) %!t(string=replication_yyerror) map[]}

Please add config and wal-g stdout/stderr logs for debug purpose

test case!

AWS_ACCESS_KEY_ID=minio;
AWS_ENDPOINT=http://127.0.0.1:32009;
AWS_S3_FORCE_PATH_STYLE=true;
AWS_SECRET_ACCESS_KEY=123456;
PGHOST=127.0.0.1;
PGPASSWORD=123456;
PGPORT=5432;
PGUSER=postgres;
WALE_S3_PREFIX=s3://test-pg/pg15-1116

image

* In the streamFromPostgres method, CopyData case adds data receiving processing from pgsql version 15 or later.
* In the streamFromPostgres method, add NoticeResponse case.
* Troubleshoot EOF problems caused by the last zeroBlock message sent from pgsql15 or later.
* Add test for Supports remote backup push from PostgreSQL 15 or later

Signed-off-by: tangtx <tianxitang@harmonycloud.cn>
@tangtx3 tangtx3 requested a review from a team as a code owner November 16, 2023 08:13
@tangtx3
Copy link
Author

tangtx3 commented Nov 27, 2023

Can the code owner help me review the code? THX!

@Aevin1387
Copy link
Contributor

What needs to be done to get this reviewed and merged? We would like to use the remote backup feature for our PG15+ clusters, and would prefer not to maintain/run a fork.

@x4m
Copy link
Collaborator

x4m commented May 16, 2024

@debebantur Can you please take a look on the code? Architecturally the feature seem important.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

None yet

3 participants