Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

HIVE-28204: Remove some HMS obsolete scripts #5201

Open
wants to merge 5 commits into
base: master
Choose a base branch
from

Conversation

dengzhhu653
Copy link
Member

What changes were proposed in this pull request?

Why are the changes needed?

Does this PR introduce any user-facing change?

Is the change a dependency upgrade?

How was this patch tested?

@dengzhhu653 dengzhhu653 changed the title HIVE-28204: Remove the HMS 1.x init script HIVE-28204: Remove some HMS obsolete scripts Apr 18, 2024
@dengzhhu653
Copy link
Member Author

Under standalone-metastore/metastore-server/src/main/sql, there are scripts for 1.2.0, mainly for TestSchemaToolForMetastore to test the upgrade from 1.2.0.

@InvisibleProgrammer
Copy link
Contributor

Hi, is that some legacy way how we handled the metastore upgrade scripts at an old Hive version?

@dengzhhu653
Copy link
Member Author

Hi, is that some legacy way how we handled the metastore upgrade scripts at an old Hive version?

The upgrade story is almost the same, while these deleted scripts are for Hive version <= 2.3(including the upgrade scripts).
For the scripts target at 1.x or 0.x, I think we can remove them safety.
For the scripts target at 2.x, the branch 2.x already contains the scripts for initializing, we don't need to keep them on the 4.x branch,
the scripts under https://github.com/apache/hive/tree/master/standalone-metastore/metastore-server/src/main/sql/postgres can upgrade to the latest version from any releases that newer than 1.2.0, so I remove the upgrade scripts from the directories as well.

@deniskuzZ
Copy link
Member

Hi, is that some legacy way how we handled the metastore upgrade scripts at an old Hive version?

The upgrade story is almost the same, while these deleted scripts are for Hive version <= 2.3(including the upgrade scripts). For the scripts target at 1.x or 0.x, I think we can remove them safety. For the scripts target at 2.x, the branch 2.x already contains the scripts for initializing, we don't need to keep them on the 4.x branch, the scripts under https://github.com/apache/hive/tree/master/standalone-metastore/metastore-server/src/main/sql/postgres can upgrade to the latest version from any releases that newer than 1.2.0, so I remove the upgrade scripts from the directories as well.

what if customer decided to upgrade from 2.0 to 4.0, won't we miss some of the upgrade script?

@dengzhhu653
Copy link
Member Author

Hi, is that some legacy way how we handled the metastore upgrade scripts at an old Hive version?

The upgrade story is almost the same, while these deleted scripts are for Hive version <= 2.3(including the upgrade scripts). For the scripts target at 1.x or 0.x, I think we can remove them safety. For the scripts target at 2.x, the branch 2.x already contains the scripts for initializing, we don't need to keep them on the 4.x branch, the scripts under https://github.com/apache/hive/tree/master/standalone-metastore/metastore-server/src/main/sql/postgres can upgrade to the latest version from any releases that newer than 1.2.0, so I remove the upgrade scripts from the directories as well.

what if customer decided to upgrade from 2.0 to 4.0, won't we miss some of the upgrade script?

https://github.com/apache/hive/tree/master/standalone-metastore/metastore-server/src/main/sql/postgres this directory contains the scripts for upgrading to 4.0,

https://github.com/apache/hive/blob/master/standalone-metastore/metastore-server/src/main/sql/postgres/upgrade.order.postgres

@dengzhhu653
Copy link
Member Author

Hello @nrg4878, @saihemanth-cloudera cloud you please take a look as well if have cycles?

@nrg4878
Copy link
Contributor

nrg4878 commented May 15, 2024

@dengzhhu653 Given there is a RC for 2.3.10 release, should we retain the upgrade scripts from 2.3 to the latest version?

@dengzhhu653
Copy link
Member Author

dengzhhu653 commented May 16, 2024

@dengzhhu653 Given there is a RC for 2.3.10 release, should we retain the upgrade scripts from 2.3 to the latest version?

This https://github.com/apache/hive/tree/master/standalone-metastore/metastore-server/src/main/sql/postgres directory contains the scripts for upgrading to 4.0 from 2.3 or 1.2. The PR removes the scripts in metastore module.

Copy link

sonarcloud bot commented May 21, 2024

Quality Gate Passed Quality Gate passed

Issues
0 New issues
0 Accepted issues

Measures
0 Security Hotspots
No data about Coverage
No data about Duplication

See analysis details on SonarCloud

Copy link
Contributor

@henrib henrib left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Non binding, but LGTM :-)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
6 participants