[EPIC] Improve the user authentication system

[yuqi1129]

Describe the proposal

Currently, we only implement authentication between the Gravitino client and the Gravitino server and the Gravitino server and Hive Metastore, catalogs such as Iceberg, HDFS, and Kafka are left unauthenticated. Additionally, there is no authentication between The Trino connector, Spark connector, and the Gravitino server, we need to improve it.

Task list

• Authentication between Gravitino and specific catalogs
  • [Improvement] Authentication between the Hadoop catalog and Gravitino. #3337
  • Support different level(catalog, schema,fileset) of authentication for Hadoop catalog. #3462
  • Support user authentication for Iceberg with Hive backend. #3463
  • Add hadoop different level authentication.
  • Support multiple metastore/KDC service
  • Authentication between Iceberg catalog and Gravitino.
  • Authentication between Kafka and Gravitino.
• Trino connector authentication
  • Use authentication between Trino and Gravitino.
  • Support authentication between Trino and Hive/Iceberg
• Spark connector authentication
  • Use authentication between Trino and Gravitino
  • Support authentication between Trino and Hive/Iceberg
• Support e2e test
  • [Improvement] Add Hive user authentication e2e test. #3489
  • [Improvement] Add user authentication e2e tests for Hadoop catalog #3537
  • Add KDC and Hive with security in docker container #3408