[yugabyted] Send database migrations metadata for visualisation in yugabyted UI

[gargsans-yb]

Create and
As users start the process of migrations using Voyager, users should be able to review the complexity of the migrations and the progress of each migration at any given time. Yugabyted UI should be able to provide a dashboard to allow the users to effectively plan the migrations based on the complexity and also be able to monitor the progress of each migration.

Yugabyted UI will provide the visualization for the Voyager workflow. Following are the steps users will go through when migrating to YugabyteDB -

Step 1: Overall Migration assessment of the Source DB
Step 2: Schema migration
Step 3: finalize schema migration
Step 4: data migration
Step 5: cutover/failback for app traffic

Metadata regarding each step in voyager should be sent to the target DB. The metadata table schema:

CREATE TABLE IF NOT EXISTS ybvoyager_visualizer.ybvoyager_visualizer_metadata (
			migration_uuid UUID,
			migration_phase INT,
			invocation_sequence INT,
			database_name VARCHAR(250),
			schema_name VARCHAR(250),
			payload TEXT,
			status VARCHAR(30),
			invocation_timestamp TIMESTAMPTZ,
			PRIMARY KEY (migration_uuid, migration_phase, invocation_sequence)
			);

payload will contain the report generated at the ANALYZE SCHEMA step.

For EXPORT DATA and IMPORT DATA steps, send the metrics for EXPORT/IMPORT completion for each table. The metrics table:

CREATE TABLE IF NOT EXISTS ybvoyager_visualizer.ybvoyager_visualizer_table_metrics (
			migration_uuid UUID,
			table_name VARCHAR(250),
			schema_name VARCHAR(250),
			migration_phase INT,
			status INT,
			count_live_rows INT,
			count_total_rows INT,
			invocation_timestamp TIMESTAMPTZ,
			PRIMARY KEY (migration_uuid, table_name, migration_phase, schema_name)
			);

There will be an entry for each table that is being IMPORTED/EXPORTED and the entry is updated every 5 secs.