SchemaChange failed because of storage migration

[decster]

I0507 20:50:22.041597 2029395 agent_server.cpp:382] Submit task success. type=CREATE, signature=96324582
I0507 20:50:37.675457 2832556 tablet_manager.cpp:140] Creating tablet 96324582
I0507 20:50:37.700320 2832556 tablet_manager.cpp:209] Created tablet 96324582
I0507 20:51:38.750128 2029394 agent_server.cpp:403] Submit task success. type=STORAGE_MEDIUM_MIGRATE, signature=96324582
I0507 20:51:38.750202 2832565 engine_storage_migration_task.cpp:75] begin to process storage migrate. tablet_id=96324582, schema_hash=1952330583, tablet=96324582.1952330583.9641d4bc6971b88a-dcf68a7988339cb4, dest_store=/mnt/hdd02
I0507 20:51:38.780112 2832565 tablet_manager.cpp:833] Loading tablet 96324582 from /mnt/hdd02/data/754/96324582/1952330583. force=0 restore=0
I0507 20:51:38.806866 2832565 tablet_manager.cpp:1353] Start to drop tablet 96324582
I0507 20:51:38.808101 2832565 tablet_manager.cpp:1397] Succeed to drop tablet 96324582
I0507 20:51:38.808122 2832565 tablet_manager.cpp:108] Added duplicated tablet. tablet_id=96324582 old_tablet_path=/mnt/disk01/data/598/96324582/1952330583 new_tablet_path=/mnt/hdd02/data/754/96324582/1952330583
I0507 20:51:38.809311 2832565 agent_task.cpp:398] storage media migrate success. signature:96324582
I0507 20:51:38.809321 2832565 tablet_manager.cpp:877] Reporting tablet info. tablet_id=96324582
I0507 20:51:42.540856 2832656 tablet_manager.cpp:1004] Moved /mnt/disk01/data/598/96324582
I0507 21:03:10.276037 2029394 agent_server.cpp:439] Submit task success. type=ALTER, signature=96324582
I0507 21:12:30.710778 2832560 agent_task.cpp:219] get alter table task, signature: 96324582
I0507 21:16:38.158951 2029394 agent_server.cpp:439] Submit task success. type=ALTER, signature=96324582
I0507 21:43:13.889056 2832560 agent_task.cpp:219] get alter table task, signature: 96324582
I0507 21:48:47.512015 2029395 agent_server.cpp:439] Submit task success. type=ALTER, signature=96324582
I0507 21:52:08.164726 2832560 agent_task.cpp:219] get alter table task, signature: 96324582
I0507 21:53:55.964332 2029395 agent_server.cpp:439] Submit task success. type=ALTER, signature=96324582
I0507 21:57:16.200291 2832560 agent_task.cpp:219] get alter table task, signature: 96324582
I0507 21:58:06.552728 2029394 agent_server.cpp:439] Submit task success. type=ALTER, signature=96324582
I0507 22:01:03.586952 2832560 agent_task.cpp:219] get alter table task, signature: 96324582
I0507 22:01:03.586992 2832560 schema_change.cpp:686] begin to do request alter tablet: base_tablet_id=95484238, base_schema_hash=84770649, new_tablet_id=96324582, new_schema_hash=1952330583, alter_version=119743
I0507 22:01:03.587007 2832560 schema_change.cpp:736] finish to validate alter tablet request. begin to convert data from base tablet to new tablet base_tablet=95484238.84770649.f94a4952d24eadad-ce86b91770719bbb new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f
I0507 22:01:03.596957 2832560 schema_change.cpp:871] begin to remove all data from new tablet to prevent rewrite. new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f
I0507 22:01:03.608721 2832560 schema_change.cpp:964] begin to convert historical rowsets for new_tablet from base_tablet. base_tablet=95484238.84770649.f94a4952d24eadad-ce86b91770719bbb, new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f
W0507 22:01:03.626832 2832560 rowset.cpp:264] Fail to link /mnt/disk01/data/810/95484238/84770649/020000007b4845f6fe4a23e192310ef55fa8d24ea5384aa6_0.dat to /mnt/hdd02/data/754/96324582/1952330583/020000007fc22bdffe4a23e192310ef55fa8d24ea5384aa6_0.dat: Invalid cross-device link [18]
W0507 22:01:03.636292 2832560 schema_change.cpp:288] fail to convert rowset., new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f, base_tablet=95484238.84770649.f94a4952d24eadad-ce86b91770719bbb, version=[0-119743]
W0507 22:01:03.636324 2832560 schema_change.cpp:1026] failed to process the schema change. from tablet 95484238.84770649.f94a4952d24eadad-ce86b91770719bbb to tablet 96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f version=0-119743 error Internal error: failed to proccessV2 LinkedSchemaChange
W0507 22:01:03.647279 2832560 engine_alter_tablet_task.cpp:57] failed to do alter task. status=Internal error: failed to proccessV2 LinkedSchemaChange base_tablet_id=95484238, base_schema_hash=84770649, new_tablet_id=96324582, new_schema_hash=1952330583
W0507 22:01:03.647316 2832560 agent_task.cpp:123] alter failed. signature: 96324582
W0507 22:02:21.996218 2832656 tablet.cpp:464] lastest_delta is null 96324582
W0507 22:05:24.916981 2832656 tablet.cpp:464] lastest_delta is null 96324582
I0507 22:06:08.468286 2029394 agent_server.cpp:439] Submit task success. type=ALTER, signature=96324582
I0507 22:06:08.468364 2832560 agent_task.cpp:219] get alter table task, signature: 96324582
I0507 22:06:08.468391 2832560 schema_change.cpp:686] begin to do request alter tablet: base_tablet_id=95484238, base_schema_hash=84770649, new_tablet_id=96324582, new_schema_hash=1952330583, alter_version=119743
I0507 22:06:08.468405 2832560 schema_change.cpp:736] finish to validate alter tablet request. begin to convert data from base tablet to new tablet base_tablet=95484238.84770649.f94a4952d24eadad-ce86b91770719bbb new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f
I0507 22:06:08.473579 2832560 schema_change.cpp:871] begin to remove all data from new tablet to prevent rewrite. new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f
I0507 22:06:08.481935 2832560 schema_change.cpp:964] begin to convert historical rowsets for new_tablet from base_tablet. base_tablet=95484238.84770649.f94a4952d24eadad-ce86b91770719bbb, new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f
W0507 22:06:08.482316 2832560 rowset.cpp:264] Fail to link /mnt/disk01/data/810/95484238/84770649/020000007b4845f6fe4a23e192310ef55fa8d24ea5384aa6_0.dat to /mnt/hdd02/data/754/96324582/1952330583/020000007fc7956ffe4a23e192310ef55fa8d24ea5384aa6_0.dat: Invalid cross-device link [18]
W0507 22:06:08.482357 2832560 schema_change.cpp:288] fail to convert rowset., new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f, base_tablet=95484238.84770649.f94a4952d24eadad-ce86b91770719bbb, version=[0-119743]
W0507 22:06:08.482370 2832560 schema_change.cpp:1026] failed to process the schema change. from tablet 95484238.84770649.f94a4952d24eadad-ce86b91770719bbb to tablet 96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f version=0-119743 error Internal error: failed to proccessV2 LinkedSchemaChange
W0507 22:06:08.488190 2832560 engine_alter_tablet_task.cpp:57] failed to do alter task. status=Internal error: failed to proccessV2 LinkedSchemaChange base_tablet_id=95484238, base_schema_hash=84770649, new_tablet_id=96324582, new_schema_hash=1952330583
W0507 22:06:08.488219 2832560 agent_task.cpp:123] alter failed. signature: 96324582
W0507 22:08:27.740833 2832656 tablet.cpp:464] lastest_delta is null 96324582
W0507 22:11:30.946000 2832656 tablet.cpp:464] lastest_delta is null 96324582
W0507 22:14:33.210924 2832656 tablet.cpp:464] lastest_delta is null 96324582
W0507 22:17:36.123932 2832656 tablet.cpp:464] lastest_delta is null 96324582
I0507 22:18:17.060407 2029394 agent_server.cpp:439] Submit task success. type=ALTER, signature=96324582
I0507 22:18:17.060477 2832561 agent_task.cpp:219] get alter table task, signature: 96324582
I0507 22:18:17.060561 2832561 schema_change.cpp:686] begin to do request alter tablet: base_tablet_id=95484238, base_schema_hash=84770649, new_tablet_id=96324582, new_schema_hash=1952330583, alter_version=119743
I0507 22:18:17.060575 2832561 schema_change.cpp:736] finish to validate alter tablet request. begin to convert data from base tablet to new tablet base_tablet=95484238.84770649.f94a4952d24eadad-ce86b91770719bbb new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f
I0507 22:18:17.068877 2832561 schema_change.cpp:871] begin to remove all data from new tablet to prevent rewrite. new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f
I0507 22:18:17.079094 2832561 schema_change.cpp:964] begin to convert historical rowsets for new_tablet from base_tablet. base_tablet=95484238.84770649.f94a4952d24eadad-ce86b91770719bbb, new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f
W0507 22:18:17.080138 2832561 rowset.cpp:264] Fail to link /mnt/disk01/data/810/95484238/84770649/020000007b4845f6fe4a23e192310ef55fa8d24ea5384aa6_0.dat to /mnt/hdd02/data/754/96324582/1952330583/020000007fd52f48fe4a23e192310ef55fa8d24ea5384aa6_0.dat: Invalid cross-device link [18]
W0507 22:18:17.080204 2832561 schema_change.cpp:288] fail to convert rowset., new_tablet=96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f, base_tablet=95484238.84770649.f94a4952d24eadad-ce86b91770719bbb, version=[0-119743]
W0507 22:18:17.080220 2832561 schema_change.cpp:1026] failed to process the schema change. from tablet 95484238.84770649.f94a4952d24eadad-ce86b91770719bbb to tablet 96324582.1952330583.914349f752d83af5-be2bd77b3f3d7b8f version=0-119743 error Internal error: failed to proccessV2 LinkedSchemaChange
W0507 22:18:17.087345 2832561 engine_alter_tablet_task.cpp:57] failed to do alter task. status=Internal error: failed to proccessV2 LinkedSchemaChange base_tablet_id=95484238, base_schema_hash=84770649, new_tablet_id=96324582, new_schema_hash=1952330583
W0507 22:18:17.087381 2832561 agent_task.cpp:123] alter failed. signature: 96324582
W0507 22:20:38.952567 2832656 tablet.cpp:464] lastest_delta is null 96324582
I0507 22:21:38.914428 2029394 agent_server.cpp:386] Submit task success. type=DROP, signature=96324582
I0507 22:21:43.088999 2832554 tablet_manager.cpp:365] Start to drop tablet 96324582
I0507 22:21:43.090936 2832554 tablet_manager.cpp:410] Succeed to drop tablet 96324582
I0507 22:23:53.269196 2832656 tablet_manager.cpp:1004] Moved /mnt/hdd02/data/754/96324582

StarRocks version (Required)

• You can get the StarRocks version by executing SQL select current_version()