pitr status became paused after restart all pd、tikv、tidb

[Lily2025]

Bug Report

What version of TiKV are you using?

./tikv-server -V
TiKV
Release Version: 8.2.0-alpha
Edition: Community
Git Commit Hash: 72a0fd5
Git Commit Branch: heads/refs/tags/v8.2.0-alpha
UTC Build Time: 2024-04-30 11:39:54
Rust Version: rustc 1.77.0-nightly (89e2160c4 2023-12-27)
Enable Features: memory-engine pprof-fp jemalloc mem-profiling portable sse test-engine-kv-rocksdb test-engine-raft-raft-engine trace-async-tasks openssl-vendored
Profile: dist_release

What operating system and CPU are you using?

8c/32g

Steps to reproduce

1、create pitr
2、run workload
3、restart all pd、tikv、tidb

What did you expect?

pitr status can become normal after cluster restart

What did happened?

pitr status became paused after restart all pd、tikv、tidb

tikv/components/backup-stream/src/endpoint.rs

Line 732 in 88099c9

self.on_fatal_error_of_task(&task_clone.info.name, &Box::new(e))

[Lily2025]

/type bug
/severity major
/assign Leavrth

[Leavrth]

During one TiKV registered the task's ranges, it failed to connect to PD and return an error.
Then the TiKV paused the task.

tikv/components/backup-stream/src/endpoint.rs

Line 732 in 88099c9

self.on_fatal_error_of_task(&task_clone.info.name, &Box::new(e))

Currently we can manually resume the task.