Bug Report

What did you do?

inject pdleader io hang
https://tcms.pingcap.net/dashboard/executions/plan/1655438
http://perf.pingcap.net:3000/d/WOw1JWmVk/ha-test-case-detail?orgId=1&refresh=10s&var-case_id=2820188

What did you expect to see?

QPS can recover within 2min

What did you see instead?

QPS drop to zero until fault recover

clinc : https://clinic.pingcap.com.cn/portal/#/orgs/31/clusters/7208067513104263723?from=1678303062&to=1678304612
logs: http://minio.pingcap.net:38888/buckets/test-infra-testground/browse/YXJjaGl2ZS9lbmRsZXNzLWhhLXRlc3QtdHBzLTE2NTU0MzgtMS02MDM=

What version of PD are you using (pd-server -V)?

./pd-server -V
Release Version: v6.7.0-alpha
Edition: Community
Git Commit Hash: 8cd4b16
Git Branch: heads/refs/tags/v6.7.0-alpha
UTC Build Time: 2023-03-08 11:32:54
2023-03-09T03:17:55.301+0800 INFO