This has proven to be a dangerous setting and shouldn't be offered to any user as a solution to a problem. Instead, the slow task provider notification should allow the specific task provider to be canceled on a one-off basis.

Alternatively, the quick pick could support streaming the entries as they become available.