Restarting kernel while debugging remotely gets stuck in debug mode

Testing https://github.com/microsoft/vscode/issues/133905

1. connect to remote kernel
2. set a breakpoint in a cell
3. debug cell
4. restart kernel
5. :bug: app becomes stuck in "debug" mode

https://user-images.githubusercontent.com/35271042/135172491-69644ab7-69ef-4ae9-b912-cb31d3289b38.mp4
