Akka.IO.Tcp fails to write some outgoing messages [1.3.0] #3021
Description
Working on upgrading Petabridge.Cmd and hit this issue:
[DEBUG][8/24/2017 1:53:25 AM][Thread 0004][[akka://akkacmd/user/petabridge.cmd/127.0.0.1%3A51015#756879318]] Sending [RESPONSE][FINAL=False]: [INFO][8/24/2017 1:53:24 AM][Thread 0021][[akka://akkacmd/user/petabridge.cmd#2122656557]] petabridge.cmd host bound to [0.0.0.0:9110] to client [277 bytes]
[DEBUG][8/24/2017 1:53:25 AM][Thread 0004][[akka://akkacmd/user/petabridge.cmd/127.0.0.1%3A51015#756879318]] Sending [RESPONSE][FINAL=False]: [INFO][8/24/2017 1:53:24 AM][Thread 0021][Petabridge.Cmd.Host.Tests.PetabridgeCmdConnectionSpecs] 1 to client [242 bytes]
[DEBUG][8/24/2017 1:53:25 AM][Thread 0004][[akka://akkacmd/user/petabridge.cmd/127.0.0.1%3A51015#756879318]] Sending [RESPONSE][FINAL=True]: [ERROR][8/24/2017 1:53:24 AM][Thread 0021][Petabridge.Cmd.Host.Tests.PetabridgeCmdConnectionSpecs] 2
Cause: Unknown to client [259 bytes]
sending a total of 778 bytes
[DEBUG][8/24/2017 1:53:25 AM][Thread 0018][[akka://akkacmd/user/$a#660563327]] Received [256 bytes] from host
[DEBUG][8/24/2017 1:53:25 AM][Thread 0018][[akka://akkacmd/user/$a#660563327]] Received [21 bytes] from host
[DEBUG][8/24/2017 1:53:25 AM][Thread 0018][[akka://akkacmd/user/$a#660563327]] Deserialized [[RESPONSE][FINAL=False]: [INFO][8/24/2017 1:53:24 AM][Thread 0021][[akka://akkacmd/user/petabridge.cmd#2122656557]] petabridge.cmd host bound to [0.0.0.0:9110]] from host
[DEBUG][8/24/2017 1:53:25 AM][Thread 0018][[akka://akkacmd/user/$a#660563327]] Received [256 bytes] from host
[DEBUG][8/24/2017 1:53:25 AM][Thread 0018][[akka://akkacmd/user/$a#660563327]] Received [3 bytes] from host
[DEBUG][8/24/2017 1:53:25 AM][Thread 0018][[akka://akkacmd/user/$a#660563327]] Deserialized [[RESPONSE][FINAL=True]: [ERROR][8/24/2017 1:53:24 AM][Thread 0021][Petabridge.Cmd.Host.Tests.PetabridgeCmdConnectionSpecs] 2
Cause: Unknown] from host
Client receives only 536, thus we're missing the 256 bytes in the middle. I'd bet dollars to donuts it's an issue with a pending write being suck in a queue and getting purged by accident. Working on a repro spec now.