This issue needs to be solved at the same time as https://github.com/PaddlePaddle/PaddleSpeech/issues/1282 see: [DurIAN](https://arxiv.org/abs/1909.01700)