Hi everyone, Someone asked me how to compute Transformer FLOPs (Equation 6 in the paper). I wrote a tutorial and hope it can help. Feel free to offer feedback so that I can improve it.

You can also refer to PDF version.