After from_rgb layer in the discriminator, there is no activation function. A leaky relu nonlinearity should be applied there. https://github.com/rosinality/style-based-gan-pytorch/blob/e5caa16e9edcb1a4ddb22206511f9339ead78ad7/model.py#L552