Question

I was debugging the behaviour of the model during training, I landed on this peculiar behaviour.
If I understand it correctly, the expand_context is set to false if we are training the model. Why? Why is the context expanded only during inference?