https://github.com/pytest-dev/pytest/blob/master/_pytest/main.py#L191 should do a warnings.warn so we can safely remove later on