Follow-up from #33011.

Because of the complication described in #33011, we not only remove the file from the source tree but also remove it from site-packages before building sagelib.

Follow-up:

• make sagemath-standard, sage-setup depend on sagemath-environment

Depends on #33011

CC: @kwankyu @videlec

Component: refactoring

Author: Matthias Koeppe

Branch: a77b971

Reviewer: Kwankyu Lee

Issue created by migration from https://trac.sagemath.org/ticket/34187