It would be nice to turn off terminal colors sometimes, but there currently is no option to do that.

https://no-color.org/ is the closest thing to a standard I could find, and they recommend disabling color if the NO_COLOR environment variable is set (to any value).