We need a separate setting to allow users to toggle whether datatips-all-the-time once we enable run-by-line. It should be on by default.