Skip to content

Conversation

Twixes
Copy link
Member

@Twixes Twixes commented Mar 15, 2023

Problem

Noticed in #14744 that some of our UI had some minor but visible changes that haven't been captured by snapshots. Looks like our failure threshold has been a bit too low.

Changes

  1. Reduces the failure threshold for visual regression tests.
  2. Switches to a more accurate structural similarity algorithm for snapshot comparisons.
  3. Skips taking a snapshot of the Feedback scene, since there are some problems with putting mockdate on it.
  4. Changes the approach to loading Gravatars so that we always show the lettermark at first, reducing snapshot flakiness.

@PostHog PostHog deleted a comment from posthog-bot Mar 16, 2023
@PostHog PostHog deleted a comment from posthog-bot Mar 16, 2023
@PostHog PostHog deleted a comment from posthog-bot Mar 16, 2023
@PostHog PostHog deleted a comment from posthog-bot Mar 16, 2023
@PostHog PostHog deleted a comment from posthog-bot Mar 16, 2023
@posthog-bot
Copy link
Contributor

📸 UI snapshots have been updated

15 snapshot changes in total. 0 added, 15 modified, 0 deleted:

Triggered by this commit.

👉 Review this PR's diff of snapshots.

@Twixes
Copy link
Member Author

Twixes commented Mar 16, 2023

Re-ran a few times, looking stable!

@Twixes Twixes marked this pull request as ready for review March 16, 2023 15:05
@Twixes Twixes merged commit ab6f079 into master Mar 16, 2023
@Twixes Twixes deleted the tune-vrt-failure-treshold branch March 16, 2023 15:05
fuziontech added a commit that referenced this pull request Mar 16, 2023
* master: (101 commits)
  feat: feedback tab - improve the UI and switch to HogQL (#14777)
  feat(experiments): cache experiment results (#14742)
  fix(empty-state): properly fix query timeout state (#14793)
  chore(feature-flag): release json payload flag (#14775)
  feat(hogql): make sure joins work with properties (#14790)
  test(frontend): Tune visual regression test failure threshold (#14766)
  feat(hogql): count distinct and count star (#14786)
  feat(perf): only load experiment results once (#14772)
  feat: allow new insight type choice from sidebar (#14759)
  fix(persons): hide persons in the future (#14308)
  feat: allow query cards in saved insights grid (#14784)
  fix(lemon-ui): Align padding for small/large buttons with icons (#14750)
  chore(deps): Upgrade TypeScript from 4.8 to 4.9 in the frontend (#14609)
  feat: rename insight query tab to json tab (#14781)
  feat: use same top heading for insight card and exported insight (#14780)
  feat: define new insight urls in one place (#14778)
  fix(hogql): person properties in a funnel breakdown (#14765)
  fix: hide query based insights in recently viewed list (#14774)
  feat: improve query summaries (#14768)
  feat(hogql): add sampling support (#14733)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants