-
Notifications
You must be signed in to change notification settings - Fork 29.2k
Closed
Labels
P2Important issues not at the top of the work listImportant issues not at the top of the work lista: tests"flutter test", flutter_test, or one of our tests"flutter test", flutter_test, or one of our testsc: contributor-productivityTeam-specific productivity, code health, technical debt.Team-specific productivity, code health, technical debt.frameworkflutter/packages/flutter repository. See also f: labels.flutter/packages/flutter repository. See also f: labels.toolAffects the "flutter" command-line tool. See also t: labels.Affects the "flutter" command-line tool. See also t: labels.
Description
We should shuffle our tests. I've encountered a number of test files that depend on state set by previous tests. This ends up hiding bugs and/or creating unnecessary breaking changes later on when we have to fix it.
Package test takes an argument --test-randomize-ordering-seed=random
. For regular test runs this looks like pub run test --test-randomize-ordering-seed=random
. For flutter test
we'll have to create a way to pipe in the argument. In general, we'll want to update dev/bots/test.dart
to use this argument by default when running tests for CI.
/cc @jonahwilliams @goderbauer @tvolkert @Hixie @yjbanov @zanderso - I would not be surprised if this surfaces various breaking changes in tool/flutter/etc.
friebetill
Metadata
Metadata
Assignees
Labels
P2Important issues not at the top of the work listImportant issues not at the top of the work lista: tests"flutter test", flutter_test, or one of our tests"flutter test", flutter_test, or one of our testsc: contributor-productivityTeam-specific productivity, code health, technical debt.Team-specific productivity, code health, technical debt.frameworkflutter/packages/flutter repository. See also f: labels.flutter/packages/flutter repository. See also f: labels.toolAffects the "flutter" command-line tool. See also t: labels.Affects the "flutter" command-line tool. See also t: labels.