Skip to content

[plugins] Integration test failures aren't captured (at least on iOS) #105055

@stuartmorgan-g

Description

@stuartmorgan-g

It appears that integration tests somehow regressed in our CI. Example (from https://api.cirrus-ci.com/v1/task/4990437185290240/logs/drive.log):

Running command: "flutter drive -d C2C157E2-4772-42D2-8CEB-8BE5483761D2 --driver test_driver/integration_test.dart --target integration_test/ios_platform_images_integration_test.dart" in /private/var/folders/tn/f_9sf1xx5t14qm_6f83q3b840000gn/T/cirrus-ci-build/packages/ios_platform_images/example
Running "flutter pub get" in example...                            636ms
Warning: Missing build name (CFBundleShortVersionString).
Warning: Missing build number (CFBundleVersion).
Running pod install...                                           1,123ms
Running Xcode build...                                          
Xcode build done.                                           20.8s
flutter: 00:00 +0: load ios bundled image
flutter: file:///Users/admin/Library/Developer/CoreSimulator/Devices/C2C157E2-4772-42D2-8CEB-8BE5483761D2/data/Containers/Bundle/Application/92999D35-B5E6-4DF7-A37B-31E477B4868B/Runner.app/textfile
flutter: 00:01 +1: load ios system images
flutter: 00:01 +1: load ios bundled image
flutter: file:///Users/admin/Library/Developer/CoreSimulator/Devices/C2C157E2-4772-42D2-8CEB-8BE5483761D2/data/Containers/Bundle/Application/92999D35-B5E6-4DF7-A37B-31E477B4868B/Runner.app/textfile
flutter: 00:01 +2: ios system image error case
flutter: 00:01 +2: ios system image error case [E]
flutter:   Invalid argument(s): System image couldn't be found: invalid_symbol
flutter:
flutter: 00:01 +2 -1: (tearDownAll)
flutter: Warning: integration_test plugin was not detected.
flutter:
flutter: If you're running the tests with `flutter drive`, please make sure your tests
flutter: are in the `integration_test/` directory of your package and use
flutter: `flutter test $path_to_test` to run it instead.
flutter:
flutter: If you're running the tests with Android instrumentation or XCTest, this means
flutter: that you are not capturing test results properly! See the following link for
flutter: how to set up the integration_test plugin:
flutter:
flutter: https://flutter.dev/docs/testing/integration-tests#testing-on-firebase-test-lab
flutter:
flutter: 00:01 +3 -1: Some tests failed.
All tests passed.

I'm not sure why the integration test plugin wouldn't have been detected. @dnfield was the flutter test thing a breaking change? I thought flutter drive was supposed to keep working for now.

Metadata

Metadata

Labels

P1High-priority issues at the top of the work lista: tests"flutter test", flutter_test, or one of our testsc: contributor-productivityTeam-specific productivity, code health, technical debt.packageflutter/packages repository. See also p: labels.

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions