Mac tool_integration_tests_4_4 flaky on multiple unit tests #100245
Description
(part of #97036)
Since 03/14/2022, Mac tool_integration_tests_4_4 has been flaky 4 times, each hit same multiple unit tests errors:
Flaky builds:
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_4_4/3475/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_4_4/3484/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_4_4/3486/overview
https://ci.chromium.org/ui/p/flutter/builders/prod/Mac%20tool_integration_tests_4_4/3487/overview
01:19 +0 -1: test/integration.shard/ios_content_validation_test.dart: iOS app validation builds all plugin architectures for simulator [E]
Expected: <0>
Actual: <1>
package:test_api expect
test/integration.shard/ios_content_validation_test.dart 246:7 main.<fn>.<fn>
dart:async runZoned
test/src/common.dart 197:14 testWithoutContext.<fn>
test/src/common.dart 196:18 testWithoutContext.<fn>
test/src/common.dart 166:18 test.<fn>
test/src/common.dart 161:5 test.<fn>
01:35 +0 -2: test/integration.shard/ios_content_validation_test.dart: iOS app validation build for simulator with all available architectures [E]
Expected: <0>
Actual: <1>
package:test_api expect
test/integration.shard/ios_content_validation_test.dart 283:7 main.<fn>.<fn>
dart:async runZoned
test/src/common.dart 197:14 testWithoutContext.<fn>
test/src/common.dart 196:18 testWithoutContext.<fn>
test/src/common.dart 166:18 test.<fn>
test/src/common.dart 161:5 test.<fn>
02:28 +0 -3: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in debug mode validate obfuscation [E]
Expected: <1>
Actual: <2>
package:test_api expect
test/integration.shard/ios_content_validation_test.dart 228:11 main.<fn>.<fn>.<fn>
dart:async runZoned
test/src/common.dart 197:14 testWithoutContext.<fn>
test/src/common.dart 196:18 testWithoutContext.<fn>
test/src/common.dart 166:18 test.<fn>
test/src/common.dart 161:5 test.<fn>
02:28 +0 ~1 -4: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in debug mode flutter build ios builds a valid app [E]
Expected: a file system entity that exists
Actual: LocalFile:<LocalFile: '/opt/s/w/ir/x/t/flutter_ios_content_validation.ocq7dS/hello/example/build/ios/iphoneos/Runner.app/Frameworks/hello.framework/hello'>
Which: does not exist
package:test_api expect
test/integration.shard/ios_content_validation_test.dart 97:11 main.<fn>.<fn>.<fn>
dart:async runZoned
test/src/common.dart 197:14 testWithoutContext.<fn>
test/src/common.dart 196:18 testWithoutContext.<fn>
test/src/common.dart 166:18 test.<fn>
test/src/common.dart 161:5 test.<fn>
02:28 +0 ~1 -4: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in debug mode Info.plist dart observatory Bonjour service
02:28 +0 ~1 -5: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in debug mode Info.plist dart observatory Bonjour service [E]
Expected: <true>
Actual: <false>
package:test_api expect
test/integration.shard/ios_content_validation_test.dart 133:11 main.<fn>.<fn>.<fn>
dart:async runZoned
test/src/common.dart 197:14 testWithoutContext.<fn>
test/src/common.dart 196:18 testWithoutContext.<fn>
test/src/common.dart 166:18 test.<fn>
test/src/common.dart 161:5 test.<fn>
03:35 +1 ~1 -6: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in release mode validate obfuscation [E]
Expected: <1>
Actual: <2>
package:test_api expect
test/integration.shard/ios_content_validation_test.dart 228:11 main.<fn>.<fn>.<fn>
dart:async runZoned
test/src/common.dart 197:14 testWithoutContext.<fn>
test/src/common.dart 196:18 testWithoutContext.<fn>
test/src/common.dart 166:18 test.<fn>
test/src/common.dart 161:5 test.<fn>
03:35 +1 ~1 -6: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in release mode xcode_backend embed_and_thin
03:35 +1 ~1 -7: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in release mode xcode_backend embed_and_thin [E]
FileSystemException: Deletion failed, path = '/opt/s/w/ir/x/t/flutter_ios_content_validation.ocq7dS/hello/example/build/ios/iphoneos/Runner.app/Frameworks/Flutter.framework' (OS Error: No such file or directory, errno = 2)
dart:io FileSystemEntity.deleteSync
package:file/src/forwarding/forwarding_file_system_entity.dart 70:16 ForwardingFileSystemEntity.deleteSync
test/integration.shard/ios_content_validation_test.dart 165:34 main.<fn>.<fn>.<fn>
dart:async runZoned
test/src/common.dart 197:14 testWithoutContext.<fn>
test/src/common.dart 196:18 testWithoutContext.<fn>
test/src/common.dart 166:18 test.<fn>
test/src/common.dart 161:5 test.<fn>
03:35 +1 ~1 -7: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in release mode flutter build ios builds a valid app
03:35 +1 ~1 -8: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in release mode flutter build ios builds a valid app [E]
Expected: a file system entity that exists
Actual: LocalFile:<LocalFile: '/opt/s/w/ir/x/t/flutter_ios_content_validation.ocq7dS/hello/example/build/ios/iphoneos/Runner.app/Frameworks/hello.framework/hello'>
Which: does not exist
package:test_api expect
test/integration.shard/ios_content_validation_test.dart 97:11 main.<fn>.<fn>.<fn>
dart:async runZoned
test/src/common.dart 197:14 testWithoutContext.<fn>
test/src/common.dart 196:18 testWithoutContext.<fn>
test/src/common.dart 166:18 test.<fn>
test/src/common.dart 161:5 test.<fn>
03:35 +1 ~1 -8: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in release mode Info.plist dart observatory Bonjour service
03:35 +2 ~1 -8: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in release mode Info.plist dart observatory Bonjour service
03:35 +2 ~1 -8: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in release mode check symbols
03:35 +2 ~1 -9: test/integration.shard/ios_content_validation_test.dart: iOS app validation build in release mode check symbols [E]
Expected: <true>
Actual: <false>
package:test_api expect
test/integration.shard/ios_content_validation_test.dart 161:11 main.<fn>.<fn>.<fn>
dart:async runZoned
test/src/common.dart 197:14 testWithoutContext.<fn>
test/src/common.dart 196:18 testWithoutContext.<fn>
test/src/common.dart 166:18 test.<fn>
test/src/common.dart 161:5 test.<fn>
18:32 +46 ~1 -10: test/integration.shard/analyze_size_test.dart: --analyze-size flag produces expected output on hello_world for iOS [E]
Expected: contains 'Dart AOT symbols accounted decompressed size'
Actual: 'Warning: Building for device with codesigning disabled. You will have to manually codesign before deploying to device.\n'
'Building io.flutter.examples.hello-world for device (ios-release)...\n'
'Warning: Missing build name (CFBundleShortVersionString).\n'
'Warning: Missing build number (CFBundleVersion).\n'
'Running Xcode build... \n'
'Xcode build done. 25.2s\n'
'Failed to build iOS app\n'
'Error output from Xcode build:\n'
'↳\n'
' 2022-03-15 21:51:43.660 xcodebuild[12578:73409] [MT] DVTSDK: Skipped SDK /opt/s/w/ir/cache/osx_sdk/XCode.app/Contents/Developer/Platforms/MacOSX.platform/Developer/SDKs/MacOSX10.15.sdk; its version (10.15.6) is below required minimum (11.0) for the macosx platform.\n'
' 2022-03-15 21:51:43.662 xcodebuild[12578:73409] [MT] DVTSDK: Skipped SDK /opt/s/w/ir/cache/osx_sdk/XCode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator13.6.sdk; its version (13.6) is below required minimum (15.0) for the iphonesimulator platform.\n'
' 2022-03-15 21:51:43.662 xcodebuild[12578:73409] [MT] DVTSDK: Skipped SDK /opt/s/w/ir/cache/osx_sdk/XCode.app/Contents/Developer/Platforms/iPhoneSimulator.platform/Developer/SDKs/iPhoneSimulator14.0.sdk; its version (14.0) is below required minimum (15.0) for the iphonesimulator platform.\n'
' 2022-03-15 21:51:43.663 xcodebuild[12578:73409] [MT] DVTSDK: Skipped SDK /opt/s/w/ir/cache/osx_sdk/XCode.app/Contents/Developer/Platforms/iPhoneOS.platform/Developer/SDKs/iPhoneOS13.6.sdk; its version (13.6) is below required minimum (15.0) for the iphoneos platform.\n'
' 2022-03-15 21:51:43.663 xcodebuild[12578:73409] [MT] DVTSDK: Skipped SDK /opt/s/w/ir/cache/osx_sdk/XCode.app/Contents/Developer/Platforms/iPhoneOS.platform/Developer/SDKs/iPhoneOS14.0.sdk; its version (14.0) is below required minimum (15.0) for the iphoneos platform.\n'
' ** BUILD FAILED **\n'
'\n'
'\n'
'Xcode\'s output:\n'
'↳\n'
' Writing result bundle at path:\n'
' \t/opt/s/w/ir/x/t/flutter_tools.6CBhPi/flutter_ios_build_temp_diru69dKJ/temporary_xcresult_bundle\n'
'\n'
' 2022-03-15 21:52:08.614 ibtoold[12136:70583] [MT] IBPlatformTool: *** Failed to launch tool with description <IBCocoaTouchPlatformToolDescription: 0x600002532ce0> System content for IBCocoaTouchFramework-EightAndLater <IBScaleFactorDeviceTypeDescription: 0x600002533fc0> scaleFactor=2x, renderMode.identifier=(null): Failed to find or create execution context for description \'<IBCocoaTouchPlatformToolDescription: 0x600002532ce0> System content for IBCocoaTouchFramework-EightAndLater <IBScaleFactorDeviceTypeDescription: 0x600002533fc0> scaleFactor=2x, renderMode.identifier=(null)\'.\n'
' Device type: IBSimDeviceTypeiPad2x (com.apple.dt.Xcode.IBSimDeviceType.iPad-2x)\n'
' Sim runtime: (null)\n'
' ** Please also include the output of `xcrun simctl list` and `xcode-select -p`.: Failed to find newest available Simulator runtime: Could not find any supported simulator runtimes\n'
' /* com.apple.ibtool.errors */\n'
' /opt/s/w/ir/x/w/flutter/examples/hello_world/ios/Runner/Base.lproj/LaunchScreen.storyboard: error: Failed to find or create execution context for description \'<IBCocoaTouchPlatformToolDescription: 0x600002532ce0> System content for IBCocoaTouchFramework-EightAndLater <IBScaleFactorDeviceTypeDescription: 0x600002533fc0> scaleFactor=2x, renderMode.identifier=(null)\'.\n'
' Device type: IBSimDeviceTypeiPad2x (com.apple.dt.Xcode.IBSimDeviceType.iPad-2x)\n'
' Sim runtime: (null)\n'
' ** Please also include the output of `xcrun simctl list` and `xcode-select -p`.\n'
' Underlying Errors:\n'
' Description: Failed to find newest available Simulator runtime\n'
' Underlying Errors:\n'
' Description: Could not find any supported simulator runtimes\n'
' note: Using new build system\n'
' note: Planning\n'
' note: Build preparation complete\n'
' note: Building targets in parallel\n'
'\n'
' Result bundle written to path:\n'
' \t/opt/s/w/ir/x/t/flutter_tools.6CBhPi/flutter_ios_build_temp_diru69dKJ/temporary_xcresult_bundle\n'
'\n'
'\n'
''
package:test_api expect
test/integration.shard/analyze_size_test.dart 72:5 main.<fn>