Sorry. On 0.53 I have default webapplication factory injected into test class as [ClassDataSource<CustomWebApplicationFactory>(Shared = SharedType.PerClass)]. It is IAsyncDisposable. And there are no calls to DisposeAsync method (and no for Dispose too)! For another injected classes (PerAssembly) is the same thing. InitializeAsync works fine