Reproduction Steps

1. Create a pipeline that uses a s3 resource pointing to a file that doesn't exist
2. Push the pipeline for the first time

Actual

Job hangs in pending state and doesn't throw an error, while the resource has "Checking Successfully" green.

Expected

Start the job and throw and error saying fetching resource failed.

Note

Once a S3 resource has been fetched successfully, then changing the file value to a non-existent field yields the desired error. So the error only happens if the resource has never fetched successfully.