Occasional SIGSEV with recursive cp of a lot of files #559
Description
version: 2.0.0
uname: 4.18.0-372.32.1.el8_6.x86_64 x86_64 GNU/Linux
I am seeing a flakey SIGSEV error when doing a recursive cp of a large directory with 27K files.
$ echo cp 'DIR/*' s3://BUCKET/ | s5cmd run
panic: runtime error: invalid memory address or nil pointer dereference
[signal SIGSEGV: segmentation violation code=0x1 addr=0x20 pc=0x972025]
goroutine 11 [running]:
github.com/peak/s5cmd/storage.(*Filesystem).expandGlob.func1()
/home/conda/feedstock_root/build_artifacts/s5cmd_1656989523083/work/storage/fs.go:93 +0x3e5
created by github.com/peak/s5cmd/storage.(*Filesystem).expandGlob
/home/conda/feedstock_root/build_artifacts/s5cmd_1656989523083/work/storage/fs.go:71 +0xe8
I'm not sure if this problem happens without s5cmd run. I haven't been able to test because it doesn't happen reliably.