s5cmd Doesn't respect proxy environment variables #445
Description
The AWS CLI + Boto3 support setting environment variables to pass requests through a proxy. In my case, we require this functionality because we use a proxy to route requests from our dev network to our VPC.
The environment variables that are set are:
https_proxy
http_proxy
HTTPS_PROXY
HTTP_PROXY
Using the AWS CLI, the following command succeeds:
aws --region us-east-2 --no-verify-ssl s3 ls s3://path/to/prefix
However, using s5cmd (v1.4.0), the analagous command fails:
s5cmd --log debug --no-verify-ssl ls s3://path/to/prefix
with the following output
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.80.130:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.80.130:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.80.130:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.80.130:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.80.130:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.80.130:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.80.130:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.142.89:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.106.241:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.99.57:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: dial tcp 52.219.88.226:443: connect: connection refused
ERROR session: fetching region failed: RequestError: send request failed
caused by: dial tcp 52.219.88.226:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.84.232:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.84.232:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.84.232:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.84.232:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.84.232:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.84.232:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.84.232:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.99.34:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.105.122:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.110.170:443: connect: connection refused
DEBUG retryable error: RequestError: send request failed
caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.109.122:443: connect: connection refused
ERROR "ls s3://path/to/prefix": RequestError: send request failed caused by: Get "https://path.s3.us-east-2.amazonaws.com/?delimiter=%2F&list-type=2&prefix=to%2Fprefix": dial tcp 52.219.109.122:443: connect: connection refused
Is there some way to get s5cmd to use the proxy variables? Or is this unsupported?