docker pull / push slow #7291
Description
Issue related to #1888 that wasn't resolved.
As Ross said here: #1888 (comment)
We're seeing this.
Steps to reproduce:
Run latest (or any version) of docker-registry.
Run Docker 1.1.1 (or any version) on another machine on the local network. "Local network" in our case is a 10GbE connection with ample available bandwidth.
Push and pull any docker image from the Docker host to the docker-registry. Observe the speeds.
For reference, here's a concrete example (names changed, everything else as per output).
root@int-build-systems:~ # time docker pull our-registry.example.com/ourapp:v0.90.19
Pulling repository our-registry.example.com/ourapp
f53e24aff1ea: Download complete
1db82e0c82b2: Download complete
5ad7cde6f934: Download complete
1b63e01a661e: Download complete
76bf39c7538d: Download complete
52490f4c441f: Download complete
4711ab69462c: Download complete
a3298b1086dd: Download complete
6ec7f7a84999: Download complete
12286e1683de: Download complete
e65d790b892e: Download complete
68a857ae02fd: Download complete
19fa32328999: Download complete
35dc94353234: Download complete
9bfba14d5960: Download complete
3ca1dfe05755: Download complete
3e836ac53ec4: Download complete
e940f2494e01: Download complete
59a6acada74e: Download complete
17bc599649b4: Download complete
451cb4e63973: Download complete
29a0981d8008: Download complete
205a854f59a5: Download complete
3471990c34d0: Download complete
real 2m6.888s
user 0m0.148s
sys 0m0.108s
OK, so 2 mins 6 seconds to pull this container. Now, I took the access log from the registry server (to see every file Docker downloaded from the registry) and created a Bash script from it to curl each of the files downloaded:
#!/bin/bash
curl -O https://our-registry.example.com/v1/images/746c70792250bddb7ca5ab4ec0cc85ac2858dcc32a7f44fd11e562733b3f484d/ancestry
curl -O https://our-registry.example.com/v1/images/f53e24aff1ead3dce35711567f26b3ad01624f168aebc53d04f9dd7bd16e14d0/json
curl -O https://our-registry.example.com/v1/images/f53e24aff1ead3dce35711567f26b3ad01624f168aebc53d04f9dd7bd16e14d0/layer
curl -O https://our-registry.example.com/v1/images/f53e24aff1ead3dce35711567f26b3ad01624f168aebc53d04f9dd7bd16e14d0/layer
curl -O https://our-registry.example.com/v1/images/1db82e0c82b29793aec6a14f88ec92f7062e9f54e9aea8a112b8721eaf800110/json
curl -O https://our-registry.example.com/v1/images/1db82e0c82b29793aec6a14f88ec92f7062e9f54e9aea8a112b8721eaf800110/layer
curl -O https://our-registry.example.com/v1/images/1db82e0c82b29793aec6a14f88ec92f7062e9f54e9aea8a112b8721eaf800110/layer
curl -O https://our-registry.example.com/v1/images/5ad7cde6f934f1be64ec3589093f08f666af17bc70391400cdfdd21d0ad7f0bb/json
curl -O https://our-registry.example.com/v1/images/5ad7cde6f934f1be64ec3589093f08f666af17bc70391400cdfdd21d0ad7f0bb/layer
curl -O https://our-registry.example.com/v1/images/5ad7cde6f934f1be64ec3589093f08f666af17bc70391400cdfdd21d0ad7f0bb/layer
curl -O https://our-registry.example.com/v1/images/1b63e01a661e2f8dfb8019b8028e1b88481cc00fa3f18b876f68aecace8dd883/json
curl -O https://our-registry.example.com/v1/images/1b63e01a661e2f8dfb8019b8028e1b88481cc00fa3f18b876f68aecace8dd883/layer
curl -O https://our-registry.example.com/v1/images/1b63e01a661e2f8dfb8019b8028e1b88481cc00fa3f18b876f68aecace8dd883/layer
curl -O https://our-registry.example.com/v1/images/76bf39c7538d3ec1f6509cceb220dc648873fcd6db35b1fe6cdced69fbe04634/json
curl -O https://our-registry.example.com/v1/images/76bf39c7538d3ec1f6509cceb220dc648873fcd6db35b1fe6cdced69fbe04634/layer
curl -O https://our-registry.example.com/v1/images/76bf39c7538d3ec1f6509cceb220dc648873fcd6db35b1fe6cdced69fbe04634/layer
curl -O https://our-registry.example.com/v1/images/52490f4c441fc183eb6940bb87fb5a6c54d2784e171dc8c3692261ffa0c0cdf0/json
curl -O https://our-registry.example.com/v1/images/52490f4c441fc183eb6940bb87fb5a6c54d2784e171dc8c3692261ffa0c0cdf0/layer
curl -O https://our-registry.example.com/v1/images/52490f4c441fc183eb6940bb87fb5a6c54d2784e171dc8c3692261ffa0c0cdf0/layer
curl -O https://our-registry.example.com/v1/images/4711ab69462c595b12ca725a2a0ae3d95a77a5b11f435e4cfbb2da2c643e60ba/json
curl -O https://our-registry.example.com/v1/images/4711ab69462c595b12ca725a2a0ae3d95a77a5b11f435e4cfbb2da2c643e60ba/layer
curl -O https://our-registry.example.com/v1/images/4711ab69462c595b12ca725a2a0ae3d95a77a5b11f435e4cfbb2da2c643e60ba/layer
curl -O https://our-registry.example.com/v1/images/a3298b1086ddb50efab152693b82f87354bc179cea45a95329783f8e3170d6e8/json
curl -O https://our-registry.example.com/v1/images/a3298b1086ddb50efab152693b82f87354bc179cea45a95329783f8e3170d6e8/layer
curl -O https://our-registry.example.com/v1/images/a3298b1086ddb50efab152693b82f87354bc179cea45a95329783f8e3170d6e8/layer
curl -O https://our-registry.example.com/v1/images/6ec7f7a849995b715f6ed616d2daffc48eb2cc3b57dc04fda1733a5f0a504717/json
curl -O https://our-registry.example.com/v1/images/6ec7f7a849995b715f6ed616d2daffc48eb2cc3b57dc04fda1733a5f0a504717/layer
curl -O https://our-registry.example.com/v1/images/6ec7f7a849995b715f6ed616d2daffc48eb2cc3b57dc04fda1733a5f0a504717/layer
curl -O https://our-registry.example.com/v1/images/12286e1683de9c8165dc0a916d1227b2a22a880620c31c0bcc359b75a75affed/json
curl -O https://our-registry.example.com/v1/images/12286e1683de9c8165dc0a916d1227b2a22a880620c31c0bcc359b75a75affed/layer
curl -O https://our-registry.example.com/v1/images/12286e1683de9c8165dc0a916d1227b2a22a880620c31c0bcc359b75a75affed/layer
curl -O https://our-registry.example.com/v1/images/e65d790b892e9041963f20c24c2224a738650fdabc4fa70b3870edc44ec59156/json
curl -O https://our-registry.example.com/v1/images/e65d790b892e9041963f20c24c2224a738650fdabc4fa70b3870edc44ec59156/layer
curl -O https://our-registry.example.com/v1/images/e65d790b892e9041963f20c24c2224a738650fdabc4fa70b3870edc44ec59156/layer
curl -O https://our-registry.example.com/v1/images/68a857ae02fd4d97ddb43ba21dc3241adf718b1140a348ae064853177180bf2a/json
curl -O https://our-registry.example.com/v1/images/68a857ae02fd4d97ddb43ba21dc3241adf718b1140a348ae064853177180bf2a/layer
curl -O https://our-registry.example.com/v1/images/68a857ae02fd4d97ddb43ba21dc3241adf718b1140a348ae064853177180bf2a/layer
curl -O https://our-registry.example.com/v1/images/19fa323289990f5685a78bf523a4946aea93ec5dfb0fa4b7a2edf26ac42412aa/json
curl -O https://our-registry.example.com/v1/images/19fa323289990f5685a78bf523a4946aea93ec5dfb0fa4b7a2edf26ac42412aa/layer
curl -O https://our-registry.example.com/v1/images/19fa323289990f5685a78bf523a4946aea93ec5dfb0fa4b7a2edf26ac42412aa/layer
curl -O https://our-registry.example.com/v1/images/35dc9435323495e6dc048556128f5075b5869aede8f57af235a601b3f38ea353/json
curl -O https://our-registry.example.com/v1/images/35dc9435323495e6dc048556128f5075b5869aede8f57af235a601b3f38ea353/layer
curl -O https://our-registry.example.com/v1/images/35dc9435323495e6dc048556128f5075b5869aede8f57af235a601b3f38ea353/layer
curl -O https://our-registry.example.com/v1/images/9bfba14d5960242ff7acbc31e3229ebe3bdedc471d1ecf144807017c557108a3/json
curl -O https://our-registry.example.com/v1/images/9bfba14d5960242ff7acbc31e3229ebe3bdedc471d1ecf144807017c557108a3/layer
curl -O https://our-registry.example.com/v1/images/9bfba14d5960242ff7acbc31e3229ebe3bdedc471d1ecf144807017c557108a3/layer
curl -O https://our-registry.example.com/v1/images/3ca1dfe05755b7c1af9b7264f59ef442dd5451cce0ca403e7b0549f07db37af4/json
curl -O https://our-registry.example.com/v1/images/3ca1dfe05755b7c1af9b7264f59ef442dd5451cce0ca403e7b0549f07db37af4/layer
curl -O https://our-registry.example.com/v1/images/3ca1dfe05755b7c1af9b7264f59ef442dd5451cce0ca403e7b0549f07db37af4/layer
curl -O https://our-registry.example.com/v1/images/3e836ac53ec401cb88ca784045953929cfc619aac37bd8b669d7929ff371357e/json
curl -O https://our-registry.example.com/v1/images/3e836ac53ec401cb88ca784045953929cfc619aac37bd8b669d7929ff371357e/layer
curl -O https://our-registry.example.com/v1/images/3e836ac53ec401cb88ca784045953929cfc619aac37bd8b669d7929ff371357e/layer
curl -O https://our-registry.example.com/v1/images/e940f2494e01939e28b555a3ff6894754c1e79b2da3a06e06cad5c68ae66e94f/json
curl -O https://our-registry.example.com/v1/images/e940f2494e01939e28b555a3ff6894754c1e79b2da3a06e06cad5c68ae66e94f/layer
curl -O https://our-registry.example.com/v1/images/e940f2494e01939e28b555a3ff6894754c1e79b2da3a06e06cad5c68ae66e94f/layer
curl -O https://our-registry.example.com/v1/images/59a6acada74e3522a78270c1eb3de11964bd03168131b8bd9a52ea812c7c49ef/json
curl -O https://our-registry.example.com/v1/images/59a6acada74e3522a78270c1eb3de11964bd03168131b8bd9a52ea812c7c49ef/layer
curl -O https://our-registry.example.com/v1/images/59a6acada74e3522a78270c1eb3de11964bd03168131b8bd9a52ea812c7c49ef/layer
curl -O https://our-registry.example.com/v1/images/17bc599649b4a9c340b14320b1525b42c9def351813c230c9dcad0ce4f2edac4/json
curl -O https://our-registry.example.com/v1/images/17bc599649b4a9c340b14320b1525b42c9def351813c230c9dcad0ce4f2edac4/layer
curl -O https://our-registry.example.com/v1/images/17bc599649b4a9c340b14320b1525b42c9def351813c230c9dcad0ce4f2edac4/layer
curl -O https://our-registry.example.com/v1/images/451cb4e639736cadcf7a52111cf4483ee7211e06fdb4c6df882ab6ec1f0d7be2/json
curl -O https://our-registry.example.com/v1/images/451cb4e639736cadcf7a52111cf4483ee7211e06fdb4c6df882ab6ec1f0d7be2/layer
curl -O https://our-registry.example.com/v1/images/451cb4e639736cadcf7a52111cf4483ee7211e06fdb4c6df882ab6ec1f0d7be2/layer
curl -O https://our-registry.example.com/v1/images/29a0981d8008246a329fd1b7d19270011aaa78ce274d5751246078b24b6bbb5c/json
curl -O https://our-registry.example.com/v1/images/29a0981d8008246a329fd1b7d19270011aaa78ce274d5751246078b24b6bbb5c/layer
curl -O https://our-registry.example.com/v1/images/29a0981d8008246a329fd1b7d19270011aaa78ce274d5751246078b24b6bbb5c/layer
curl -O https://our-registry.example.com/v1/images/205a854f59a549f8b4edc0c14ec9f565415592a36e3a8b6fd7836bd07a98d904/json
curl -O https://our-registry.example.com/v1/images/205a854f59a549f8b4edc0c14ec9f565415592a36e3a8b6fd7836bd07a98d904/layer
curl -O https://our-registry.example.com/v1/images/205a854f59a549f8b4edc0c14ec9f565415592a36e3a8b6fd7836bd07a98d904/layer
curl -O https://our-registry.example.com/v1/images/3471990c34d0572d28bbf9a14c189900fb81d5a010ce4c4da2146224edaddfe3/json
curl -O https://our-registry.example.com/v1/images/3471990c34d0572d28bbf9a14c189900fb81d5a010ce4c4da2146224edaddfe3/layer
curl -O https://our-registry.example.com/v1/images/3471990c34d0572d28bbf9a14c189900fb81d5a010ce4c4da2146224edaddfe3/layer
curl -O https://our-registry.example.com/v1/images/746c70792250bddb7ca5ab4ec0cc85ac2858dcc32a7f44fd11e562733b3f484d/json
curl -O https://our-registry.example.com/v1/images/746c70792250bddb7ca5ab4ec0cc85ac2858dcc32a7f44fd11e562733b3f484d/layer
curl -O https://our-registry.example.com/v1/images/746c70792250bddb7ca5ab4ec0cc85ac2858dcc32a7f44fd11e562733b3f484d/layer
Now, how long does this script take?
root@int-build-systems:~ # time ./test.sh
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 2380 100 2380 0 0 126k 0 --:--:-- --:--:-- --:--:-- 145k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1437 100 1437 0 0 74340 0 --:--:-- --:--:-- --:--:-- 84529
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 1665 0 --:--:-- --:--:-- --:--:-- 1916
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 2091 0 --:--:-- --:--:-- --:--:-- 3285
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1466 100 1466 0 0 80456 0 --:--:-- --:--:-- --:--:-- 91625
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 2175 0 --:--:-- --:--:-- --:--:-- 2875
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 2867 0 --:--:-- --:--:-- --:--:-- 3833
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1544 100 1544 0 0 131k 0 --:--:-- --:--:-- --:--:-- 150k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 2327 0 --:--:-- --:--:-- --:--:-- 3285
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 2852 0 --:--:-- --:--:-- --:--:-- 3833
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1529 100 1529 0 0 112k 0 --:--:-- --:--:-- --:--:-- 135k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 8645k 100 8645k 0 0 87.1M 0 --:--:-- --:--:-- --:--:-- 89.8M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 8645k 100 8645k 0 0 92.8M 0 --:--:-- --:--:-- --:--:-- 94.8M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1665 100 1665 0 0 154k 0 --:--:-- --:--:-- --:--:-- 203k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 162M 100 162M 0 0 131M 0 0:00:01 0:00:01 --:--:-- 133M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 162M 100 162M 0 0 159M 0 0:00:01 0:00:01 --:--:-- 159M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1540 100 1540 0 0 138k 0 --:--:-- --:--:-- --:--:-- 167k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 4833k 100 4833k 0 0 74.3M 0 --:--:-- --:--:-- --:--:-- 77.3M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 4833k 100 4833k 0 0 103M 0 --:--:-- --:--:-- --:--:-- 109M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1552 100 1552 0 0 161k 0 --:--:-- --:--:-- --:--:-- 216k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 164 100 164 0 0 18935 0 --:--:-- --:--:-- --:--:-- 23428
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 164 100 164 0 0 22422 0 --:--:-- --:--:-- --:--:-- 27333
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1555 100 1555 0 0 158k 0 --:--:-- --:--:-- --:--:-- 189k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 173 100 173 0 0 22709 0 --:--:-- --:--:-- --:--:-- 28833
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 173 100 173 0 0 22552 0 --:--:-- --:--:-- --:--:-- 24714
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1519 100 1519 0 0 169k 0 --:--:-- --:--:-- --:--:-- 211k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 292k 100 292k 0 0 28.7M 0 --:--:-- --:--:-- --:--:-- 35.6M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 292k 100 292k 0 0 28.9M 0 --:--:-- --:--:-- --:--:-- 35.6M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1531 100 1531 0 0 174k 0 --:--:-- --:--:-- --:--:-- 213k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1889 100 1889 0 0 239k 0 --:--:-- --:--:-- --:--:-- 307k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1889 100 1889 0 0 248k 0 --:--:-- --:--:-- --:--:-- 307k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1531 100 1531 0 0 175k 0 --:--:-- --:--:-- --:--:-- 213k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 3052 0 --:--:-- --:--:-- --:--:-- 3833
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 3115 0 --:--:-- --:--:-- --:--:-- 4600
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1620 100 1620 0 0 183k 0 --:--:-- --:--:-- --:--:-- 226k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1432 100 1432 0 0 185k 0 --:--:-- --:--:-- --:--:-- 233k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1432 100 1432 0 0 171k 0 --:--:-- --:--:-- --:--:-- 233k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1615 100 1615 0 0 168k 0 --:--:-- --:--:-- --:--:-- 225k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 337 100 337 0 0 26731 0 --:--:-- --:--:-- --:--:-- 56166
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 337 100 337 0 0 36112 0 --:--:-- --:--:-- --:--:-- 56166
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1612 100 1612 0 0 170k 0 --:--:-- --:--:-- --:--:-- 224k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 214 100 214 0 0 25295 0 --:--:-- --:--:-- --:--:-- 35666
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 214 100 214 0 0 27860 0 --:--:-- --:--:-- --:--:-- 35666
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1613 100 1613 0 0 184k 0 --:--:-- --:--:-- --:--:-- 225k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 333 100 333 0 0 43218 0 --:--:-- --:--:-- --:--:-- 55500
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 333 100 333 0 0 45164 0 --:--:-- --:--:-- --:--:-- 55500
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1610 100 1610 0 0 176k 0 --:--:-- --:--:-- --:--:-- 224k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 342 100 342 0 0 46035 0 --:--:-- --:--:-- --:--:-- 68400
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 342 100 342 0 0 22643 0 --:--:-- --:--:-- --:--:-- 26307
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1574 100 1574 0 0 96280 0 --:--:-- --:--:-- --:--:-- 102k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 158M 100 158M 0 0 136M 0 0:00:01 0:00:01 --:--:-- 136M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 158M 100 158M 0 0 150M 0 0:00:01 0:00:01 --:--:-- 150M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1608 100 1608 0 0 69634 0 --:--:-- --:--:-- --:--:-- 80400
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 142M 100 142M 0 0 126M 0 0:00:01 0:00:01 --:--:-- 127M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 142M 100 142M 0 0 155M 0 --:--:-- --:--:-- --:--:-- 156M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1690 100 1690 0 0 120k 0 --:--:-- --:--:-- --:--:-- 137k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 19.5M 100 19.5M 0 0 100M 0 --:--:-- --:--:-- --:--:-- 101M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 19.5M 100 19.5M 0 0 117M 0 --:--:-- --:--:-- --:--:-- 118M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1561 100 1561 0 0 86204 0 --:--:-- --:--:-- --:--:-- 101k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 1330 0 --:--:-- --:--:-- --:--:-- 1533
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 2674 0 --:--:-- --:--:-- --:--:-- 3285
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1564 100 1564 0 0 94885 0 --:--:-- --:--:-- --:--:-- 101k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 1776 0 --:--:-- --:--:-- --:--:-- 2090
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 1940 0 --:--:-- --:--:-- --:--:-- 2300
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1534 100 1534 0 0 146k 0 --:--:-- --:--:-- --:--:-- 187k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1929k 100 1929k 0 0 81.5M 0 --:--:-- --:--:-- --:--:-- 89.7M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1929k 100 1929k 0 0 86.4M 0 --:--:-- --:--:-- --:--:-- 99.1M
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1551 100 1551 0 0 87301 0 --:--:-- --:--:-- --:--:-- 126k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 184 100 184 0 0 15011 0 --:--:-- --:--:-- --:--:-- 18400
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 184 100 184 0 0 23535 0 --:--:-- --:--:-- --:--:-- 30666
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1556 100 1556 0 0 107k 0 --:--:-- --:--:-- --:--:-- 126k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 2873 0 --:--:-- --:--:-- --:--:-- 3833
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 1782 0 --:--:-- --:--:-- --:--:-- 2090
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 1580 100 1580 0 0 109k 0 --:--:-- --:--:-- --:--:-- 128k
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 1971 0 --:--:-- --:--:-- --:--:-- 2300
% Total % Received % Xferd Average Speed Time Time Time Current
Dload Upload Total Spent Left Speed
100 23 100 23 0 0 1713 0 --:--:-- --:--:-- --:--:-- 1916
real 0m10.708s
user 0m4.032s
sys 0m3.560s
10 seconds.
I realise that pull is doing other stuff besides downloading the layers (tar?), but should it really take over 12 times as long to 'docker pull' than to download the files? It seems to me there's something slowing down the process considerably.
The problem is especially noticable on large containers, pulling them from a docker-registry to hosts takes a considerable length of time despite ample free bandwidth over a local network.
Edit: Replaced semicolons with newlines in bash script to enhance readability