Skip to content
This repository was archived by the owner on Jan 1, 2021. It is now read-only.

Add new ISO generation method intended to replace existing Dockerfile #1332

Merged
merged 22 commits into from
Sep 15, 2018
Merged

Add new ISO generation method intended to replace existing Dockerfile #1332

merged 22 commits into from
Sep 15, 2018

Conversation

tianon
Copy link
Contributor

@tianon tianon commented Sep 10, 2018

This is a whole new ISO that's intended to eventually replace the existing one (and should explicitly be compatible completely -- it's just a cleaner way to build TCL into an ISO via Docker).

The main gist of these changes is using TCL's own tce-load with a minor patch in order to install packages in our target environment, which allows us to largely ignore their dependencies (ie, the entire purpose of a package manager).

This also includes a bump to Linux 4.14.69 and the requisite addition of haveged which is noted/discussed over in #1322.

@tianon
Copy link
Contributor Author

tianon commented Sep 10, 2018 •
edited
Loading

There's an example build up at https://gist.github.com/tianon/1ff294a629942e6f0a019c532b3b2734 (https://gist.github.com/tianon/1ff294a629942e6f0a019c532b3b2734/raw/97e8a794d019ae77b1c9636d789f790740b4ed1b/boot2docker.iso).

@legal90 any chance you could test this via Parallels and ensure it does the right thing? 🙏 ❤️

(Also, is there somewhere public I could link to for Parallels Tools releases in https://github.com/tianon/boot2docker-legacy/blob/b91259e06cc066d27b3931585465b161a26c845d/tcl/files/make-b2d-iso.sh#L36?)

@tianon tianon mentioned this pull request Sep 10, 2018
Closed
@tianon
Copy link
Contributor Author

tianon commented Sep 10, 2018

So far, the best I can find is something like https://github.com/Homebrew/homebrew-cask-versions/blob/master/Casks/parallels13.rb, which at least would give us a source for updating this version number, but it isn't official (and I'm not sure where they're getting their version numbers from -- probably just stealing it from the application itself after it updates).

@legal90
Copy link
Contributor

legal90 commented Sep 11, 2018 •
edited
Loading

@legal90 any chance you could test this via Parallels and ensure it does the right thing? 🙏 ❤️

@tianon Hm.. It seems that boot2docker.iso image which you mentioned launches docker daemon with listening to UNIX socket only. It doesn't listen to TCP socket, so I can't verify it with docker-machine 0.15.0.
The only I managed to check is that shared folders work fine there.

(Also, is there somewhere public I could link to for Parallels Tools releases in https://github.com/tianon/boot2docker-legacy/blob/b91259e06cc066d27b3931585465b161a26c845d/tcl/files/make-b2d-iso.sh#L36?)

As far as I know, the dynamic link for downloading the latest release of Parallels Desktop for Mac is https://www.parallels.com/directdownload/pd/
But if you want to have the same especially for "Parallels Tools for boo2docker" bundle, then I can ask my former colleagues from Parallels about that.
Currently the version numbers which we use here in Dockerfile (

boot2docker/Dockerfile

Lines 236 to 241 in 7c826fb

ENV PRL_MAJOR 13
ENV PRL_VERSION 13.3.0-43321
RUN set -ex \
&& mkdir -p /prl_tools \
&& curl -fSL "http://download.parallels.com/desktop/v${PRL_MAJOR}/${PRL_VERSION}/ParallelsTools-${PRL_VERSION}-boot2docker.tar.gz" \
) are updated on-demand, e.q. the new tar is published only when it's decided to promote it to boot2docker. Usually there are no issues of using the older version of Tools with newer version of the host part (Parallels Desktop), so it's updated not so often here.

@tianon
Copy link
Contributor Author

tianon commented Sep 11, 2018

Hm.. It seems that boot2docker.iso image which you mentioned launches docker daemon with listening to UNIX socket only. It doesn't listen to TCP socket, so I can't verify it with docker-machine 0.15.0.

Whoops, that was an oversight, sorry! I've updated the branch and the gist with a newer ISO which should fix that: https://gist.github.com/tianon/1ff294a629942e6f0a019c532b3b2734 (https://gist.github.com/tianon/1ff294a629942e6f0a019c532b3b2734/raw/f84b9fbb224dbe2fbdf6d7c8a87d447d2ec4a961/boot2docker.iso)

I've successfully tested this one with Hyper-V via docker-machine, so fingers crossed it's all fixed. 😅

Currently the version numbers which we use here in Dockerfile (...) are updated on-demand, e.q. the new tar is published only when it's decided to promote it to boot2docker.

Ah, fair enough! I won't worry about it then. 😇 ❤️

@legal90
Copy link
Contributor

legal90 commented Sep 11, 2018 •
edited
Loading

@tianon Thank you! I tested the new iso and it works like a charm under on latest Parallels Desktop(v14.0.0 build 45124 at this moment) ! 🎉
There is no delay of dockerd start anymore.

@ailispaw ailispaw mentioned this pull request Sep 11, 2018
Open
@tianon
Copy link
Contributor Author

tianon commented Sep 11, 2018

Excellent, thanks for testing and confirming, @legal90! 👍

@tianon
Copy link
Contributor Author

tianon commented Sep 12, 2018

I was thinking of publishing this alongside the existing boot2docker.iso for a couple releases, but I'm currently leaning more towards replacing the existing boot2docker.iso entirely and just going all-in here.

tianon added 18 commits September 13, 2018 11:50
@tianon
Add new method of building ISO (more TCL-centric)
b119b65
@tianon
Remove AUFS from new installer
cb59109
@tianon
Update kernel to 4.9.126, VBox to 5.2.18
998d137
@tianon
Update to 18.09.0-ce-beta1
d42ae76
@tianon
Update to Linux 4.14 (specifically 4.14.69)
d3f387d
@tianon
Add "haveged" (but start it conditional on low entropy during system …
8351994 
…startup)

This solves the problem introduced by https://lkml.org/lkml/2018/4/12/711 (especially for VMs, where entropy is scarse).

To elaborate a little on the problem, simply invoking "dockerd" hangs without any output until sufficient entropy is available.
@tianon
Add a basic README to explain what this directory is
a799a12
@tianon
Add more Hyper-V related kernel configuration
2700482
@tianon
Add logging to haveged
b4589f2
@tianon
Add a hint to the swap warning
a9f0d2d
@tianon
Add simple workaround for docker-machine expecting "dockerd" to be li…
2f300ef 
…stening remotely before it configures it to do so
@tianon
Explicitly ignore requests for AUFS (since they'll just fail to start…
f11dd19 
… dockerd anyhow)
@tianon
Add a little more consistency to /etc/init.d/haveged output
67cd89d
@tianon
Use "PermitUserEnvironment" to enforce a sane PATH on ssh (so docker-…
9e858e7 
…machine can use "ip" and "iptables" properly)
@tianon
Add "Tiny Core Linux" version/link to boot2docker info block
23d6236
@tianon
Send all haveged output to the log file
17f3ec8
@tianon
Add CloudFlare's privacy-focused DNS servers above Google's
b59760b
@tianon
Replace existing boot2docker with new code
c2b60ab
@tianon
Copy link
Contributor Author

tianon commented Sep 15, 2018 •
edited
Loading

As another point in favor of this, the resulting ISO not only has more useful tools installed (like properly configured bash-completion), but is a few MB smaller. 👍

(Even the Docker image is ~200MB smaller. 💯)

@tianon tianon merged commit a35a287 into boot2docker:master Sep 15, 2018
@tianon tianon deleted the tcl branch September 15, 2018 15:21
This was referenced Sep 15, 2018
Closed
Closed
@TheDeadCode
Copy link

On this version (v18.09.0), using docker-machine and vmware-vsphere driver, the network interface does not connect to DHCP, effectively making it stuck to "Waiting for VMWare tools"

@tianon
Copy link
Contributor Author

tianon commented Dec 29, 2018 via email

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
3 participants
@tianon @legal90 @TheDeadCode