Skip to content

Conversation

maflcko
Copy link
Member

@maflcko maflcko commented Nov 8, 2019

Without this gitian prints warnings for me:

ERROR: ld.so: object '/usr/lib/x86_64-linux-gnu/faketime/libfaketime.so.1' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
$ ls /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1 
/usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1

@maflcko maflcko force-pushed the 1911-gitianArm64 branch 2 times, most recently from faaaeef to fad5403 Compare November 8, 2019 01:12
@DrahtBot
Copy link
Contributor

DrahtBot commented Nov 8, 2019

The following sections might be updated with supplementary metadata relevant to reviewers and maintainers.

Conflicts

No conflicts as of last run.

@maflcko maflcko force-pushed the 1911-gitianArm64 branch 4 times, most recently from cc6b337 to fa61c79 Compare November 8, 2019 03:24
-BEGIN VERIFY SCRIPT-
sed -i -e "s|'export LD_PRELOAD=/usr/lib/x86_64-linux-gnu/faketime/libfaketime.so.1'|\"export LD_PRELOAD='/usr/\\\\\$LIB/faketime/libfaketime.so.1'\"|g" $(git grep -l 'x86_64-linux-gnu/faketime')
sed -i -e 's|"amd64"|"linux64"|g' $(git grep -l '"amd64"')
-END VERIFY SCRIPT-
@laanwj
Copy link
Member

laanwj commented Nov 8, 2019

Code review ACK fab9850
(haven't tested build determinism yet)

@maflcko
Copy link
Member Author

maflcko commented Nov 8, 2019

Note that this requires a gbuild that includes this patch: devrandom/gitian-builder#223

@fanquake
Copy link
Member

fanquake commented Nov 8, 2019

Note that this requires a gbuild that includes this patch:

So should this get a mention in our docs somewhere, if you've bumped the minimum required version of gitian-builder?

@maflcko
Copy link
Member Author

maflcko commented Nov 8, 2019

docs somewhere

I don't think we have docs somewhere that document the minimum required version of gitian. Also, gitian is not versioned, and as long as the diff is applied to your local clone of gitian, the build should succeed.

@maflcko
Copy link
Member Author

maflcko commented Nov 8, 2019

@fanquake We don't officially support versions that are not the latest version:

https://github.com/bitcoin/bitcoin/blame/8021392b825c74312173f15eb937ba6d4aec3841/contrib/gitian-build.py#L245
https://github.com/bitcoin/bitcoin/blame/8021392b825c74312173f15eb937ba6d4aec3841/doc/release-process.md#L112

So I think this is ready for merge (assuming DrahtBot and other peoples build succeed)

@laanwj
Copy link
Member

laanwj commented Nov 8, 2019

I think the implicit requirement is to use the latest version of gitian-builder for new releases (I mean, latest commit). This is likely not documented anywhere,but it has always been the case

@DrahtBot
Copy link
Contributor

DrahtBot commented Nov 9, 2019

Gitian builds

File commit 8021392
(master)
commit 06adecb
(master and this pull)
bitcoin-0.19.99-aarch64-linux-gnu-debug.tar.gz d30ccb3bc3e2b17f... 034d4a66ea4d59e9...
bitcoin-0.19.99-aarch64-linux-gnu.tar.gz 57491dba3936bda8... 440cdbef7fe124ab...
bitcoin-0.19.99-arm-linux-gnueabihf-debug.tar.gz 1e553ea164a4cd7f... 6d24af827380d8a4...
bitcoin-0.19.99-arm-linux-gnueabihf.tar.gz 015366fa434da86d... 8fced15b39a580e0...
bitcoin-0.19.99-i686-pc-linux-gnu-debug.tar.gz 540e1353bc835640... 41e7a48690b67c89...
bitcoin-0.19.99-i686-pc-linux-gnu.tar.gz f6f8fa79c790cf01... 2d02fe464f801046...
bitcoin-0.19.99-riscv64-linux-gnu-debug.tar.gz f742089555860c38... 7910b0a281d13656...
bitcoin-0.19.99-riscv64-linux-gnu.tar.gz 410c7ee098dae993... d71ee7c11745be8c...
bitcoin-0.19.99-win64-debug.zip 9a0bccad9ba2d958... 02f7fcc6f28a45d4...
bitcoin-0.19.99-win64-setup-unsigned.exe f66f93a9663d1bf1... 8870085201a2a7bf...
bitcoin-0.19.99-win64.zip 87d569e6df61ef5e... 9237001fa0a9db40...
bitcoin-0.19.99-x86_64-linux-gnu-debug.tar.gz 0be0d1f65b4e2b67... 6aa4d4715d627510...
bitcoin-0.19.99-x86_64-linux-gnu.tar.gz 68923503e791736c... 0b8a9c2cfc44ec1e...
bitcoin-0.19.99.tar.gz 21bb937085b774af... f80416d5acbb1f49...
bitcoin-core-linux-0.20-res.yml 960db765bcddfb39... c742ffb577095efb...
bitcoin-core-win-0.20-res.yml c332590dd177bdb0... 95953945f1757602...
linux-build.log 00ff825e1ae728ff... de35fb68d25d1828...
win-build.log 94f52043528b9e40... 1ce6dbb1fcddd28f...
bitcoin-0.19.99-osx-unsigned.dmg 09bafb8752e5fd14...
bitcoin-0.19.99-osx64.tar.gz 3cecde8b6a18f966...
bitcoin-core-linux-0.20-res.yml.diff 67c1886707c6080b...
bitcoin-core-osx-0.20-res.yml 4c8433f69e8179fd...
bitcoin-core-win-0.20-res.yml.diff 2c818c39de981b79...
linux-build.log.diff df03a36be34a7cf6...
osx-build.log 7ccc72d160d3e2cc...
win-build.log.diff c02416f1bca3d9b2...

@fanquake
Copy link
Member

fanquake commented Nov 9, 2019

I think the implicit requirement is to use the latest version of gitian-builder for new releases

Ok. I feel like at one point we might have specified only a minimum bound, but I can't find any record of it.

Upstream devrandom/gitian-builder#223 has now been merged.

@DrahtBot
Copy link
Contributor

DrahtBot commented Nov 9, 2019

Gitian builds

File commit a7aec7a
(master)
commit 25c136d
(master and this pull)
bitcoin-0.19.99-aarch64-linux-gnu-debug.tar.gz 2ded8805929bee45... 1545a052aefe4d8f...
bitcoin-0.19.99-aarch64-linux-gnu.tar.gz 3d48b0f55743be45... 47b46ed14c06c6fe...
bitcoin-0.19.99-arm-linux-gnueabihf-debug.tar.gz cb55a98800189a95... d6ade84d2e717eb8...
bitcoin-0.19.99-arm-linux-gnueabihf.tar.gz e58124ef423d9ce0... 3ef973c6f47e4267...
bitcoin-0.19.99-i686-pc-linux-gnu-debug.tar.gz 765e0b5d54091961... 2781eee4539fb3d8...
bitcoin-0.19.99-i686-pc-linux-gnu.tar.gz 19e57b6a2eecefc0... 91cfc47b8a0b7093...
bitcoin-0.19.99-osx-unsigned.dmg 1edc1f1810b3ebcc... ed6a358f1b7fa397...
bitcoin-0.19.99-osx64.tar.gz eeb3024352757631... 1e63e8af030e810f...
bitcoin-0.19.99-riscv64-linux-gnu-debug.tar.gz faa0583d9b60850f... 65c45c588b9e3c6c...
bitcoin-0.19.99-riscv64-linux-gnu.tar.gz 704d1057bb7b206e... e77e52dd8d250ed4...
bitcoin-0.19.99-win64-debug.zip dba0ee9e7e33dbe6... 6af233826142186d...
bitcoin-0.19.99-win64-setup-unsigned.exe 9de6964561a5fd19... 232a3b3a2d1a9ef0...
bitcoin-0.19.99-win64.zip 588123a6197dc260... e4cbfafcb1971a08...
bitcoin-0.19.99-x86_64-linux-gnu-debug.tar.gz 0bc81dd03a88dabd... 994d14a0d65c049f...
bitcoin-0.19.99-x86_64-linux-gnu.tar.gz 7bd514ec16d6aece... 8505bc78fb7e0be2...
bitcoin-0.19.99.tar.gz 1eb123b6d792dfc5... b7fd3e751120b911...
bitcoin-core-linux-0.20-res.yml eb8ec4e3ddb55cf1... 3ef3b92a9eef9f9e...
bitcoin-core-osx-0.20-res.yml 7a075eb05e15b10c... 64df98c4908c2417...
bitcoin-core-win-0.20-res.yml b5bd1a2c2d396906... febecb3add807a44...
linux-build.log bed06fee965d926e... 541d3c467580ebc4...
osx-build.log a000eab9df81732c... ba0dccedd0123409...
win-build.log 9c17b06865a5e6b0... 9d02ca30f6860547...
bitcoin-core-linux-0.20-res.yml.diff ae1aac3c5ba86a68...
bitcoin-core-osx-0.20-res.yml.diff b6cd589dff396e0f...
bitcoin-core-win-0.20-res.yml.diff 33cc23839bc8991b...
linux-build.log.diff 1b04eec63ee06f41...
osx-build.log.diff ee9303a5c868ac83...
win-build.log.diff 3f11baa498878158...

@laanwj
Copy link
Member

laanwj commented Nov 10, 2019

The two above gitian builds don't seem to match 😢

@maflcko
Copy link
Member Author

maflcko commented Nov 10, 2019

What do you mean they don't match? The commit hashes are different, so all builds must differ as well.

@laanwj
Copy link
Member

laanwj commented Nov 10, 2019

Oh, I thought you were trying to show determinism by running gitian-builder twice on the same commit.

@maflcko
Copy link
Member Author

maflcko commented Nov 12, 2019

I ran it on the same commit as DrahtBot and got a match for osx: (linux and windows didn't compile due to #17323 )

$ sha256sum ./scratch/gitian/bitcoin-binaries/25c136d3/*
1e63e8af030e810f6fced9b494274ee5821781687ce3a302730cead48dfd44bf  ./scratch/gitian/bitcoin-binaries/25c136d3/bitcoin-0.19.99-osx64.tar.gz
ed6a358f1b7fa39712174981c9e211e7288801e0711e3be4f6bd4c82f8b0cc66  ./scratch/gitian/bitcoin-binaries/25c136d3/bitcoin-0.19.99-osx-unsigned.dmg
b7fd3e751120b911c4b2e3998726b673a8a8edab6ad2cfe01526053e33c22d3d  ./scratch/gitian/bitcoin-binaries/25c136d3/bitcoin-0.19.99.tar.gz
3ada76f58943e505ce55cdb1f3e24fe599a323c44a826049e0839c48a461f258  ./scratch/gitian/bitcoin-binaries/25c136d3/bitcoin-core-osx-0.20-res.yml
143682b4f38681f400623973adb6bf37f00c800621086193a82e8aee04c96f24  ./scratch/gitian/bitcoin-binaries/25c136d3/linux-build.log
c70240190107edc5b757bff5004264d23dc116088883c878e3abb25caa5855d5  ./scratch/gitian/bitcoin-binaries/25c136d3/osx-build.log
71f1b8ead4f53b1b6806543b50e39ece600c88b5d5f3306d902acdc0ad0f71ef  ./scratch/gitian/bitcoin-binaries/25c136d3/win-build.log

@maflcko
Copy link
Member Author

maflcko commented Nov 12, 2019

Done

@laanwj
Copy link
Member

laanwj commented Nov 12, 2019

ACK fab9850, ran two -linux builds and they match
ACK 3333629

156d83b11f469a2b4d0f2f6e2e926ec5527a893178fa0b029e62acb030990622  bitcoin-0.19.99-aarch64-linux-gnu-debug.tar.gz
357a099db4ca37f1076c9d88cacc64b0b905d84305c89d014277ad3c274388a7  bitcoin-0.19.99-aarch64-linux-gnu.tar.gz
44a02d1397312e16f6a029b0a3429ff617e1e1c8862e49b15730a3afe169bfa2  bitcoin-0.19.99-arm-linux-gnueabihf-debug.tar.gz
9f6eb58afdbf93ef1983e89b074a1dd7d0e52f97272c510a052ecfd7cedccc38  bitcoin-0.19.99-arm-linux-gnueabihf.tar.gz
100ec7d9da684075c2bd7b24df0f008fb1c6a0b7977534d84196bf6a358eeeea  bitcoin-0.19.99-i686-pc-linux-gnu-debug.tar.gz
d541290225f9dcb645a5d7026a55212c74f370a9b07c4bccbe693690080347a6  bitcoin-0.19.99-i686-pc-linux-gnu.tar.gz
0bb2e865157e71af718d792774e6f8ed4eba80ad9f3790e171cf371f65fa30bd  bitcoin-0.19.99-riscv64-linux-gnu-debug.tar.gz
ba3aa72aa649cafcbe51470931c0d8150f9d8c1a631e9708e83e8b25ac2dfcf2  bitcoin-0.19.99-riscv64-linux-gnu.tar.gz
5f3e64d037da40ffb78ef48ad5958e94542b776ff3e7769fd7aefb81eade3607  bitcoin-0.19.99-x86_64-linux-gnu-debug.tar.gz
164e6348a02e056aa75a8c79f604d5cd026aadcac0ad9e49139dc04b4f05d7d0  bitcoin-0.19.99-x86_64-linux-gnu.tar.gz
156d83b11f469a2b4d0f2f6e2e926ec5527a893178fa0b029e62acb030990622  bitcoin-0.19.99-aarch64-linux-gnu-debug.tar.gz
357a099db4ca37f1076c9d88cacc64b0b905d84305c89d014277ad3c274388a7  bitcoin-0.19.99-aarch64-linux-gnu.tar.gz
44a02d1397312e16f6a029b0a3429ff617e1e1c8862e49b15730a3afe169bfa2  bitcoin-0.19.99-arm-linux-gnueabihf-debug.tar.gz
9f6eb58afdbf93ef1983e89b074a1dd7d0e52f97272c510a052ecfd7cedccc38  bitcoin-0.19.99-arm-linux-gnueabihf.tar.gz
100ec7d9da684075c2bd7b24df0f008fb1c6a0b7977534d84196bf6a358eeeea  bitcoin-0.19.99-i686-pc-linux-gnu-debug.tar.gz
d541290225f9dcb645a5d7026a55212c74f370a9b07c4bccbe693690080347a6  bitcoin-0.19.99-i686-pc-linux-gnu.tar.gz
0bb2e865157e71af718d792774e6f8ed4eba80ad9f3790e171cf371f65fa30bd  bitcoin-0.19.99-riscv64-linux-gnu-debug.tar.gz
ba3aa72aa649cafcbe51470931c0d8150f9d8c1a631e9708e83e8b25ac2dfcf2  bitcoin-0.19.99-riscv64-linux-gnu.tar.gz
5f3e64d037da40ffb78ef48ad5958e94542b776ff3e7769fd7aefb81eade3607  bitcoin-0.19.99-x86_64-linux-gnu-debug.tar.gz
164e6348a02e056aa75a8c79f604d5cd026aadcac0ad9e49139dc04b4f05d7d0  bitcoin-0.19.99-x86_64-linux-gnu.tar.gz

same for windows

f349e675ffec85081ad0bd3704b10ff87664888860dfe73c4898add9ebc7a68b  bitcoin-0.19.99-win-unsigned.tar.gz
78465e91cb11d1a145108c9b5d16500f477f9f4c643fdc5d0d5873abd7257b7c  bitcoin-0.19.99-win64-debug.zip
503a17d636c89fa9b9964ccc84300b228787cb54acd76400cef0f2364d4e3add  bitcoin-0.19.99-win64-setup-unsigned.exe
6bda2c10eebee5cc87eb9cd13e6f77927e1b502e1656320154346f3581112ade  bitcoin-0.19.99-win64.zip
691e4cc359b7fdf4f0d47d36dd4a1b4bc95146d6c9ae75838a4c35a8b3343701  src/bitcoin-0.19.99.tar.gz
6149a730b4d1953c7dc9d54679065728296bc5e2747bc364878d698738edbca7  bitcoin-core-win-0.20-res.yml
f349e675ffec85081ad0bd3704b10ff87664888860dfe73c4898add9ebc7a68b  bitcoin-0.19.99-win-unsigned.tar.gz
78465e91cb11d1a145108c9b5d16500f477f9f4c643fdc5d0d5873abd7257b7c  bitcoin-0.19.99-win64-debug.zip
503a17d636c89fa9b9964ccc84300b228787cb54acd76400cef0f2364d4e3add  bitcoin-0.19.99-win64-setup-unsigned.exe
6bda2c10eebee5cc87eb9cd13e6f77927e1b502e1656320154346f3581112ade  bitcoin-0.19.99-win64.zip
691e4cc359b7fdf4f0d47d36dd4a1b4bc95146d6c9ae75838a4c35a8b3343701  src/bitcoin-0.19.99.tar.gz
6149a730b4d1953c7dc9d54679065728296bc5e2747bc364878d698738edbca7  bitcoin-core-win-0.20-res.yml

@maflcko
Copy link
Member Author

maflcko commented Nov 12, 2019

Compiled windows and it matches yours as well:

Compiling fab9850 Windows
--- Building for bionic linux64 ---
Stopping target if it is up
Making a new image copy
Starting target
Checking if target is up.
Preparing build environment
Updating apt-get repository (log in var/install.log)
Installing additional packages (log in var/install.log)
Upgrading system, may take a while (log in var/install.log)
Creating package manifest
Creating build script (var/build-script)
Running build script (log in var/build.log)
Grabbing results from target
Grabbing cache from target
Generating report
f349e675ffec85081ad0bd3704b10ff87664888860dfe73c4898add9ebc7a68b  bitcoin-0.19.99-win-unsigned.tar.gz
78465e91cb11d1a145108c9b5d16500f477f9f4c643fdc5d0d5873abd7257b7c  bitcoin-0.19.99-win64-debug.zip
503a17d636c89fa9b9964ccc84300b228787cb54acd76400cef0f2364d4e3add  bitcoin-0.19.99-win64-setup-unsigned.exe
6bda2c10eebee5cc87eb9cd13e6f77927e1b502e1656320154346f3581112ade  bitcoin-0.19.99-win64.zip
691e4cc359b7fdf4f0d47d36dd4a1b4bc95146d6c9ae75838a4c35a8b3343701  src/bitcoin-0.19.99.tar.gz
2b9ea9a8a42fdf90224b41f6de277502dfe1eb7020700d2764fcf9263bf74e59  bitcoin-core-win-0.20-res.yml

(except for res.yml, of course, which is expected)

Same for linux:

Compiling fab9850 Linux
--- Building for bionic linux64 ---
Stopping target if it is up
Making a new image copy
Starting target
Checking if target is up.
Preparing build environment
Updating apt-get repository (log in var/install.log)
Installing additional packages (log in var/install.log)
Upgrading system, may take a while (log in var/install.log)
Creating package manifest
Creating build script (var/build-script)
Running build script (log in var/build.log)
Grabbing results from target
Grabbing cache from target
Generating report
156d83b11f469a2b4d0f2f6e2e926ec5527a893178fa0b029e62acb030990622  bitcoin-0.19.99-aarch64-linux-gnu-debug.tar.gz
357a099db4ca37f1076c9d88cacc64b0b905d84305c89d014277ad3c274388a7  bitcoin-0.19.99-aarch64-linux-gnu.tar.gz
44a02d1397312e16f6a029b0a3429ff617e1e1c8862e49b15730a3afe169bfa2  bitcoin-0.19.99-arm-linux-gnueabihf-debug.tar.gz
9f6eb58afdbf93ef1983e89b074a1dd7d0e52f97272c510a052ecfd7cedccc38  bitcoin-0.19.99-arm-linux-gnueabihf.tar.gz
100ec7d9da684075c2bd7b24df0f008fb1c6a0b7977534d84196bf6a358eeeea  bitcoin-0.19.99-i686-pc-linux-gnu-debug.tar.gz
d541290225f9dcb645a5d7026a55212c74f370a9b07c4bccbe693690080347a6  bitcoin-0.19.99-i686-pc-linux-gnu.tar.gz
0bb2e865157e71af718d792774e6f8ed4eba80ad9f3790e171cf371f65fa30bd  bitcoin-0.19.99-riscv64-linux-gnu-debug.tar.gz
ba3aa72aa649cafcbe51470931c0d8150f9d8c1a631e9708e83e8b25ac2dfcf2  bitcoin-0.19.99-riscv64-linux-gnu.tar.gz
5f3e64d037da40ffb78ef48ad5958e94542b776ff3e7769fd7aefb81eade3607  bitcoin-0.19.99-x86_64-linux-gnu-debug.tar.gz
164e6348a02e056aa75a8c79f604d5cd026aadcac0ad9e49139dc04b4f05d7d0  bitcoin-0.19.99-x86_64-linux-gnu.tar.gz
691e4cc359b7fdf4f0d47d36dd4a1b4bc95146d6c9ae75838a4c35a8b3343701  src/bitcoin-0.19.99.tar.gz
867588207f5c985ae8daac9baa6442083a63e133651becae61af8e62e7d51d45  bitcoin-core-linux-0.20-res.yml

laanwj added a commit that referenced this pull request Nov 13, 2019
3333629 doc: Explain $LIB in LD_PRELOAD in gitian descriptors (MarcoFalke)
fab9850 scripted-diff: Avoid hardcoded libfaketime dir in gitian (MarcoFalke)

Pull request description:

  Without this gitian prints warnings for me:

  ```
  ERROR: ld.so: object '/usr/lib/x86_64-linux-gnu/faketime/libfaketime.so.1' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
  ```

  ```
  $ ls /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  ```

ACKs for top commit:
  laanwj:
    ACK 3333629

Tree-SHA512: 3e7c4471b69c2ae38c29d0cc0db8b9eae0912085299d7f5ac67eeb4b6a2fdc7eb23d806eeeae0b0c2da22d6d1ba82513cab23652876b97aada9928b2c7d38e7e
@laanwj laanwj merged commit 3333629 into bitcoin:master Nov 13, 2019
@maflcko
Copy link
Member Author

maflcko commented Nov 13, 2019

The build on my arm64 with a single thread just completed:

Compiling fab9850ef4a76e4f09278909a2865e5175661653 Windows
--- Building for bionic linux64 ---
Stopping target if it is up
Making a new image copy
Starting target
Checking if target is up..
Preparing build environment
Updating apt-get repository (log in var/install.log)
Installing additional packages (log in var/install.log)
Upgrading system, may take a while (log in var/install.log)
Creating package manifest
Creating build script (var/build-script)
Running build script (log in var/build.log)
Grabbing results from target
Grabbing cache from target
Generating report
a0a12b428c9ce7137d966022be15e49bf3e2538738bce173509598bc829dd5fa  bitcoin-0.19.99-win-unsigned.tar.gz
b410bc4a2fa908f996b617efaca5cc9b3acae6920ee30f2f0cac8504a87f556b  bitcoin-0.19.99-win64-debug.zip
f45c898bac6c2550cb7dd9e2138f6beaf288ec58d59ea619fd30b55a8ac766c3  bitcoin-0.19.99-win64-setup-unsigned.exe
fd822a029b2a43975a5ff8c4707d16d5726dda69d24de11fb78c74d299518081  bitcoin-0.19.99-win64.zip
691e4cc359b7fdf4f0d47d36dd4a1b4bc95146d6c9ae75838a4c35a8b3343701  src/bitcoin-0.19.99.tar.gz
ba59634819dc55558f470116834fdf94a23dc21990538d74ff7a45c28844fa72  bitcoin-core-win-0.20-res.yml
Done.
gpg: keybox '/home/ubuntu/.gnupg/pubring.kbx' created
gpg: skipped "no_signer": No secret key
gpg: signing failed: No secret key
Traceback (most recent call last):
        1: from bin/gsign:93:in `<main>'
bin/gsign:11:in `system!': failed to run gpg --detach-sign -u "no_signer" "../gitian.sigs/fab9850ef4a76e4f09278909a2865e5175661653-win-unsigned/no_signer/bitcoin-core-win-0.20-build.assert" (RuntimeError)
Traceback (most recent call last):
  File "./contrib/gitian-build.py", line 261, in <module>
    main()
  File "./contrib/gitian-build.py", line 249, in main
    build()
  File "./contrib/gitian-build.py", line 69, in build
    subprocess.check_call(['bin/gsign', '-p', args.sign_prog, '--signer', args.signer, '--release', args.version+'-win-unsigned', '--destination', '../gitian.sigs/', '../bitcoin/contrib/gitian-descriptors/gitian-win.yml'])
  File "/usr/lib/python3.6/subprocess.py", line 311, in check_call
    raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['bin/gsign', '-p', 'gpg --detach-sign', '--signer', 'no_signer', '--release', 'fab9850ef4a76e4f09278909a2865e5175661653-win-unsigned', '--destination', '../gitian.sigs/', '../bitcoin/contrib/gitian-descriptors/gitian-win.yml']' returned non-zero exit status 1.
ubuntu@ubuntu:~/bitcoin-core$ uname -a
Linux ubuntu 4.15.0-1041-raspi2 #44-Ubuntu SMP PREEMPT Wed Jul 3 15:45:20 UTC 2019 aarch64 aarch64 aarch64 GNU/Linux

@maflcko maflcko deleted the 1911-gitianArm64 branch November 13, 2019 21:08
sidhujag pushed a commit to syscoin/syscoin that referenced this pull request Nov 13, 2019
3333629 doc: Explain $LIB in LD_PRELOAD in gitian descriptors (MarcoFalke)
fab9850 scripted-diff: Avoid hardcoded libfaketime dir in gitian (MarcoFalke)

Pull request description:

  Without this gitian prints warnings for me:

  ```
  ERROR: ld.so: object '/usr/lib/x86_64-linux-gnu/faketime/libfaketime.so.1' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
  ```

  ```
  $ ls /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  ```

ACKs for top commit:
  laanwj:
    ACK 3333629

Tree-SHA512: 3e7c4471b69c2ae38c29d0cc0db8b9eae0912085299d7f5ac67eeb4b6a2fdc7eb23d806eeeae0b0c2da22d6d1ba82513cab23652876b97aada9928b2c7d38e7e
@jonasschnelli
Copy link
Contributor

Does this outdate the docs: https://github.com/bitcoin-core/docs/blob/master/gitian-building/gitian-building-setup-gitian-debian.md#setting-up-the-gitian-image?

@maflcko
Copy link
Member Author

maflcko commented Nov 14, 2019

Yes, they will need to be fixed up

@jonasschnelli
Copy link
Contributor

I guess this requires a new base image?
Using the newest gitian master that includes (devrandom/gitian-builder#223) calling bin/make-base-vm --lxc --arch linux64 --suite bionic results on my end in:

E: Invalid Release file, no entry for main/binary-linux64/Packages

@maflcko
Copy link
Member Author

maflcko commented Nov 14, 2019

Ok, it might be better to just revert this pull request and give up on getting this run on non-amd64

@laanwj
Copy link
Member

laanwj commented Nov 15, 2019

No, it isn't necessary to generate a new image. linux64 is an abstract name, the concrete build arch is still the same. What I did was just symlink the old base image. After that, the LXC build worked.

bin/make-base-vm --lxc --arch linux64 --suite bionic

The LXC parameters should be kept the same, there is no architecture-independent release of ubuntu 😄

@maflcko
Copy link
Member Author

maflcko commented Nov 15, 2019

What I did was just symlink the old base image.

Yes, that works, but is clumsy. At the very least the instructions should be updated to include this step.

@laanwj
Copy link
Member

laanwj commented Nov 15, 2019

Well, less clumsy than waiting half an hour to generate a new base image, but sure…
I think ideally gitian should pick the right base image for the platform automatically.

@jonasschnelli
Copy link
Contributor

I can confirm that a symlink helps.
But how should new (or existing) gitian builder figure that out?

@maflcko
Copy link
Member Author

maflcko commented Nov 15, 2019

Yeah, either

  • the docs need to be updated, or
  • gitian-builder needs to be made smarter, or
  • the change needs to be reverted

MarkLTZ added a commit to litecoinz-core/litecoinz that referenced this pull request Nov 29, 2019
maflcko pushed a commit that referenced this pull request Jan 22, 2020
fae7530 scripted-diff: Set gitian arch back to amd64 (MarcoFalke)

Pull request description:

  This was required to allow gitian builds on non-amd64 architecture, however, it seems to break the current builds (with lxc), see #17409 (comment)

  Also, the gititan builds wouldn't be deterministic across arches anyway, see #17468

  So instead of wasting more time on this, revert the change and hope that guix allows to compile on non-amd64 architectures.

Top commit has no ACKs.

Tree-SHA512: 801e9a30ae1b0882ef45d5eb3a3cf80f3ace3b99db046069dbd95b6162119e977e3cf3134287d1ac5d09483906206acc71e1ac34d6b74dbc533d46aaf73f5cc2
sidhujag pushed a commit to syscoin-core/syscoin that referenced this pull request Nov 10, 2020
3333629 doc: Explain $LIB in LD_PRELOAD in gitian descriptors (MarcoFalke)
fab9850 scripted-diff: Avoid hardcoded libfaketime dir in gitian (MarcoFalke)

Pull request description:

  Without this gitian prints warnings for me:

  ```
  ERROR: ld.so: object '/usr/lib/x86_64-linux-gnu/faketime/libfaketime.so.1' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
  ```

  ```
  $ ls /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  ```

ACKs for top commit:
  laanwj:
    ACK 3333629

Tree-SHA512: 3e7c4471b69c2ae38c29d0cc0db8b9eae0912085299d7f5ac67eeb4b6a2fdc7eb23d806eeeae0b0c2da22d6d1ba82513cab23652876b97aada9928b2c7d38e7e
UdjinM6 pushed a commit to UdjinM6/dash that referenced this pull request Oct 23, 2021
3333629 doc: Explain $LIB in LD_PRELOAD in gitian descriptors (MarcoFalke)
fab9850 scripted-diff: Avoid hardcoded libfaketime dir in gitian (MarcoFalke)

Pull request description:

  Without this gitian prints warnings for me:

  ```
  ERROR: ld.so: object '/usr/lib/x86_64-linux-gnu/faketime/libfaketime.so.1' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
  ```

  ```
  $ ls /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  ```

ACKs for top commit:
  laanwj:
    ACK 3333629

Tree-SHA512: 3e7c4471b69c2ae38c29d0cc0db8b9eae0912085299d7f5ac67eeb4b6a2fdc7eb23d806eeeae0b0c2da22d6d1ba82513cab23652876b97aada9928b2c7d38e7e
UdjinM6 pushed a commit to UdjinM6/dash that referenced this pull request Oct 23, 2021
fae7530 scripted-diff: Set gitian arch back to amd64 (MarcoFalke)

Pull request description:

  This was required to allow gitian builds on non-amd64 architecture, however, it seems to break the current builds (with lxc), see bitcoin#17409 (comment)

  Also, the gititan builds wouldn't be deterministic across arches anyway, see bitcoin#17468

  So instead of wasting more time on this, revert the change and hope that guix allows to compile on non-amd64 architectures.

Top commit has no ACKs.

Tree-SHA512: 801e9a30ae1b0882ef45d5eb3a3cf80f3ace3b99db046069dbd95b6162119e977e3cf3134287d1ac5d09483906206acc71e1ac34d6b74dbc533d46aaf73f5cc2
UdjinM6 pushed a commit to UdjinM6/dash that referenced this pull request Dec 4, 2021
3333629 doc: Explain $LIB in LD_PRELOAD in gitian descriptors (MarcoFalke)
fab9850 scripted-diff: Avoid hardcoded libfaketime dir in gitian (MarcoFalke)

Pull request description:

  Without this gitian prints warnings for me:

  ```
  ERROR: ld.so: object '/usr/lib/x86_64-linux-gnu/faketime/libfaketime.so.1' from LD_PRELOAD cannot be preloaded (cannot open shared object file): ignored.
  ```

  ```
  $ ls /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  /usr/lib/aarch64-linux-gnu/faketime/libfaketime.so.1
  ```

ACKs for top commit:
  laanwj:
    ACK 3333629

Tree-SHA512: 3e7c4471b69c2ae38c29d0cc0db8b9eae0912085299d7f5ac67eeb4b6a2fdc7eb23d806eeeae0b0c2da22d6d1ba82513cab23652876b97aada9928b2c7d38e7e
UdjinM6 pushed a commit to UdjinM6/dash that referenced this pull request Dec 4, 2021
fae7530 scripted-diff: Set gitian arch back to amd64 (MarcoFalke)

Pull request description:

  This was required to allow gitian builds on non-amd64 architecture, however, it seems to break the current builds (with lxc), see bitcoin#17409 (comment)

  Also, the gititan builds wouldn't be deterministic across arches anyway, see bitcoin#17468

  So instead of wasting more time on this, revert the change and hope that guix allows to compile on non-amd64 architectures.

Top commit has no ACKs.

Tree-SHA512: 801e9a30ae1b0882ef45d5eb3a3cf80f3ace3b99db046069dbd95b6162119e977e3cf3134287d1ac5d09483906206acc71e1ac34d6b74dbc533d46aaf73f5cc2
@bitcoin bitcoin locked as resolved and limited conversation to collaborators Dec 16, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants