Skip to content

Conversation

dongcarl
Copy link
Contributor

@dongcarl dongcarl commented Jun 10, 2019

Fixes regression introduced by #16141.

-BEGIN VERIFY SCRIPT-
sed -i 's#\$REFERENCE_DATE\\\\\\ \$REFERENCE_TIME#\$REFERENCE_DATETIME#g' contrib/gitian-descriptors/*
-END VERIFY SCRIPT-

Note that this could have been fixed by escaping properly, but using REFERENCE_DATETIME directly is simpler.

Future note: REFERENCE_{DATE{,DATETIME},TIME} is a bit ridiculous. At the very least gitian should use epoch, as it is the most parse-able, and preferably set SOURCE_DATE_EPOCH.

Fixes regression introduced by bitcoin#16141

-BEGIN VERIFY SCRIPT-
sed -i 's#\$REFERENCE_DATE\\\\\\ \$REFERENCE_TIME#\$REFERENCE_DATETIME#g' contrib/gitian-descriptors/*
-END VERIFY SCRIPT-
@maflcko
Copy link
Member

maflcko commented Jun 10, 2019

Can you explain how the regression was introduced?

@maflcko
Copy link
Member

maflcko commented Jun 10, 2019

Concept ACK

@fanquake
Copy link
Member

fanquake commented Jun 10, 2019

Concept ACK. Thanks.

@MarcoFalke It was my poor copy-paste, followed by some over-the-shoulder review.

Also a little related discussion in the #bitcoin-builds IRC channel.

edit: closing obviously accidental.

@fanquake fanquake closed this Jun 10, 2019
@fanquake fanquake reopened this Jun 10, 2019
@maflcko
Copy link
Member

maflcko commented Jun 10, 2019

Oh, let me rephrase: Why did REFERENCE_TIME && REFERENCE_DATE work previously, but does no longer?

@dongcarl
Copy link
Contributor Author

Oh, let me rephrase: Why did REFERENCE_TIME && REFERENCE_DATE work previously, but does no longer?

@MarcoFalke
https://gist.github.com/dongcarl/c1032fd0236efd62ebc369931c339577

@maflcko
Copy link
Member

maflcko commented Jun 10, 2019

Ah, so the issue could be fixed by escaping properly, but you decided to use _DATETIME directly. Sounds fair. Maybe mention that in the OP?

@dongcarl
Copy link
Contributor Author

Ah, so the issue could be fixed by escaping properly, but you decided to use _DATETIME directly. Sounds fair. Maybe mention that in the OP?

Done.

@sidhujag
Copy link

sidhujag commented Jun 10, 2019

Oh, let me rephrase: Why did REFERENCE_TIME && REFERENCE_DATE work previously, but does no longer?

I don't think it was actually being used, it was in a variable and then copied and pasted into the sed by #16141 which broke the build, but should have been escaped

@dongcarl
Copy link
Contributor Author

I don't think it was actually being used, it was in a variable and then copied and pasted into the sed by #16141 which broke the build, but should have been escaped

@sidhujag It was being used pre-16141, see: https://www.gnu.org/software/tar/manual/html_node/using-tar-options.html

@dongcarl
Copy link
Contributor Author

-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA256

ab4be93795002308de86cd02a699dd82e53bf4794b11095e651a57e7839d927a  bitcoin-0.18.99-aarch64-linux-gnu-debug.tar.gz
b9f3879221d42e6eb836a9de8641aee11359a7bf361020d668f3c5d511f37992  bitcoin-0.18.99-aarch64-linux-gnu.tar.gz
e627d30341d80eed6b4d7b74ff1b377e6cdccbe7c39173a0b21fc7bee89ac2f9  bitcoin-0.18.99-arm-linux-gnueabihf-debug.tar.gz
c9c0c1c798244770a0212dbd1dbfe53061f34539264933284ee027132e98d600  bitcoin-0.18.99-arm-linux-gnueabihf.tar.gz
abf7597ffe132a37f837bc5a239f0d7b2d712a9a85f5a752a5cace2181648338  bitcoin-0.18.99-i686-pc-linux-gnu-debug.tar.gz
76bedf0ad53e5e699f8bcc6ae00ccde20a927809a10d67682ddf61bb196fcf59  bitcoin-0.18.99-i686-pc-linux-gnu.tar.gz
3a1d541061568bee5282f918ef21e6ede14c9d8e4676110fa82bfda6608da729  bitcoin-0.18.99-riscv64-linux-gnu-debug.tar.gz
87e2fd3e11dbe5b9dfecb4a0ddb7e966af561be3f035360af2a8aefec010b746  bitcoin-0.18.99-riscv64-linux-gnu.tar.gz
4372290bfefa8b65904ba0a2df6efc3ad26f476da7f1c5367f7efee2592ea33d  bitcoin-0.18.99-x86_64-linux-gnu-debug.tar.gz
276f7039c7f0e8038373cf2a8ab9a52d237f076cfb243921f3d3b99ae870d48c  bitcoin-0.18.99-x86_64-linux-gnu.tar.gz
a09c58d9de205de9cb5f56ee7d02c524e275ed6d7e6aaecfb47c3718ac15295e  src/bitcoin-0.18.99.tar.gz
f6e72f3efcd2b97410f8fb9428c25e1fcdbfcae83dedb73a45a3e8ce0e087807  bitcoin-core-linux-0.19-res.yml
-----BEGIN PGP SIGNATURE-----

iQIzBAEBCAAdFiEECc3SW1JEo3Z49u6oDMUhUxl5kaUFAlz/ysgACgkQDMUhUxl5
kaVLhw/+Lssvjn2oDFR4hQeKfdMduIeytGf+LgPkqykxFXDcA2ujIoDf3gdTpBmz
SNJbgwh+ukigaaEHJ1FVfJUXnyQrgkhZJzF9Yvcx5BXMh2BjA/h33W6yEf2QJG7/
vWyQSZpRem2O8ynbZ6sxyeoUL3IpiMG7wdsJ53V5Z8pGN/ZVN3e93VOjJYLUwpuO
WPyrnbRwKAxRvuNdbQG8vks99U0JXXK8tD4+6fwfh4Po8B+BDyhMbTcClnsXyfVY
d7SEtAaARqKo/dmueWpBnx7BqmyAniYqVnAjbwh2u2S1ZnbOny0KwJM/61ro4p83
23Ci2VL7/QE2ew4LVFTs9OZezHhDe9cVP0xML/0BdXriknZYmdPXcLVO9NyMeWQJ
vCjjVu3hMefqWeCF6qsPrZ6ZyE8buoVkUAppxRvHrcemLorHxREFbPo85diHyd7c
w7KnjVZ4LjcsVGahWHeyk6ufOwtv/bQ828x9x8WMPZ/Jcn92hNafjgHWoYJAxXi5
wzKLFDiZO3qqlAKOzF74ALf3jGWmvKEMUgNkdMuVPS9bNPvVeoOYXWDIZ3XGc++o
mbwPWcuDhAW1ioVE5UMLzZWVYbC+06Ec6FEEux2fpdPv0atLefGyc+YLJ5E/zQUC
7KgG52HCwg2hDKSqZscbG2pbKoDNLI4R2sh91CZfKZeprO5xjDQ=
=ebkx
-----END PGP SIGNATURE-----

@DrahtBot
Copy link
Contributor

Gitian builds for commit 8a503a6 (master):

Gitian builds for commit c80f31d (master and this pull):

@maflcko maflcko merged commit 993aa41 into bitcoin:master Jun 11, 2019
maflcko pushed a commit that referenced this pull request Jun 11, 2019
993aa41 scripted-diff: gitian: Use REFERENCE_DATETIME directly. (Carl Dong)

Pull request description:

  Fixes regression introduced by #16141.

  ```
  -BEGIN VERIFY SCRIPT-
  sed -i 's#\$REFERENCE_DATE\\\\\\ \$REFERENCE_TIME#\$REFERENCE_DATETIME#g' contrib/gitian-descriptors/*
  -END VERIFY SCRIPT-
  ```

  -----

  Note that this could have been fixed by escaping properly, but using `REFERENCE_DATETIME` directly is simpler.

  Future note: `REFERENCE_{DATE{,DATETIME},TIME}` is a bit ridiculous. At the very _least_ gitian should use epoch, as it is the most parse-able, and preferably set SOURCE_DATE_EPOCH.

ACKs for commit 993aa4:

Tree-SHA512: 8457e5fffde66e1d2b846547b6807416b884c171f63569f76dfefd498d2a58ad6f9eb93931eb6cfc7ff38c6b460b0c488ca87d1a68bc630c48f365a74b6ee163
@laanwj
Copy link
Member

laanwj commented Jun 12, 2019

Thanks! POsthumous utACK 993aa41

@theuni
Copy link
Member

theuni commented Jun 13, 2019

Grr, sorry for missing this in review. Post-merge ACK 993aa41.

deadalnix pushed a commit to Bitcoin-ABC/bitcoin-abc that referenced this pull request Oct 27, 2020
…ptors

Summary:
bc8863b81922eb878519f328e9b0c7974aaa34ff depends: remove usage of TAR_OPTIONS (fanquake)
3ff1f2a319fc619954736d1e540ccbebc818ff11 build: remove export GZIP from gitian descriptors (fanquake)

Pull request description:

  The `GZIP` environment variable is [deprecated](https://www.gnu.org/software/gzip/manual/gzip.html#Environment), and everywhere that we invoke `gzip` we are already passing `-9n` directly, i.e:
  ```base
    find bitcoin-* | sort | tar --no-recursion --mode='u+rw,go+r-w,a+X' --owner=0 --group=0 -c -T - | gzip -9n > ../$SOURCEDIST
  ```

  ```bash
  GZIP="-9n" gzip -h
  gzip: warning: GZIP environment variable is deprecated; use an alias or script
  Usage: gzip [OPTION]... [FILE]...
  ```

Merge #16184: scripted-diff: gitian: Use REFERENCE_DATETIME directly.

Pull request description:

  Fixes regression introduced by #16141.

  ```
  -BEGIN VERIFY SCRIPT-
  sed -i 's#\$REFERENCE_DATE\\\\\\ \$REFERENCE_TIME#\${REFERENCE_DATETIME}#g' contrib/gitian-descriptors/*
  -END VERIFY SCRIPT-
  ```

  -----

  Note that this could have been fixed by escaping properly, but using `REFERENCE_DATETIME` directly is simpler.

  Future note: `REFERENCE_{DATE{,DATETIME},TIME}` is a bit ridiculous. At the very _least_ gitian should use epoch, as it is the most parse-able, and preferably set SOURCE_DATE_EPOCH.

Backport of Core [[bitcoin/bitcoin#16141 | PR16141]] and [[bitcoin/bitcoin#16184 | PR16184]] (to fix a regression in 16141)

Test Plan: Run all Gitian builds in CI

Reviewers: #bitcoin_abc, Fabien

Reviewed By: #bitcoin_abc, Fabien

Subscribers: Fabien

Differential Revision: https://reviews.bitcoinabc.org/D8136
random-zebra added a commit to random-zebra/PIVX that referenced this pull request Jul 19, 2021
…scriptors

a7dbb27 build: add missing attributes to Win installer (Fuzzbawls)
13d0b48 nsis: Don't duplicate URL string (Fuzzbawls)
56563e5 build: remove WINDOWS_BITS from build system (fanquake)
0cb37c8 nsis: Write to correct filename in first place (Carl Dong)
7aa2823 gitian: Put things in the right place to begin with (Carl Dong)
0dcf6e6 gitian: Eliminate rename dependency (Carl Dong)
ba579b9 gitian: Smaller diff with gitian-linux.yml (Carl Dong)
3b9d5e8 gitian: Fix README inclusion in archives (Carl Dong)
07c27d2 gitian: Use split-debug.sh for Win builds (Carl Dong)
9f19095 build: Add README.md to DIST target (MarcoFalke)
ce80c76 build: remove mingw linker workaround from win gitian descriptor (fanquake)
37441b0 scripted-diff: gitian: Use REFERENCE_DATETIME directly. (Fuzzbawls)
966fe9a depends: remove usage of TAR_OPTIONS (fanquake)
12fd641 build: remove export GZIP from gitian descriptors (fanquake)

Pull request description:

  This is a collection of upstream PRs focused on cleaning up the gitian descriptors (un-needed or duplicate code bits, standardizing similar actions across the descriptors, etc), and minor cleanups to supporting build system files.

  Included are the following upstream PRs:
  * bitcoin#16141
  * bitcoin#16184
  * bitcoin#16667
  * bitcoin#17097
  * bitcoin#17029
  * bitcoin#17308
  * bitcoin#17756
  * bitcoin#18059

ACKs for top commit:
  furszy:
    Tested ACK a7dbb27
  random-zebra:
    ACK a7dbb27 and merging...

Tree-SHA512: 409d4f51adfb1c90aa8bc572fe6610596dea1293a8ca795f9071bb88bd583bd7678359ee19e34440bb0d117075ebd27f9a622247ee3dfd0cd9088e6da306a4d5
UdjinM6 pushed a commit to UdjinM6/dash that referenced this pull request Oct 23, 2021
…rectly.

993aa41 scripted-diff: gitian: Use REFERENCE_DATETIME directly. (Carl Dong)

Pull request description:

  Fixes regression introduced by bitcoin#16141.

  ```
  -BEGIN VERIFY SCRIPT-
  sed -i 's#\$REFERENCE_DATE\\\\\\ \$REFERENCE_TIME#\$REFERENCE_DATETIME#g' contrib/gitian-descriptors/*
  -END VERIFY SCRIPT-
  ```

  -----

  Note that this could have been fixed by escaping properly, but using `REFERENCE_DATETIME` directly is simpler.

  Future note: `REFERENCE_{DATE{,DATETIME},TIME}` is a bit ridiculous. At the very _least_ gitian should use epoch, as it is the most parse-able, and preferably set SOURCE_DATE_EPOCH.

ACKs for commit 993aa4:

Tree-SHA512: 8457e5fffde66e1d2b846547b6807416b884c171f63569f76dfefd498d2a58ad6f9eb93931eb6cfc7ff38c6b460b0c488ca87d1a68bc630c48f365a74b6ee163
UdjinM6 pushed a commit to UdjinM6/dash that referenced this pull request Dec 4, 2021
…rectly.

993aa41 scripted-diff: gitian: Use REFERENCE_DATETIME directly. (Carl Dong)

Pull request description:

  Fixes regression introduced by bitcoin#16141.

  ```
  -BEGIN VERIFY SCRIPT-
  sed -i 's#\$REFERENCE_DATE\\\\\\ \$REFERENCE_TIME#\$REFERENCE_DATETIME#g' contrib/gitian-descriptors/*
  -END VERIFY SCRIPT-
  ```

  -----

  Note that this could have been fixed by escaping properly, but using `REFERENCE_DATETIME` directly is simpler.

  Future note: `REFERENCE_{DATE{,DATETIME},TIME}` is a bit ridiculous. At the very _least_ gitian should use epoch, as it is the most parse-able, and preferably set SOURCE_DATE_EPOCH.

ACKs for commit 993aa4:

Tree-SHA512: 8457e5fffde66e1d2b846547b6807416b884c171f63569f76dfefd498d2a58ad6f9eb93931eb6cfc7ff38c6b460b0c488ca87d1a68bc630c48f365a74b6ee163
@bitcoin bitcoin locked as resolved and limited conversation to collaborators Dec 16, 2021
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

7 participants