Should target staging considering the amount of rebuilds

Yes I'll point it there soon, but I still have a few TODOs.

Unfortunately, this does not fix the sui problem. I debugged it by adding "set -x" on the cargo-vendor-dir command:

+++ ln -s /nix/store/a3hq2s4jsrjlk5flzm6bwibc63habljn-tokio-io-timeout-1.2.0 /nix/store/hrw1qsrqh3mfasw72hlapd0lnkd303a1-cargo-vendor-dir/tokio-io-timeout-1.2.0
+++ '[' -e /nix/store/a3hq2s4jsrjlk5flzm6bwibc63habljn-tokio-io-timeout-1.2.0/.cargo-config ']'
+++ for crate in /nix/store/w4njzhl6c2ap84kd6v9c09g3vb3jwpwr-Inflector-0.11.4 /nix/store/61myz4b2wg5bcwrmcgqir98p1kjh0yjf-addchain-0.2.0 /nix/store/dfdynm0vivlyw1cyxabpnkmk0gbfvn6v-add>
++++ basename /nix/store/pbkdlfdqi3gzigz428kbay8fcwvv6z7z-tokio-macros-2.5.0
++++ cut -c 34-
+++ ln -s /nix/store/pbkdlfdqi3gzigz428kbay8fcwvv6z7z-tokio-macros-2.5.0 /nix/store/hrw1qsrqh3mfasw72hlapd0lnkd303a1-cargo-vendor-dir/tokio-macros-2.5.0
+++ '[' -e /nix/store/pbkdlfdqi3gzigz428kbay8fcwvv6z7z-tokio-macros-2.5.0/.cargo-config ']'
+++ for crate in /nix/store/w4njzhl6c2ap84kd6v9c09g3vb3jwpwr-Inflector-0.11.4 /nix/store/61myz4b2wg5bcwrmcgqir98p1kjh0yjf-addchain-0.2.0 /nix/store/dfdynm0vivlyw1cyxabpnkmk0gbfvn6v-add>
++++ basename /nix/store/rk97wgy1a6m8x9z5k05dzw1fmhbqb3wx-tokio-macros-2.5.0
++++ cut -c 34-
+++ ln -s /nix/store/rk97wgy1a6m8x9z5k05dzw1fmhbqb3wx-tokio-macros-2.5.0 /nix/store/hrw1qsrqh3mfasw72hlapd0lnkd303a1-cargo-vendor-dir/tokio-macros-2.5.0
ln: failed to create symbolic link '/nix/store/hrw1qsrqh3mfasw72hlapd0lnkd303a1-cargo-vendor-dir/tokio-macros-2.5.0/rk97wgy1a6m8x9z5k05dzw1fmhbqb3wx-tokio-macros-2.5.0': Permission den>
+ exitHandler
+ exitCode=1
+ set +e
+ '[' -n '' ']'
+ ((  1 != 0  ))
+ runHook failureHook
+ local hookName=failureHook

The problem is triggered by 2 versions of the tokio-macros used by sui

You are using cargoLock.lockFile (backend: importCargoLock)
instead of cargoHash + useFetchCargoVendor = true (backend: fetchCargoVendor).

In this PR I only modified fetchCargoVendor.

I was able to build sui with this:
(do note that you need like over 100GiB of storage to build it...)

{
  lib,
  rustPlatform,
  fetchFromGitHub,
  pkg-config,
  zstd,
}:

rustPlatform.buildRustPackage (finalAttrs: {
  pname = "sui";
  version = "1.43.1";

  src = fetchFromGitHub {
    owner = "MystenLabs";
    repo = "sui";
    tag = "mainnet-v${finalAttrs.version}";
    hash = "sha256-mNljh3HupusGmfT3pXtjqUp7OZHhyWd6jNiFiKlSYpk=";
  };

  useFetchCargoVendor = true;
  cargoHash = "sha256-ckotvpQw3WfvJ2YXR/XKT7LamGj7kLtGwMR/qrXpmYc=";

  nativeBuildInputs = [
    pkg-config
    rustPlatform.bindgenHook
  ];

  buildInputs = [
    zstd
  ];

  env = {
    # if this is not set the build will try to invoke git to get the rev
    GIT_REVISION = "nixpkgs@${finalAttrs.version}";
    ZSTD_SYS_USE_PKG_CONFIG = true;
  };

  # the build takes up more than 60G of space even without the checks
  # my system ran out of space (150G) when having tests enabled
  doCheck = false;

})

Ahh, I see. I used useFetchCargoVendor = true and cargoLock.
Works now, thanks a lot 👍🏽

I tested this patch today on a project where it was running into the failed to create symbolic link error and it fixed it successfully.

EDIT: Though I'm now running into an error like this:

 error: failed to select a version for the requirement `cfg-if = "^1.0"` (locked to 1.0.0)

Not sure if this is related to the fetching or not

If this is a public project, please share a link to it.
If not, please share some more details/logs.

@TomaSajt My issue seems to be unrelated. Please don't feel blocked by it

Packaging Kiesel seems to be blocked on this.

Kiesel uses an in-tree Rust crate for some FFI, which depends partly on crates.io versions, partly on git versions to get the latest fixes. A lot of transitive deps are duplicated in turn, too.
Just replacing them with crates.io is not practical, as the rest of the project also has the exact git commits pinned.
(Current attempt is at MultisampledNight@ec0f801 if anybody is curious, very half-baked.)

Pushed a change factoring out some stuff to slightly de-clutter the create_vendor function and hopefully made some of the logic more readable.
Diff