Skip to content

Conversation

brody4hire
Copy link
Contributor

@brody4hire brody4hire commented Aug 28, 2024

UPDATED: update to do cross test over multiple targets

Leaving out the following targets, need to use portable-atomic to get CA test working for these (already got these working in my personal branch):

  • arm-linux-androideabi
  • armv5te-unknown-linux-gnueabi

Another nice target for no-std, if we can work around issue with no atomic refs for issue #2068: thumbv6m-none-eabi

will likely defer these missing targets for issue #2100 (time permitting, of course)


NOTES - UPDATED:

I think this should only be seen as a very small, slightly-incremental step towards testing on more and more embedded, "no-std" target environments.

Building & testing with cross-rs for many embedded targets seems to be limited by the following issues:

  • supported Rust toolchain has a very limited number of Tier 2 / Tier 3 targets (I am not sure if it has any tier 3 targets builit-in)
  • limited number of targets supported by cross docker images (there may be some others out there in the wild)
  • It looks like aws-lc-rs / aws-lc-sys requires some bindgen setup to build for most of the targets other than the normal Windows / /macOS / normal headless Linux targets. And it looks to me like even if we would not enable the aws_lc_rs feature, cross test would still include aws-lc-rs / aws-lc-sys due to this dev-depenencies entry needed for rustls/examples/internal/test_ca.rs:
    • rcgen = { version = "0.13", default-features = false, features = ["aws_lc_rs", "pem"] }

SOME HELPFUL RESOURCES:

@brody4hire brody4hire force-pushed the cross-testing-updates branch from af86354 to 684e42b Compare August 28, 2024 09:00
@brody4hire brody4hire marked this pull request as ready for review August 28, 2024 09:05
@brody4hire brody4hire marked this pull request as draft August 28, 2024 09:24
Copy link

codecov bot commented Aug 28, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 94.76%. Comparing base (94db910) to head (a431772).
Report is 1 commits behind head on main.

Additional details and impacted files
@@           Coverage Diff           @@
##             main    #2095   +/-   ##
=======================================
  Coverage   94.76%   94.76%           
=======================================
  Files         102      102           
  Lines       23514    23514           
=======================================
  Hits        22283    22283           
  Misses       1231     1231           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@brody4hire brody4hire changed the title ci: cross-testing updates [DRAFT] ci: cross-target testing updates - DRAFT WIP Aug 28, 2024
@brody4hire brody4hire changed the title [DRAFT] ci: cross-target testing updates - DRAFT WIP [DRAFT] ci: cross-target build & test updates - DRAFT WIP Aug 28, 2024
@brody4hire brody4hire force-pushed the cross-testing-updates branch from a5b14bc to dc66dad Compare August 28, 2024 23:47
@brody4hire brody4hire changed the title [DRAFT] ci: cross-target build & test updates - DRAFT WIP ci: cross-target build & test updates Aug 29, 2024
@brody4hire brody4hire marked this pull request as ready for review August 29, 2024 06:59
@brody4hire
Copy link
Contributor Author

Shoud be ready now - review comments should be resolved

Copy link
Member

@djc djc left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM, thanks!

Given that all the intermediate commits here just resolve TODOs introduced in the first commit, I don't think there's value in keeping them and we should just squash this. @brodycj can you do that?

Copy link

rustls-benchmarking bot commented Aug 29, 2024

Benchmark results

Instruction counts

Significant differences

There are no significant instruction count differences

Other differences

Click to expand
Scenario Baseline Candidate Diff Threshold
handshake_session_id_aws_lc_rs_1.2_rsa_aes_server 3923958 3977485 53527 (1.36%) 4.93%
handshake_tickets_aws_lc_rs_1.2_rsa_aes_server 5120388 5176217 55829 (1.09%) 4.40%
handshake_no_resume_aws_lc_rs_1.3_rsa_aes_server 13779194 13844172 64978 (0.47%) 0.91%
handshake_no_resume_aws_lc_rs_1.2_rsa_aes_server 13453578 13408852 -44726 (-0.33%) 1.30%
handshake_no_resume_aws_lc_rs_1.3_rsa_chacha_server 13822242 13864155 41913 (0.30%) 0.84%
handshake_no_resume_ring_1.3_ecdsap256_chacha_server 2135848 2140671 4823 (0.23%) 0.76%
handshake_session_id_aws_lc_rs_1.3_rsa_chacha_server 32975648 32902885 -72763 (-0.22%) 0.68%
transfer_no_resume_aws_lc_rs_1.2_rsa_aes_server 46379666 46456602 76936 (0.17%) 0.31%
handshake_tickets_aws_lc_rs_1.3_rsa_chacha_server 34804344 34746855 -57489 (-0.17%) 0.63%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_client 8875527 8889106 13579 (0.15%) 0.79%
handshake_tickets_aws_lc_rs_1.3_rsa_aes_server 34807293 34759815 -47478 (-0.14%) 0.44%
handshake_session_id_aws_lc_rs_1.3_rsa_aes_server 33035554 32994137 -41417 (-0.13%) 0.76%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_client 3382116 3384707 2591 (0.08%) 0.26%
transfer_no_resume_aws_lc_rs_1.3_rsa_aes_server 46498649 46466737 -31912 (-0.07%) 0.41%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_aes_client 30752420 30733048 -19372 (-0.06%) 0.33%
handshake_no_resume_ring_1.3_ecdsap256_chacha_client 3916084 3918506 2422 (0.06%) 0.38%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_aes_client 8884203 8889341 5138 (0.06%) 1.29%
handshake_no_resume_ring_1.3_ecdsap256_aes_client 3914699 3912685 -2014 (-0.05%) 0.44%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_aes_client 58219079 58247075 27996 (0.05%) 0.23%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_aes_client 31133175 31119720 -13455 (-0.04%) 0.45%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_chacha_client 31200077 31187854 -12223 (-0.04%) 0.65%
handshake_session_id_ring_1.2_rsa_aes_server 4266233 4267092 859 (0.02%) 0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_aes_client 3381964 3381324 -640 (-0.02%) 0.22%
handshake_session_id_ring_1.3_ecdsap256_chacha_client 41876849 41883277 6428 (0.02%) 0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_chacha_client 31171377 31166646 -4731 (-0.02%) 0.20%
handshake_no_resume_aws_lc_rs_1.3_rsa_chacha_client 2235163 2235475 312 (0.01%) 0.20%
handshake_tickets_aws_lc_rs_1.2_rsa_aes_client 4442994 4442383 -611 (-0.01%) 0.20%
handshake_no_resume_ring_1.3_rsa_chacha_client 2957216 2957580 364 (0.01%) 0.20%
handshake_session_id_aws_lc_rs_1.2_rsa_aes_client 4026626 4026149 -477 (-0.01%) 0.20%
handshake_tickets_ring_1.3_ecdsap256_chacha_server 43958577 43953433 -5144 (-0.01%) 0.20%
handshake_no_resume_aws_lc_rs_1.2_rsa_aes_client 2016931 2017153 222 (0.01%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_client 92724726 92714589 -10137 (-0.01%) 0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_aes_client 31119732 31122521 2789 (0.01%) 0.20%
handshake_no_resume_ring_1.2_rsa_aes_client 2853577 2853832 255 (0.01%) 0.20%
transfer_no_resume_ring_1.3_ecdsap256_aes_server 46455226 46451182 -4044 (-0.01%) 0.20%
handshake_no_resume_ring_1.3_rsa_aes_client 2951353 2951588 235 (0.01%) 0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_aes_server 4390150 4389885 -265 (-0.01%) 0.20%
handshake_session_id_ring_1.2_rsa_aes_client 4284818 4284564 -254 (-0.01%) 0.20%
handshake_no_resume_ring_1.3_ecdsap256_aes_server 2134318 2134205 -113 (-0.01%) 0.79%
transfer_no_resume_ring_1.3_ecdsap256_chacha_client 92661607 92666332 4725 (0.01%) 0.20%
handshake_tickets_ring_1.2_rsa_aes_client 4558012 4557782 -230 (-0.01%) 0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_server 1919916 1919822 -94 (-0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_rsa_chacha_server 80606381 80610200 3819 (0.00%) 0.20%
handshake_tickets_ring_1.2_rsa_aes_server 4703322 4703118 -204 (-0.00%) 0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_chacha_client 30720372 30721655 1283 (0.00%) 0.40%
transfer_no_resume_ring_1.3_ecdsap256_aes_client 58335701 58333352 -2349 (-0.00%) 0.20%
handshake_no_resume_ring_1.3_rsa_chacha_server 12185802 12186278 476 (0.00%) 0.20%
handshake_no_resume_ring_1.3_rsa_aes_server 12179511 12179972 461 (0.00%) 0.20%
handshake_tickets_ring_1.3_ecdsap256_aes_client 42410497 42412080 1583 (0.00%) 0.20%
handshake_no_resume_ring_1.2_rsa_aes_server 11991846 11992227 381 (0.00%) 0.20%
handshake_no_resume_ring_1.3_ecdsap384_aes_server 13742051 13741623 -428 (-0.00%) 0.20%
handshake_session_id_ring_1.3_rsa_chacha_client 41893305 41894523 1218 (0.00%) 0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_chacha_server 32960820 32961751 931 (0.00%) 0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_aes_client 30740666 30741480 814 (0.00%) 0.20%
handshake_no_resume_aws_lc_rs_1.3_rsa_aes_client 2228103 2228045 -58 (-0.00%) 0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_chacha_server 32960194 32961027 833 (0.00%) 0.20%
handshake_session_id_ring_1.3_ecdsap384_chacha_server 43365130 43366114 984 (0.00%) 0.20%
handshake_session_id_ring_1.3_ecdsap384_chacha_client 41876421 41875601 -820 (-0.00%) 0.20%
handshake_tickets_ring_1.3_ecdsap384_aes_client 42406067 42405260 -807 (-0.00%) 0.20%
handshake_session_id_ring_1.3_ecdsap384_aes_client 41956109 41956898 789 (0.00%) 0.20%
handshake_tickets_ring_1.3_rsa_chacha_server 43955460 43954706 -754 (-0.00%) 0.20%
handshake_tickets_ring_1.3_ecdsap384_chacha_server 43958264 43958983 719 (0.00%) 0.20%
handshake_no_resume_ring_1.3_ecdsap384_chacha_client 35475500 35476066 566 (0.00%) 0.20%
handshake_tickets_ring_1.3_ecdsap384_chacha_client 42340371 42339704 -667 (-0.00%) 0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_aes_server 34768090 34767565 -525 (-0.00%) 0.20%
handshake_tickets_ring_1.3_rsa_aes_server 44036231 44035577 -654 (-0.00%) 0.20%
handshake_tickets_ring_1.3_ecdsap256_aes_server 44038803 44039432 629 (0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_client 92704506 92703198 -1308 (-0.00%) 0.20%
handshake_tickets_ring_1.3_ecdsap256_chacha_client 42342561 42343147 586 (0.00%) 0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_aes_server 33001583 33001155 -428 (-0.00%) 0.20%
handshake_tickets_aws_lc_rs_1.3_rsa_chacha_client 31193108 31192710 -398 (-0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_aes_client 58244904 58245594 690 (0.00%) 0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_chacha_client 30717041 30716708 -333 (-0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.2_rsa_aes_client 68665907 68666637 730 (0.00%) 0.20%
handshake_session_id_ring_1.3_ecdsap256_chacha_server 43365573 43365123 -450 (-0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_aes_server 46428501 46428979 478 (0.00%) 0.20%
handshake_no_resume_ring_1.3_ecdsap384_aes_client 35473487 35473778 291 (0.00%) 0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_aes_server 34766822 34766546 -276 (-0.00%) 0.20%
handshake_session_id_ring_1.3_ecdsap256_aes_client 41960464 41960791 327 (0.00%) 0.20%
transfer_no_resume_ring_1.3_ecdsap384_aes_server 46454467 46454820 353 (0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_chacha_server 80606355 80606949 594 (0.00%) 0.20%
transfer_no_resume_ring_1.3_ecdsap256_chacha_server 80504616 80504028 -588 (-0.00%) 0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_chacha_server 34787172 34787421 249 (0.00%) 0.20%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_aes_server 33001648 33001863 215 (0.00%) 0.20%
handshake_no_resume_ring_1.3_ecdsap384_chacha_server 13744168 13744256 88 (0.00%) 0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_aes_server 1916664 1916652 -12 (-0.00%) 0.20%
handshake_session_id_ring_1.3_ecdsap384_aes_server 43462679 43462938 259 (0.00%) 0.20%
handshake_tickets_ring_1.3_rsa_aes_client 42422752 42422985 233 (0.00%) 0.20%
handshake_session_id_ring_1.3_ecdsap256_aes_server 43463022 43463257 235 (0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_rsa_chacha_client 92705886 92705408 -478 (-0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_rsa_aes_client 58247680 58247936 256 (0.00%) 0.20%
handshake_session_id_aws_lc_rs_1.3_rsa_aes_client 30759897 30760029 132 (0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_aes_server 46427300 46427495 195 (0.00%) 0.20%
handshake_tickets_aws_lc_rs_1.3_rsa_aes_client 31145722 31145832 110 (0.00%) 0.20%
transfer_no_resume_ring_1.3_ecdsap384_chacha_server 80507411 80507651 240 (0.00%) 0.20%
handshake_session_id_ring_1.3_rsa_aes_server 43460537 43460412 -125 (-0.00%) 0.20%
transfer_no_resume_ring_1.3_rsa_aes_client 58331834 58331999 165 (0.00%) 0.20%
transfer_no_resume_ring_1.3_rsa_chacha_client 92664437 92664699 262 (0.00%) 0.20%
handshake_session_id_ring_1.3_rsa_aes_client 41974380 41974480 100 (0.00%) 0.20%
transfer_no_resume_ring_1.3_ecdsap384_chacha_client 92660591 92660407 -184 (-0.00%) 0.20%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_server 80608113 80607969 -144 (-0.00%) 0.20%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_chacha_server 34786970 34787032 62 (0.00%) 0.20%
transfer_no_resume_ring_1.3_rsa_aes_server 46462861 46462932 71 (0.00%) 0.20%
handshake_tickets_ring_1.3_rsa_chacha_client 42358521 42358584 63 (0.00%) 0.20%
handshake_session_id_ring_1.3_rsa_chacha_server 43361394 43361350 -44 (-0.00%) 0.20%
handshake_tickets_ring_1.3_ecdsap384_aes_server 44038652 44038683 31 (0.00%) 0.20%
transfer_no_resume_ring_1.3_ecdsap384_aes_client 58328321 58328281 -40 (-0.00%) 0.20%
transfer_no_resume_ring_1.3_rsa_chacha_server 80515707 80515756 49 (0.00%) 0.20%
handshake_session_id_aws_lc_rs_1.3_rsa_chacha_client 30734310 30734326 16 (0.00%) 0.20%
transfer_no_resume_ring_1.2_rsa_aes_server 46368165 46368142 -23 (-0.00%) 0.20%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_chacha_server 4393243 4393241 -2 (-0.00%) 0.20%
transfer_no_resume_ring_1.2_rsa_aes_client 58209001 58208991 -10 (-0.00%) 0.20%

Wall-time

Significant differences

There are no significant wall-time differences

Other differences

Click to expand
Scenario Baseline Candidate Diff Threshold
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_aes 4.51 ms 4.46 ms -0.04 ms (-0.98%) 6.94%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_aes 5.23 ms 5.18 ms -0.04 ms (-0.79%) 6.11%
transfer_no_resume_aws_lc_rs_1.2_rsa_aes 5.47 ms 5.42 ms -0.04 ms (-0.79%) 4.57%
transfer_no_resume_aws_lc_rs_1.3_rsa_aes 5.47 ms 5.43 ms -0.04 ms (-0.69%) 4.48%
transfer_no_resume_ring_1.3_ecdsap256_aes 6.35 ms 6.30 ms -0.04 ms (-0.67%) 4.57%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_aes 484.06 µs 480.88 µs -3.18 µs (-0.66%) 3.59%
transfer_no_resume_ring_1.3_rsa_aes 6.84 ms 6.79 ms -0.04 ms (-0.65%) 4.34%
transfer_no_resume_ring_1.2_rsa_aes 6.73 ms 6.70 ms -0.04 ms (-0.56%) 3.51%
handshake_no_resume_aws_lc_rs_1.3_ecdsap256_chacha 482.06 µs 479.64 µs -2.42 µs (-0.50%) 3.78%
transfer_no_resume_ring_1.3_ecdsap384_aes 9.44 ms 9.40 ms -0.04 ms (-0.44%) 2.81%
transfer_no_resume_ring_1.3_rsa_chacha 13.49 ms 13.43 ms -0.05 ms (-0.40%) 2.02%
handshake_no_resume_ring_1.3_ecdsap256_chacha 506.22 µs 504.21 µs -2.01 µs (-0.40%) 2.99%
handshake_no_resume_ring_1.3_rsa_aes 1.00 ms 1.00 ms -0.00 ms (-0.37%) 1.73%
transfer_no_resume_ring_1.3_ecdsap256_chacha 12.98 ms 12.94 ms -0.05 ms (-0.35%) 2.08%
transfer_no_resume_aws_lc_rs_1.3_ecdsap384_chacha 13.69 ms 13.65 ms -0.04 ms (-0.31%) 1.93%
transfer_no_resume_aws_lc_rs_1.3_ecdsap256_chacha 12.97 ms 12.93 ms -0.04 ms (-0.31%) 2.27%
handshake_no_resume_ring_1.3_ecdsap256_aes 508.95 µs 507.37 µs -1.59 µs (-0.31%) 3.61%
transfer_no_resume_aws_lc_rs_1.3_rsa_chacha 13.94 ms 13.89 ms -0.04 ms (-0.30%) 1.97%
transfer_no_resume_ring_1.3_ecdsap384_chacha 16.08 ms 16.03 ms -0.05 ms (-0.29%) 1.51%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_aes 5.41 ms 5.40 ms -0.01 ms (-0.25%) 1.65%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_aes 1.20 ms 1.20 ms -0.00 ms (-0.25%) 1.12%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_aes 6.13 ms 6.11 ms -0.01 ms (-0.24%) 1.45%
handshake_no_resume_ring_1.2_rsa_aes 979.50 µs 977.17 µs -2.33 µs (-0.24%) 1.48%
handshake_no_resume_ring_1.3_rsa_chacha 1.00 ms 1.00 ms -0.00 ms (-0.21%) 1.31%
handshake_session_id_aws_lc_rs_1.3_ecdsap384_chacha 6.11 ms 6.10 ms -0.01 ms (-0.20%) 1.17%
handshake_session_id_aws_lc_rs_1.3_ecdsap256_chacha 5.39 ms 5.38 ms -0.01 ms (-0.18%) 1.20%
handshake_tickets_ring_1.2_rsa_aes 1.66 ms 1.66 ms -0.00 ms (-0.17%) 1.78%
handshake_no_resume_aws_lc_rs_1.3_ecdsap384_chacha 1.20 ms 1.20 ms -0.00 ms (-0.17%) 1.04%
handshake_no_resume_aws_lc_rs_1.3_rsa_chacha 1.44 ms 1.43 ms -0.00 ms (-0.16%) 6.20%
handshake_no_resume_aws_lc_rs_1.2_rsa_aes 1.39 ms 1.39 ms -0.00 ms (-0.15%) 6.06%
handshake_no_resume_aws_lc_rs_1.3_rsa_aes 1.44 ms 1.44 ms -0.00 ms (-0.14%) 5.72%
handshake_no_resume_ring_1.3_ecdsap384_aes 3.60 ms 3.60 ms -0.00 ms (-0.13%) 1.00%
handshake_session_id_aws_lc_rs_1.3_rsa_aes 6.39 ms 6.38 ms -0.01 ms (-0.12%) 1.35%
handshake_session_id_ring_1.3_ecdsap256_chacha 6.72 ms 6.71 ms -0.01 ms (-0.11%) 1.17%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_aes 5.52 ms 5.52 ms -0.01 ms (-0.10%) 1.49%
handshake_session_id_aws_lc_rs_1.2_rsa_aes 2.11 ms 2.11 ms -0.00 ms (-0.10%) 2.61%
handshake_session_id_ring_1.3_ecdsap384_chacha 9.80 ms 9.79 ms -0.01 ms (-0.10%) 1.10%
handshake_session_id_ring_1.2_rsa_aes 1.58 ms 1.58 ms -0.00 ms (-0.09%) 1.02%
handshake_tickets_ring_1.3_ecdsap256_aes 6.81 ms 6.81 ms -0.01 ms (-0.09%) 1.39%
handshake_no_resume_ring_1.3_ecdsap384_chacha 3.60 ms 3.60 ms -0.00 ms (-0.09%) 1.00%
handshake_session_id_ring_1.3_ecdsap256_aes 6.76 ms 6.75 ms -0.01 ms (-0.08%) 1.60%
handshake_tickets_ring_1.3_rsa_aes 7.30 ms 7.30 ms -0.01 ms (-0.08%) 1.12%
handshake_session_id_ring_1.3_rsa_chacha 7.20 ms 7.20 ms -0.01 ms (-0.08%) 1.48%
handshake_tickets_ring_1.3_ecdsap256_chacha 6.77 ms 6.76 ms -0.01 ms (-0.08%) 1.22%
handshake_tickets_aws_lc_rs_1.2_rsa_aes 2.31 ms 2.31 ms 0.00 ms (0.06%) 1.85%
handshake_tickets_ring_1.3_rsa_chacha 7.26 ms 7.25 ms -0.00 ms (-0.06%) 1.31%
handshake_tickets_aws_lc_rs_1.3_rsa_aes 6.50 ms 6.50 ms -0.00 ms (-0.06%) 1.53%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_chacha 6.24 ms 6.24 ms -0.00 ms (-0.05%) 1.00%
handshake_tickets_aws_lc_rs_1.3_ecdsap384_aes 6.24 ms 6.24 ms -0.00 ms (-0.05%) 1.24%
handshake_session_id_ring_1.3_rsa_aes 7.25 ms 7.25 ms -0.00 ms (-0.04%) 1.52%
handshake_tickets_aws_lc_rs_1.3_ecdsap256_chacha 5.53 ms 5.53 ms -0.00 ms (-0.04%) 1.11%
handshake_tickets_aws_lc_rs_1.3_rsa_chacha 6.50 ms 6.50 ms -0.00 ms (-0.04%) 1.01%
handshake_session_id_ring_1.3_ecdsap384_aes 9.84 ms 9.83 ms -0.00 ms (-0.03%) 1.00%
handshake_tickets_ring_1.3_ecdsap384_chacha 9.85 ms 9.85 ms -0.00 ms (-0.03%) 1.00%
handshake_session_id_aws_lc_rs_1.3_rsa_chacha 6.36 ms 6.36 ms -0.00 ms (-0.02%) 1.00%
handshake_tickets_ring_1.3_ecdsap384_aes 9.90 ms 9.89 ms -0.00 ms (-0.02%) 1.00%

Additional information

Historical results

Checkout details:

Copy link
Member

@cpu cpu left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks! This is cool :-)

It seems like the increase in CI runtime is reasonable (all of the new jobs are still faster than the coverage task).

@brody4hire brody4hire force-pushed the cross-testing-updates branch from f882e6b to cf48253 Compare August 29, 2024 15:01
@djc djc enabled auto-merge August 29, 2024 15:09
@brody4hire
Copy link
Contributor Author

I just rebased with recent updates from main.

Yes this will definitely take some more CI resources, in the form of more parallel jobs. I did keep what I think are the most important cross targets toward the top of the matrix ... and did add some comments to help people understand what I think is the relative importance of these cross targets.

Assuming that we can start adding more and more embedded targets, as discussed in #2100, I would totally favor removing say a couple of the targets I added to reduce the chance of waiting for CI jobs stuck queued.

Thanks!

auto-merge was automatically disabled August 29, 2024 21:21

Head branch was pushed to by a user without write access

@brody4hire brody4hire force-pushed the cross-testing-updates branch from cf48253 to 58dfc6a Compare August 29, 2024 21:21
@djc djc enabled auto-merge August 29, 2024 21:29
@brody4hire
Copy link
Contributor Author

Seems to be held up by "Check cross compilation targets" job, which I had renamed in this PR..

auto-merge was automatically disabled August 30, 2024 07:35

Head branch was pushed to by a user without write access

@brody4hire brody4hire marked this pull request as draft August 30, 2024 07:36
@brody4hire brody4hire force-pushed the cross-testing-updates branch from 3f30ac0 to a431772 Compare August 30, 2024 08:20
@brody4hire brody4hire marked this pull request as ready for review August 30, 2024 08:20
@brody4hire
Copy link
Contributor Author

I have pushed some updates to add a few more targets & keep the same cross: job key in build.yaml, hopefully won't be blocked for so long by GitHub again. I have added & updated some comments, think people should feel free to update or even remove some of the targets I added if this takes too heavy GitHub CI resources. Apologies for all of the churn in this PR.

@djc
Copy link
Member

djc commented Aug 30, 2024

I have removed the old job name from the merge queue checks. Right now the merge queue is not gating on any of the cross-compilation jobs. Not sure what we want to do with that going forward?

@djc djc added this pull request to the merge queue Aug 30, 2024
Merged via the queue into rustls:main with commit 213f39f Aug 30, 2024
31 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants