Plan to complete this failed release

Outline plan agreed at the standup meeting this morning.

• Perform v1.14.1 bug fix release process stopping just before publishing the Helm chart and GitHub release.
  - Release cert-manager v1.14.1 #6710
• Manually create a Helm chart archive from the v1.14.1 version of the code, but override version to be v1.14.0
• Manually sign that Helm chart,
• Publish that chart as v1.14.0.
• Manually generate the static yaml manifest from that chart
• Attach static yaml that to the draft v1.14.0 GitHub release.
• Publish the v1.14.0 GitHub release, with a release note describing what we've done and why.
• Resume and complete the v1.14.1 release process
• Including a release note explaining why we immediately released v1.14.1.
  - https://cert-manager.io/docs/releases/release-notes/release-notes-1.14#v1140

v1.14.0

• Bump Go patch version in release branch (if necessary).
  - go1.21.6: https://go.dev/doc/devel/release#go1.21.0
• Verify that test grid is green.
  - https://testgrid.k8s.io/cert-manager-periodics-release-1.14
  - Not green, but only failure is trivy-test-startupapicheck which has been fixed and we have run the check manually.
• Create website PR with release notes and updated installation versions.
  Add /hold until release is published.
  - Release notes for v1.14.0 website#1404
  - Release cert-manager 1.14 website#1400

⏸️ Wait for approval before continuing.
So that team can check release notes for any missing patches which we may have forgotten to backport.

• Send Slack message Releasing 1.14.0 🧵.
  - https://kubernetes.slack.com/archives/CDEQJ0Q8M/p1706713005073879
• Push vX.Y.Z tag.
  - https://github.com/cert-manager/cert-manager/releases/tag/v1.14.0
• Check that the build completed in the GCB Build History.
• Send Slack message cmrel makestage build logs: ....
  - https://console.cloud.google.com/cloud-build/builds/518d683a-1d8d-46e3-8b68-aea00e2499b8?project=cert-manager-release

⏸️ Wait for build to succeed.

• Create [Release $RELEASE_VERSION] Update cmd/cmctl's go.mod to $RELEASE_VERSION PR.
  - [Release v1.14.0] Update cmd/cmctl's go.mod to v1.14.0 #6690

⏸️ Wait for PR to be merged.

• Push cmd/ctl/$RELEASE_VERSION tag.
  - https://github.com/cert-manager/cert-manager/releases/tag/cmd%2Fctl%2Fv1.14.0
• Dry run cmrel publish --release-name "$RELEASE_VERSION".
• Send Slack message Follow the cmrel publish dry-run build: ....
  - https://console.cloud.google.com/cloud-build/builds/628d8fab-f1b6-41af-8877-dee67968259a?project=1021342095237
• Run cmrel publish --nomock --release-name "$RELEASE_VERSION".
• Send Slack message Follow the cmrel publish build: ....
  - https://console.cloud.google.com/cloud-build/builds/82c4362b-4d04-45f7-be3d-8c26983319a3?project=1021342095237

⏸️ Test installation of the Helm chart using the preview URL.

When I tested the Helm chart I discovered a major bug in the Helm chart, that had gone unnoticed in the beta release.
The plan is to merge a bug fix to the release branch and then manually recreate the Helm chart and the static manifests for the release, so that v1.14.0 release can be completed and published.
And to immediately create a v1.14.1 release which will contain the automatically built Helm chart.
You can read the discussion on Slack:

• https://kubernetes.slack.com/archives/CDEQJ0Q8M/p1706719876116399?thread_ts=1706713005.073879&cid=CDEQJ0Q8M
• cainjector leader election fails due to lease issues #6646
• Fix mistakenly changed cainjector image value #6692
• [release-1.14] Fix mistakenly changed cainjector image value #6693

We also discovered a backwards incompatible deletion of a metrics related Service resource:

• Clearify prometheus options and fix error in Helm chart #6694
• Fix backwards incompatible change: include a prometheus service by default #6699

• Publish the GitHub release.
  - https://github.com/cert-manager/cert-manager/releases/tag/v1.14.0
• Merge the pull request containing the Helm chart.
• Merge the Website PRs.
  - Release cert-manager 1.14 website#1400
• Send Slack message https://github.com/cert-manager/cert-manager/releases/tag/v1.0.0 🎉.
• Send an email to cert-manager-dev@googlegroups.com.
• Send a tweet on the cert-manager Twitter account.
• Send a toot from the cert-manager Mastodon account.

⏸️ Post release tasks

• Open a PR for a Homebrew formula update for cmctl.
• Open a PR against the Krew index.
• Create a new OLM package and publish to OperatorHub

TODO

• Write upgrade notes
• Update API documentation
• Update the CLI documentation
  • Release notes for v1.14.0 website#1404
• Update documentation for startupapicheck (if necessary).
  - [release-next] Also verify startupapicheck website#1394
• merge Redact the body of failed authentication requests #6683
• Document the liveness probe changes.
  - Update liveness probe docs website#1381
• Document the OtherName SANS feature
  - Add Certificate 'otherNames' SAN field description website#1378

v1.14.0-beta.0

• https://kubernetes.slack.com/archives/CDEQJ0Q8M/p1705932189217579
• https://github.com/cert-manager/cert-manager/releases/tag/v1.14.0-beta.0

v1.14.0-alpha.1

v1.14.0-alpha.0