Skip to content

Conversation

juliev0
Copy link
Contributor

@juliev0 juliev0 commented Oct 8, 2024

The Open Source Project github.com/numaproj/numaplane is a Control Plane for Numaflow Pipelines. PipelineRollout is a CR which wraps around Numaflow Pipeline to manage its state.

Numaplane has a strategy for safely updating a Numaflow Pipeline to eliminate data loss by initially pausing it.

The "allow-data-loss" Action is a solution to the problem that a Pipeline may get stuck in "pausing" for whatever reason, so the user needs a way to stop the pausing and complete the update. This is done through the use of an annotation on the object.

Checklist:

  • Either (a) I've created an enhancement proposal and discussed it with the community, (b) this is a bug fix, or (c) this does not need to be in the release notes.
  • The title of the PR states what changed and the related issues number (used for the release note).
  • The title of the PR conforms to the Toolchain Guide
  • I've included "Closes [ISSUE #]" or "Fixes [ISSUE #]" in the description to automatically close the associated issue.
  • I've updated both the CLI and UI to expose my feature, or I plan to submit a second PR with them.
  • Does this PR require documentation updates?
  • I've updated documentation as required by this PR.
  • I have signed off all my commits as required by DCO
  • I have written unit and/or e2e tests for my change. PRs without these are unlikely to be merged.
  • My build is green (troubleshooting builds).
  • My new feature complies with the feature status guidelines.
  • I have added a brief description of why this PR is necessary and/or what this PR solves.
  • Optional. My organization is added to USERS.md.
  • Optional. For bug fixes, I've indicated what older releases this fix should be cherry-picked into (this may or may not happen depending on risk/complexity).

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>
Copy link

bunnyshell bot commented Oct 8, 2024

❌ Preview Environment deleted from Bunnyshell

Available commands (reply to this comment):

  • 🚀 /bns:deploy to deploy the environment

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>
Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>
Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>
Copy link

codecov bot commented Oct 9, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 55.96%. Comparing base (6002c7d) to head (8198cca).
Report is 398 commits behind head on master.

Additional details and impacted files
@@            Coverage Diff             @@
##           master   #20298      +/-   ##
==========================================
+ Coverage   55.92%   55.96%   +0.04%     
==========================================
  Files         322      322              
  Lines       44673    44701      +28     
==========================================
+ Hits        24985    25019      +34     
+ Misses      17094    17082      -12     
- Partials     2594     2600       +6     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@juliev0 juliev0 marked this pull request as ready for review October 9, 2024 04:22
@juliev0 juliev0 requested review from a team as code owners October 9, 2024 04:22
Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>
Copy link
Member

@crenshaw-dev crenshaw-dev left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, thanks!

@crenshaw-dev crenshaw-dev merged commit 4722a7f into argoproj:master Oct 9, 2024
27 checks passed
ali-hamza-noor pushed a commit to ali-hamza-noor/argo-cd that referenced this pull request Oct 10, 2024
…goproj#20298)

* add Actions for PipelineRollout to allow/disallow data loss

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* fix: test, add codegen generated docs

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* fix name

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* fix: make actions more robust to handle empty metadata

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* spacing

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

---------

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>
Signed-off-by: alnoor <alihamzanoor99@gmail.com>
austin5219 pushed a commit to austin5219/argo-cd that referenced this pull request Oct 16, 2024
…goproj#20298)

* add Actions for PipelineRollout to allow/disallow data loss

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* fix: test, add codegen generated docs

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* fix name

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* fix: make actions more robust to handle empty metadata

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* spacing

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

---------

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>
Signed-off-by: austin5219 <3936059+austin5219@users.noreply.github.com>
adriananeci pushed a commit to adriananeci/argo-cd that referenced this pull request Dec 4, 2024
…goproj#20298)

* add Actions for PipelineRollout to allow/disallow data loss

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* fix: test, add codegen generated docs

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* fix name

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* fix: make actions more robust to handle empty metadata

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

* spacing

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>

---------

Signed-off-by: Julie Vogelman <julievogelman0@gmail.com>
Signed-off-by: Adrian Aneci <aneci@adobe.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants