Releases: pachyderm/pachyderm
Releases · pachyderm/pachyderm
2.12.2
Contributors
molinamelendezj
Assets 11
2.12.0-rc.3
What's Changed
- CreateSnapshot, ListSnapshot RPC and DB CRUD by @Zhang-Muyang in #10371
- bump jupyter_server dependency by @bbonenfant in #10376
- Bump zipp from 3.18.1 to 3.19.1 in /jupyter-extension by @dependabot in #10377
- Bump setuptools from 69.2.0 to 70.0.0 in /jupyter-extension by @dependabot in #10195
- Bump certifi from 2024.2.2 to 2024.7.4 in /jupyter-extension by @dependabot in #10381
- bump tornado dependency by @bbonenfant in #10382
- Bump urllib3 from 2.2.1 to 2.2.2 in /jupyter-extension by @dependabot in #10383
- Bump @sentry/browser from 7.64.0 to 7.119.1 in /console/frontend by @dependabot in #10380
- [Jupyter] update python manifest by @bbonenfant in #10386
- Implement fileset handle / id split and stable ids by @brycemcanally in #10374
- [CUSTENG-87] Update helm chart for det 0.37.0 by @BOsterbuhr in #10378
- Machinery snapshot restore batch job by @bbonenfant in #10394
- Implement fileset pinning by @brycemcanally in #10393
- [MLDM-111] snapshot cmd: list, create, and delete by @Zhang-Muyang in #10390
- Add a way to restart a pachyderm cluster via a function call by @jrockway in #10395
- Add a function to restore a snapshot by @jrockway in #10373
- [MLDM-140] [MLDM-139] Inspect snapshot and delete snapshot by @Zhang-Muyang in #10387
- [Python-SDK] Expose logs, pjs, and snapshot services by @bbonenfant in #10398
- Build test and release containers with Bazel by @jrockway in #10397
- [MLDM-114] Batch restore by @robert-uhl in #10404
- [MLDM-157] Make Sure Migrations Use Squash Correctly by @FahadBSyed in #10399
- [MLDM-160] Require snapshot ID for restore by @robert-uhl in #10402
- [MLDM-160] Add more required variables by @robert-uhl in #10406
- sever dependency chain from cmd/pachd -> cmd/pachctl by @bbonenfant in #10408
- Add PJS to Builder and Pachctl Misc gRPC by @FahadBSyed in #10403
- delete existing restore-snapshot job before subsequent restore by @bbonenfant in #10409
- Use fileset pinning in PJS by @brycemcanally in #10400
- Expose //tools/dex bazel command by @bbonenfant in #10388
- Make the CreateSnapshot API actually take a snapshot by @jrockway in #10405
- Re-enable the printf linter by @jrockway in #10415
- Enable the nilness check by @jrockway in #10416
- restore-snapshot job needed pachyderm-storage-secret env by @bbonenfant in #10418
- capitalize "Delete" in pachctl help by @bbonenfant in #10410
- Use FileSet pins in snapshots by @jrockway in #10412
- Fix PJS API for RC by @brycemcanally in #10417
- Cascade when deleting snapshots by @jrockway in #10413
- [MLDM-140] add inspect snapshot cmd by @Zhang-Muyang in #10419
- [MLDM-140] return fileset when inspectSnapshot; fix bazel by @Zhang-Muyang in #10420
- Upgrade rules_go by @jrockway in #10422
- [MLDM-140] fix auth! by @Zhang-Muyang in #10421
- set version to 2.13 after 2.12 has been forked for release by @brendoncarroll in #10423
- [MLDM-164] Add Setup Steps for PJS Worker Authentication by @FahadBSyed in #10411
- [MLDM-198] check dumped file path by @Zhang-Muyang in #10425
- record pachd logs for python-sdk tests by @bbonenfant in #10426
- [Python-SDK] Add 3.12+ compatibility for tarfile by @bbonenfant in #10427
- regenerate //private/apt/apt.lock.json by @bbonenfant in #10431
- Add an End-to-End Test for PJS by @FahadBSyed in #10428
- Run Minio on a port that Zscaler hasn't stolen for itself by @jrockway in #10433
- [MLDM-192] Add test for snapshot restoration lifecycle by @robert-uhl in #10434
- [MLDM-195] Run CheckStorage after snapshot restore tests by @Zhang-Muyang in #10429
- Fix ci by @Zhang-Muyang in #10435
- Run anything that uses the pachd container as user id 65532 by @jrockway in #10414
- remove datadog from circel config by @djanicekpach in #10438
- [INF-1587] Fix CircleCI redux by @robert-uhl in #10440
- Test Whether CI Will Build With These Changes by @FahadBSyed in #10439
- [INF-1599] Enterprise Checks by @Zhang-Muyang in #10446
- fix master by @Zhang-Muyang in #10450
- Upgrade Helm Chart for Det 0.38.0 by @BOsterbuhr in #10451
- [INF-1635] Update dependencies by @robert-uhl in #10462
- [INF-1635] Update Docker client by @robert-uhl in #10471
- [INF-1635] Update to latest go-oidc by @robert-uhl in #10475
- Djanicek/muyang/test helm by @djanicekpach in #10474
- update pg by @Zhang-Muyang in #10481
- [INF-1644] Update to latest Pachyderm Dex (#10482) by @robert-uhl in #10484
- [INF-1644] Update PostgreSQL .debs by @robert-uhl in #10487
- [INF-1644] Update spout example go.mod by @robert-uhl in #10489
Full Changelog: v2.12.0-alpha.3...v2.12.0-rc.3
Contributors
jrockway, brendoncarroll, and 8 other contributors
Assets 11
2.11.6
What's Changed
- [Backport] Fix Bazel Dependencies in 2.11.x by @FahadBSyed in #10456
- [Backport 2.11] Upgrade Helm Chart for Det 0.38.0 (#10451) by @BOsterbuhr in #10452
- Fix 2.11 by @Zhang-Muyang in #10463
- [INF-1635] Update deps by @robert-uhl in #10467
Full Changelog: v2.11.5...v2.11.6
Contributors
robert-uhl, FahadBSyed, and 2 other contributors
Assets 11
2.12.0-rc.1
What's Changed
- CreateSnapshot, ListSnapshot RPC and DB CRUD by @Zhang-Muyang in #10371
- bump jupyter_server dependency by @bbonenfant in #10376
- Bump zipp from 3.18.1 to 3.19.1 in /jupyter-extension by @dependabot in #10377
- Bump setuptools from 69.2.0 to 70.0.0 in /jupyter-extension by @dependabot in #10195
- Bump certifi from 2024.2.2 to 2024.7.4 in /jupyter-extension by @dependabot in #10381
- bump tornado dependency by @bbonenfant in #10382
- Bump urllib3 from 2.2.1 to 2.2.2 in /jupyter-extension by @dependabot in #10383
- Bump @sentry/browser from 7.64.0 to 7.119.1 in /console/frontend by @dependabot in #10380
- [Jupyter] update python manifest by @bbonenfant in #10386
- Implement fileset handle / id split and stable ids by @brycemcanally in #10374
- [CUSTENG-87] Update helm chart for det 0.37.0 by @BOsterbuhr in #10378
- Machinery snapshot restore batch job by @bbonenfant in #10394
- Implement fileset pinning by @brycemcanally in #10393
- [MLDM-111] snapshot cmd: list, create, and delete by @Zhang-Muyang in #10390
- Add a way to restart a pachyderm cluster via a function call by @jrockway in #10395
- Add a function to restore a snapshot by @jrockway in #10373
- [MLDM-140] [MLDM-139] Inspect snapshot and delete snapshot by @Zhang-Muyang in #10387
- [Python-SDK] Expose logs, pjs, and snapshot services by @bbonenfant in #10398
- Build test and release containers with Bazel by @jrockway in #10397
- [MLDM-114] Batch restore by @robert-uhl in #10404
- [MLDM-157] Make Sure Migrations Use Squash Correctly by @FahadBSyed in #10399
- [MLDM-160] Require snapshot ID for restore by @robert-uhl in #10402
- [MLDM-160] Add more required variables by @robert-uhl in #10406
- sever dependency chain from cmd/pachd -> cmd/pachctl by @bbonenfant in #10408
- Add PJS to Builder and Pachctl Misc gRPC by @FahadBSyed in #10403
- delete existing restore-snapshot job before subsequent restore by @bbonenfant in #10409
- Use fileset pinning in PJS by @brycemcanally in #10400
- Expose //tools/dex bazel command by @bbonenfant in #10388
- Make the CreateSnapshot API actually take a snapshot by @jrockway in #10405
- Re-enable the printf linter by @jrockway in #10415
- Enable the nilness check by @jrockway in #10416
- restore-snapshot job needed pachyderm-storage-secret env by @bbonenfant in #10418
- capitalize "Delete" in pachctl help by @bbonenfant in #10410
- Use FileSet pins in snapshots by @jrockway in #10412
- Fix PJS API for RC by @brycemcanally in #10417
- Cascade when deleting snapshots by @jrockway in #10413
- [MLDM-140] add inspect snapshot cmd by @Zhang-Muyang in #10419
- [MLDM-140] return fileset when inspectSnapshot; fix bazel by @Zhang-Muyang in #10420
- Upgrade rules_go by @jrockway in #10422
- [MLDM-140] fix auth! by @Zhang-Muyang in #10421
- bump base-revision dc for release branch by @molinamelendezj in #10424
Full Changelog: v2.12.0-alpha.3...v2.12.0-rc.1
Contributors
jrockway, robert-uhl, and 7 other contributors
Assets 11
2.11.5
What's Changed
- [Backport 2.11] Update helm chart for det 0.37.0 (#10378) by @BOsterbuhr in #10392
Full Changelog: v2.11.4...v2.11.5
Contributors
BOsterbuhr
Assets 11
2.12.0-alpha.3
What's Changed
- Conditional Propagation by @brycemcanally in #10310
- Add a little utility to run psql on a pachdev postgres instance by @jrockway in #10328
- [MLDM-91] benchmark dequeueAndProcess by @Zhang-Muyang in #10345
- upgrade errcheck to avoid a crash when encountering pachsql.DB by @jrockway in #10349
- Add Schema Change and Data Model Code for the PJS Server-Side Cache by @FahadBSyed in #10347
- [MLDM-34] list queue and list job RPC by @Zhang-Muyang in #10344
- Update the PFS tests to use testpachd by @brycemcanally in #10348
- Fix Master branch compile issue by @Zhang-Muyang in #10352
- [MLDM-89] Add Caching Behavior to PJSDB Functions by @FahadBSyed in #10351
- Improve bounds checking for RenewFileset by @robert-uhl in #10350
- [MLDM-66] Require function/method documentation by @robert-uhl in #10355
- Always Write Job Cache Metadata for Jobs (So We Know When to Respect cache-write and cache-read) by @FahadBSyed in #10353
- [MLDM-100] createChunkset by @Zhang-Muyang in #10354
- [MLDM-66] Type documentation by @robert-uhl in #10356
- [MLDM-89] Add Cache Code to the PJS API Server by @FahadBSyed in #10359
- [MLDM-66] Variable documentation style by @robert-uhl in #10357
- [MLDM-66] Package documentation by @robert-uhl in #10360
- update the helm values schema by @BOsterbuhr in #10362
- [MLDM-94] Move RealEnv tests to NewTestPachd by @Zhang-Muyang in #10361
- [MLDM-117] DropChunkset by @Zhang-Muyang in #10365
- Add snapshot database schema by @jrockway in #10358
- Let psql handle C-c by @jrockway in #10366
- Take database dumps during snapshots by @jrockway in #10367
Full Changelog: v2.12.0-alpha.2...v2.12.0-alpha.3
Contributors
jrockway, robert-uhl, and 4 other contributors
Assets 11
2.11.4
What's Changed
- [2.11] update the helm values schema (#10362) by @BOsterbuhr in #10363
Full Changelog: v2.11.3...v2.11.4
Contributors
BOsterbuhr
Assets 11
2.12.0-alpha.2
What's Changed
- Bump cryptography from 42.0.8 to 43.0.1 in /jupyter-extension by @dependabot in #10305
- direct users to pachdev docs in LOCAL.md by @bbonenfant in #10309
- MLDM-60: Stopgap Hashing in PJS by @FahadBSyed in #10307
- [MLDM-48] Rename 'Srv' to 'Server' by @FahadBSyed in #10311
- [MLDM-35] InspectQueue by @Zhang-Muyang in #10312
- upgrade docker to resolve a govulncheck warning by @jrockway in #10315
- [MLDM-78] Complete switch to type-safe generic golang-lru v2 by @robert-uhl in #10317
- upgrade to go 1.23.0 by @jrockway in #10287
- .bazelrc: test_output=errors by @jrockway in #10314
- [Python SDK] Log CDR network responses on error by @bbonenfant in #10327
- [MLDM-52] Delete Job RPC Without Cancelling on Behalf of User by @FahadBSyed in #10324
- Bump typescript from 4.9.3 to 5.0.4 in /console by @dependabot in #10323
- Bump github.com/docker/docker from 24.0.9+incompatible to 25.0.6+incompatible in /examples/spouts/go-rabbitmq-spout/source by @dependabot in #10320
- Bump typescript from 4.9.3 to 5.6.2 in /console/backend by @dependabot in #10321
- Rollback Dependabot Merges by @FahadBSyed in #10333
- Bump axios from 1.6.2 to 1.7.7 in /console by @dependabot in #10331
- Bump path-to-regexp and express in /console/backend by @dependabot in #10319
- Add configuration for private IP in cloud sql proxy [MLDM-74] by @acohen4 in #10187
- Revert "Bump path-to-regexp and express in /console/backend (#10319)" by @FahadBSyed in #10338
- Revert "Bump axios from 1.6.2 to 1.7.7 in /console (#10331)" by @FahadBSyed in #10340
- Revert Dependabot Changes and Update PNPM Ourselves by @FahadBSyed in #10341
- [MLDM-63] fix processQueue by @Zhang-Muyang in #10322
- Reference Inputs by @brycemcanally in #10336
Full Changelog: v2.12.0-alpha.1...v2.12.0-alpha.2
Contributors
jrockway, robert-uhl, and 6 other contributors
Assets 11
2.11.3
What's Changed
- [2.11.x] [Python SDK] Log CDR network responses on error (#10327) by @bbonenfant in #10334
- [2.11.x Backport] Remove CODEOWNERS (#10301) by @bbonenfant in #10335
- Add configuration for private IP in cloud sql proxy [MLDM-74] (#10187) by @FahadBSyed in #10339
Full Changelog: v2.11.2...v2.11.3
Contributors
FahadBSyed and bbonenfant
Assets 11
2.12.0-alpha.1
What's Changed
- [PFS-258] Create PJS Database Schema by @FahadBSyed in #10183
- only set enterpriseSecret if enabling enterprise by @jrockway in #10207
- Add creator/update information to commits by @jrockway in #10196
- Put created_by in the branch info proto by @jrockway in #10201
- [CORE-2312] Add pipeline created-at by @robert-uhl in #10203
- [CORE-2311] Alter semantics of pipeline created at by @robert-uhl in #10212
- Restart Service Pipeline once all source commits are finished by @acohen4 in #10102
- Vendor kube event tail into pachd by @acohen4 in #10209
- [FRON-1521]: Update pipeline summary to include crashing in failed pipeline count by @pleeko in #10138
- A few tweaks for
pachctl logs2by @jrockway in #10217 - Avoid paging hints too close to the current time by @jrockway in #10218
- Add branch creator / creation time / update time by @jrockway in #10213
- [PFS-261] Forget RPC Additional Guardrails by @Zhang-Muyang in #10200
- User Code inherits Determined env vars by @acohen4 in #10221
- [Python-SDK] Tests for #10190 by @bbonenfant in #10208
- [PFS-260] Work in Progress Pin Function by @FahadBSyed in #10206
- [PFS-255] Remove TestMicrosoft by @FahadBSyed in #10161
- [Jupyter] Don't show "invalid address" when cluster is valid by @bbonenfant in #10225
- First Iteration of the PJS Data Model API by @FahadBSyed in #10205
- [PFS-263] Move PJS to 2.12. by @FahadBSyed in #10232
- Add pachd + worker k8s networking env vars for notebooks by @acohen4 in #10228
- [Python-SDK] Enable datum batching tests in CI by @bbonenfant in #10233
- Console Monorepo by @pierrelamarche in #10193
- [FRON-1542]: Console release by @pleeko in #10226
- Bump cypress from 13.13.0 to 13.13.1 in /console by @dependabot in #10239
- Bump eslint-plugin-prettier from 5.1.3 to 5.2.1 in /console/backend by @dependabot in #10237
- Bump grpc_tools_node_protoc_ts from 5.3.2 to 5.3.3 in /console/backend/src/proto by @dependabot in #10238
- Override Datum Batching user code env vars [CORE-2336] by @acohen4 in #10235
- [FRON-1515]: Port template changes from haberdashery by @pleeko in #10243
- [Console]: Fix gitignore and delete temp files by @pleeko in #10244
- Bump urllib3 from 2.2.1 to 2.2.2 in /python-sdk by @dependabot in #10241
- [PFS-171] Make Loki opt-in for integration tests by @FahadBSyed in #10234
- [PFS-171] Replace UpdateCommit() by @FahadBSyed in #10231
- Split Server Functions Into Multiple Files For Readability by @FahadBSyed in #10248
- [INT-1297] Large repo infinite scroll testing documentation by @emmajsadams in #10247
- Refactor PFS Master by @FahadBSyed in #10249
- Update dependencies for jupyterlab v4.0 by @kevyang in #10250
- Remove the PFS Driver by @FahadBSyed in #10252
- [MLDM-11] Add JobContext to PJS by @FahadBSyed in #10255
- [PFS-171] Update onUpsert Interface, Refactor StartCommit by @FahadBSyed in #10253
- [Python-SDK] Bump minimum Python version to 3.9 by @bbonenfant in #10246
- Move all tests that don't need k8s out of pachyderm_test by @jrockway in #10254
- [MLDM-5] Console Tests w/ Bazel by @bbonenfant in #10264
- [MLDM-20] createJob RPC and tests by @Zhang-Muyang in #10265
- [PFS-171] Refactor PFS API Server Functions Related to Inspecting, Subscribing, and Resolving Commits by @FahadBSyed in #10259
- [MLDM-29] Queue CRUD by @Zhang-Muyang in #10268
- Det Default Image Update by @BOsterbuhr in #10270
- Convert even more k8s tests to unit tests by @jrockway in #10269
- [MLDM-30] processQueue RPC by @Zhang-Muyang in #10273
- Update CODEOWNERS - make console unowned by @msteffen in #10275
- [MLDM-24] Include console backend and frontend tests in
bazel testby @bbonenfant in #10274 - Revert change that removes environment variables from the worker; only filter out POSTGRES_PASSWORD instead by @jrockway in #10278
- document pachdev by @jrockway in #10281
- workspace_status: work on mac os, upgrade hard-coded master version by @jrockway in #10280
- [MLDM-44] Document running console cypress tests with Bazel by @bbonenfant in #10282
- Update helm chart for det 0.35.0 by @BOsterbuhr in #10283
- Implement WalkJob RPC by @FahadBSyed in #10277
- add BAZEL_TRACK_SOURCE_DIRECTORIES option to .bazelrc by @bbonenfant in #10285
- Use Commit Pickers to Resolve Commits by @FahadBSyed in #10272
- Support VM root user -- bazel build //jupyter-extension by @bbonenfant in #10292
- [MLDM-32] CancelJob RPC by @Zhang-Muyang in #10289
- Move jsonnet linting to Bazel by @jrockway in #10291
- Add a Gazelle plugin to ensure jsonnet files are linted by @jrockway in #10295
- Move all golangci-lint linters to nogo by @jrockway in #10276
- Check deferred errors more regularly by @jrockway in #10286
- Upgrade bazel and modules by @jrockway in #10290
- Remove CODEOWNERS by @msteffen in #10301
- First Pass on PJS Auth by @FahadBSyed in #10300
- [MLDM-60] Implement content hashing for PJS by @robert-uhl in #10302
- [MLDM-33] Await by @Zhang-Muyang in #10293
- pachdev docs: mention the value override files and how to diff by @jrockway in #10304
Full Changelog: v2.11.0-alpha.6...v2.12.0-alpha.1
Contributors
jrockway, msteffen, and 11 other contributors