2.10.0-alpha.3

What's Changed

• [Python-SDK] Use MINIO storage (not LOCAL) by @bbonenfant in #9769
• [Python-SDK] Regen protos without ApiBase servicer by @bbonenfant in #9740
• Jupyter Extension - some fixes to the config page by @kevyang in #9779
• [PFS-207] Add GetWithID Functions to Projects and Repos by @FahadBSyed in #9782
• Handle the proto-copying with Go by @jrockway in #9691
• Re-enable and update jupyter frontend tests for FUSE-less/tabbed view by @kevyang in #9790
• setup_remote_docker - default by @molinamelendezj in #9793
• avoid caching proto generation test by @jrockway in #9792
• upgrade k8s to 1.29 by @jrockway in #9794
• [PPS] CreateDatum support for PFS inputs by @smalyala in #9712
• jupyter extension - allow configuration via env var by @kevyang in #9615
• go 1.22.1 by @jrockway in #9798
• [PFS-207] Add Picker Protos by @FahadBSyed in #9788
• [PFS-207] Add CommitAncestry For Commit Pickers by @FahadBSyed in #9778
• security: upgrade proto libraries by @jrockway in #9803
• Add Picker Code by @FahadBSyed in #9805
• [CORE-2196] Fix dpanic by @robert-uhl in #9812
• [PFS-220] Add upper configuration to prefetcher by @brycemcanally in #9811
• Update node version in main.yml by @emmajsadams in #9797
• upgrade envoy to v1.29.1 by @jrockway in #9817
• Upgrade etcd to v3.5.12 by @jrockway in #9806
• jupyter extension - add tests for env var configuration by @kevyang in #9809
• Run helm tests with bazel by @jrockway in #9819
• Graph RPC Traversal Stubs by @FahadBSyed in #9820
• The Metamorphosis by @jrockway in #9824
• [CORE-2152] Add a context to InspectClusterWithVersionAndProject by @robert-uhl in #9821
• [CORE-2125] Add log page hints by @robert-uhl in #9818
• jupyter extension - report correct directory when downloading datums by @kevyang in #9822
• [INT-1227] Fix all outstanding eslint and jest warnings by @emmajsadams in #9808
• adjust console release logic by @molinamelendezj in #9789
• Remove spout test by @jrockway in #9826
• security: upgrade pgx by @jrockway in #9829
• [INT-1227] Follow-up bug fix for malformed svg by @emmajsadams in #9830
• move cust mock test off release flow by @molinamelendezj in #9833

Full Changelog: v2.10.0-alpha.2...v2.10.0-alpha.3

2.9.2

What's Changed

• [Python-SDK] (Backport) Use MINIO storage (not LOCAL) (#9769) by @bbonenfant in #9784
• [Python-SDK] (Backport) Regen protos without ApiBase servicer (#9740) by @bbonenfant in #9786
• Various backports for jupyter extension by @kevyang in #9795
• backport #9615 by @kevyang in #9800
• [INT-1190] Center gear tab (backport) by @msteffen in #9801
• [2.9.x] Upgrade go and proto libraries by @jrockway in #9804
• [CORE-2196] Fix dpanic by @robert-uhl in #9810
• Add upper configuration to prefetcher (2.9.x) by @brycemcanally in #9813
• [Backport][PPS] CreateDatum support for PFS inputs by @smalyala in #9802
• jupyter extension - backport (#9809) by @kevyang in #9823
• jupyter extension - report correct directory when downloading datums by @kevyang in #9827

Full Changelog: v2.9.1...v2.9.2

2.8.6

What's Changed

• Add upper configuration to prefetcher (2.8.x) by @brycemcanally in #9814
• security: upgrade dependencies by @jrockway in #9815

Full Changelog: v2.8.5...v2.8.6

2.7.7

What's Changed

• [CORE-2035] Update gRPC for 2.7.x by @robert-uhl in #9503
• Disable test_mount_datums by @msteffen in #9511
• [Python-SDK] Bugfix: AuthServiceNotActivated errors not being raised by @bbonenfant in #9531
• update to go 1.21.5 (#9579) by @djanicekpach in #9581
• Backport Bugfix in PFS-191 to 2.7.x by @FahadBSyed in #9649
• security: upgrade dependencies by @jrockway in #9816
• bump console for 2.7.7 release by @molinamelendezj in #9834

Full Changelog: v2.7.6...v2.7.7

2.8.5

What's Changed

• [Backport - 2.8] Fix recursive put file logic (#9744) by @BOsterbuhr in #9748
• [Python-SDK] (Backport) Fix serialization error not being caught. (#9733) by @bbonenfant in #9759
• Fix path range directories (2.8.x) by @brycemcanally in #9773
• [2.8.x] internal/miscutil: fix ReadInto returning partial reads during errors by @brendoncarroll in #9775
• [Python-SDK] (Backport) Use MINIO storage (not LOCAL) (#9769) by @bbonenfant in #9785
• update 2.8.x with release fixes by @molinamelendezj in #9787

Full Changelog: v2.8.4...v2.8.5

2.10.0-alpha.2

What's Changed

• Process preprocessing tasks in pachw [PFS-65] by @brycemcanally in #9619
• Fix Slack status badge in README.md by @sirredbeard in #9651
• Add shard config parameters to ShardFileSet RPC by @smalyala in #9685
• [Python] repin black dependency by @bbonenfant in #9690
• Build a container with pachd built in coverage mode by @jrockway in #9686
• pachdev: Allow users to set a custom console version by @jrockway in #9683
• pachdev: add a command to generate a coverage report by @jrockway in #9682
• Add CreateDatum RPC skeleton by @smalyala in #9689
• Change Auth Token Env Var Name by @BOsterbuhr in #9687
• Check Det User First [CORE-2131] by @BOsterbuhr in #9694
• [INT-1163] Search in file explorer by @emmajsadams in #9692
• Update values in det section for chart update by @tybritten in #9678
• [Jupyter] Use MINIO storage (not LOCAL) by @bbonenfant in #9700
• [Jupyter] Tabs (lumino) by @bbonenfant in #9696
• [PFS-199] Use PFS client rather than pachclient in PPS worker by @brycemcanally in #9707
• Upgrade bazel by @jrockway in #9708
• [Jupyter] Allow uninstantiated pachyderm clients by @bbonenfant in #9705
• [Jupyter] Prevent a bad config from being stored by @bbonenfant in #9711
• [Jupyter] Remove dev_server from tests by @bbonenfant in #9713
• clear mounted datums before new datums by @kevyang in #9716
• [Jupyter] Add UNKNOWN cluster status state by @bbonenfant in #9719
• Enable and split object storage provider tests by @jrockway in #9717
• [INT-1162] Infinite scroll in file explorer by @emmajsadams in #9715
• [PFS-174] Lock all tables during a migration transaction by @FahadBSyed in #9722
• jupyter extension - make input spec non-resizeable by @kevyang in #9720
• Remove malformed key check by @brycemcanally in #9724
• go 1.22 by @jrockway in #9723
• [Jupyter] Prevent error popups when no connected to cluster by @bbonenfant in #9721
• console release --rebase required when not running interactively by @molinamelendezj in #9704
• disable logging for pulumi iac for now by @molinamelendezj in #9731
• adjust workspace_status to respect tags by @jrockway in #9726
• Allow setting a unique tag for the worker image by @jrockway in #9734
• debug: jobs: assume limit == 0 means "no limit" by @jrockway in #9735
• [Python-SDK] Fix serialization error not being caught. by @bbonenfant in #9733
• [INT-1207] Fix local cypress tests for Arch Linux VM Dev Env by @emmajsadams in #9728
• Remove mount server by @smalyala in #9718
• check for priority classes on retry by @djanicekpach in #9739
• Simple datum benchmark by @robert-uhl in #9706
• alpha cust mock test fix by @molinamelendezj in #9743
• [CORE-2146] Update CloudSql Auth Proxy by @tybritten in #9745
• Fix recursive put file logic by @BOsterbuhr in #9744
• [CORE-2145] Delete skipped tests from v1 by @robert-uhl in #9742
• Get logs for all pipelines, even if they're not running by @jrockway in #9749
• Add CORE codeowners by @acohen4 in #9751
• [CORE-1661] Add context to ModifyClusterRoleBinding by @robert-uhl in #9753
• [CORE-1662] Add context to GetProjectRoleBinding by @robert-uhl in #9754
• [CORE-1663] Add context to GetRepoRoleBinding by @robert-uhl in #9755
• [INT-1203] Infinite Scroll w/ ScrollBar by @emmajsadams in #9746
• New logs service with GetLogs API stub by @zmajeed in #9738
• [CORE-1664] Add context to ModifyRepoRoleBinding by @robert-uhl in #9757
• fix unknown flag error in release workflow by @molinamelendezj in #9756
• separate health check and config endpoints by @kevyang in #9764
• upgrade skopeo to support docker 25 by @jrockway in #9767
• [CORE-1665] Add context to ModifyProjectRoleBinding by @robert-uhl in #9766
• ListRepo() gRPC pagination [CORE-2132] by @acohen4 in #9727
• sync values for upgrades by @djanicekpach in #9763
• [INT-1190] Center gear tab by @emmajsadams in #9761
• Postgres 15 - will be necessary change once users comply with upgrading the dependency by @acohen4 in #9571
• [PFS-204] Fix path range directories by @brycemcanally in #9770
• revert isEqual by @kevyang in #9771
• internal/miscutil: fix ReadInto returning partial reads during errors by @brendoncarroll in #9774
• [CORE-2150] Do not use AddMetadata inside auth client by @robert-uhl in #9768
• Fix broken jupyter lab integration tests by @kevyang in #9777
• Fix regex used on tags for checking whether coverage builds are used by @dzhu in #9783

New Contributors

• @sirredbeard made their first contribution in #9651

Full Changelog: v2.9.0-nightly.20240129...v2.10.0-alpha.2

2.9.1

What's Changed

• [Backport - 2.9] Fix recursive put file logic (#9744) by @BOsterbuhr in #9747
• fix unknown flag error in release workflow (#9756) by @molinamelendezj in #9762
• [Python-SDK] (Backport) Fix serialization error not being caught. (#9733) by @bbonenfant in #9758
• [Jupyter] Bulk 2.9.x backport by @bbonenfant in #9765
• Fix path range directories (2.9.x) by @brycemcanally in #9772
• [2.9.x] internal/miscutil: fix ReadInto returning partial reads during errors by @brendoncarroll in #9776

Full Changelog: v2.9.0...v2.9.1

2.9.0

What's Changed

CORE

• Improve Delete Branch message w/ Prov, Triggers - #9610
• Identity Service Provisions Cross System Users and Groups on login - #9437
• Make sure self reference is impossible in edges. - #9510
• Sort CommitSets in descending order - #9548
• make proto for python - #9591
• Update Determined Helm Values - #9660
• check for not found errors - #9546
• parameterize the number of threads for collect - #9585
• Remove conditional build on go1.20 - #9561
• Bazelify "make proto" - #9578
• Copy over protoc output files in src/github.com/... - #9623
• Build Go with Bazel - #9614
• Disable remote cache by default - #9635
• Replace github.com/ghodss/yaml with sigs.k8s.io/yaml - #8805
• Change Postgres SSL from disabled to prefer - #9653
• Run all non-k8s go tests with bazel - #9626
• Use gazelle -mode=diff instead of gazelle --mode=fix; git diff in CI - #9668
• Container push + helm upgrade PoC - #9622
• move "vet" checks from golangci-lint to nogo - #9671
• kindenv: Test config / port allocation - #9675
• upgrade CI image after bazel upgrade yesterday - #9684
• Build a container with pachd built in coverage mode - #9686
• pachdev: Allow users to set a custom console version - #9683
• pachdev: add a command to generate a coverage report - #9682
• Upgrade bazel - #9708
• Enable and split object storage provider tests - #9717
• go 1.22 - #9723
• adjust workspace_status to respect tags - #9726
• Allow setting a unique tag for the worker image - #9734
• debug: jobs: assume limit == 0 means "no limit" - #9735
• pipeline worker alerts and check status - #9461
• update det helm templates 0.27.1 for 2.9.0 - #9673
• Update values in det section for chart update - #9678
• Add/update tests for project defaults - #9500
• Remove details argument from ListPipelineRequest - #9509
• Add context to client.IsAPIActive - #9558
• pachctl project defaults lifecycle tests - #9547
• Add project defaults to pachctl inspect project - #9567
• Add context to client.GetClusterRoleBinding - #9560
• Serve sidecar metrics - #9612
• Expose storage container metrics - #9618
• Declare user container metrics port similarly to storage sidecar metrics port - #9628
• Use minikubetestenv to deploy Prometheus - #9645
• Get logs for all pipelines, even if they're not running - #9749
• debug: jobs: assume limit == 0 means "no limit" - #9736

PFS

• Process preprocessing tasks in pachw - #9619
• Use PFS client rather than pachclient in PPS worker - #9707
• Remove malformed key check - #9724
• Remove Unused Object Storage Load Test - #9583
• Use Go CDK For Object Storage Everywhere - #9587
• Pass Through Buckets for Workers and Testing Code - #9598
• Update Documentation for Go CDK Enabled and Storage URL - #9611
• Check If a Chunk Exists After Uploading It - #9634
• Add the Option to Just Return a Diff from GetFileSet - #9633
• Update realenv to Use the Object Storage Bucket Backend - #9652
• Lock all tables during a migration transaction - #9722

INT

• Mount Server Emulate pipeline validation for input spec when mounting datums - #9458
• Add shard config parameters to ShardFileSet RPC - #9685
• Add CreateDatum RPC skeleton - #9689
• Rename "Mount" to "Load" in Explore and Test views - #9621
• Support packaging external files - #9630
• Paginated background loading of files for View Datum and PFS - #9665
• Search in file explorer - #9692
• Infinite scroll in file explorer - #9715
• Fix local cypress tests for Arch Linux VM Dev Env - #9728
• containerize documentation generation - #9497
• Jupyter Better handling of PFSConentManager errors - #9494
• Add config file write support - #9600
• Jupyter correct readme and cap jupyterlab version - #9620
• Jupyter Remove unused pycurl dependency - #9632
• Jupyter Use of datetime.datetime.min may throw errors - #9631
• Jupyter Writing config files and Auth bugfixes - #9624
• Python Update betterproto compiler - #9672
• Jupyter relative path for notebook requirements file - #9680
• Jupyter Change login url to https for secure connections - #9677
• Python epin black dependency - #9690
• Jupyter Use MINIO storage (not LOCAL) - #9700
• Jupyter Tabs (lumino) - #9696
• Jupyter Allow uninstantiated pachyderm clients - #9705
• Jupyter Prevent a bad config from being stored - #9711
• Jupyter Remove dev_server from tests - #9713
• Jupyter Add UNKNOWN cluster status state - #9719
• Jupyter Prevent error popups when no connected to cluster - #9721
• Python-SDK Fix serialization error not being caught. - #9733
• remove mount-server from jupyterlab-pachyderm extension - #9563
• Jupyter extension Add functionality to download a datum - #9574
• Jupyter extension skip test that sometimes hangs on mounting datum - #9616
• re-enable jupyter extension e2e tests - #9638
• jupyter extension add download file/dir functionality - #9664
• jupyter extension show error dialog when there is an error downloading files - #9667
• jupyter extension - create config parent directory if it doesn't exist - #9676
• Jupyter Extension - Support naming mounts for explore view - #9681
• clear mounted datums before new datums - #9716
• jupyter extension - make input spec non-resizeable - #9720

Full Changelog: v2.8.4...v2.9.0

2.9.0-rc.1

What's Changed

• Process preprocessing tasks in pachw [PFS-65] by @brycemcanally in #9619
• Fix Slack status badge in README.md by @sirredbeard in #9651
• Add shard config parameters to ShardFileSet RPC by @smalyala in #9685
• [Python] repin black dependency by @bbonenfant in #9690
• Build a container with pachd built in coverage mode by @jrockway in #9686
• pachdev: Allow users to set a custom console version by @jrockway in #9683
• pachdev: add a command to generate a coverage report by @jrockway in #9682
• Add CreateDatum RPC skeleton by @smalyala in #9689
• Change Auth Token Env Var Name by @BOsterbuhr in #9687
• Check Det User First [CORE-2131] by @BOsterbuhr in #9694
• [INT-1163] Search in file explorer by @emmajsadams in #9692
• Update values in det section for chart update by @tybritten in #9678
• [Jupyter] Use MINIO storage (not LOCAL) (#9700) by @bbonenfant in #9701
• prepare for 2.9.x release series by @molinamelendezj in #9699

New Contributors

• @sirredbeard made their first contribution in #9651

Full Changelog: v2.9.0-nightly.20240129...v2.9.0-rc.1

2.8.4

What's Changed

• Backport Fix from PFS-191 to 2.8.x by @FahadBSyed in #9650
• [Backport - 2.8] Garbage Collect Determined Pipeline Users (#9491) [CORE-2131] by @acohen4 in #9658
• (backport) Pin black dependency #9599 by @bbonenfant in #9695
• [Backport - 2.8] Change Auth Token Env Var Name #9687 by @BOsterbuhr in #9693
• bump console version 2.8.4 by @molinamelendezj in #9697
• [Backport - 2.8] Check Det User First [CORE-2131] (#9694) by @BOsterbuhr in #9698

Full Changelog: v2.8.3...v2.8.4