Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Release 1.17 lyft #76

Open
wants to merge 10,000 commits into
base: master
Choose a base branch
from
Open

Release 1.17 lyft #76

wants to merge 10,000 commits into from

Conversation

nji302
Copy link

@nji302 nji302 commented Dec 19, 2023

Flink within Lyft doesn't actually use the master branch, and future changes for Flink 1.17 can be made directly on the release-1.17-lyft branch. Mainly creating this PR so the team sees the Flink 1.17 changes and has visibility.

RocMarshal and others added 30 commits February 27, 2023 22:47
…xception during restoring

(cherry picked from commit a98bb9a)
…able.exec.local-hash-agg.adaptive.sampling-threshold'

This closes apache#21900

(cherry picked from commit 55b927b)
… duplicate operators introduced by chaining optimization

This closes apache#22053.
… JobManager be allocated.

(cherry picked from commit 1993ad0)
…though the classloader has been closed

This closes apache#22072

Co-authored-by: Matthias Pohl <matthias.pohl@aiven.io>
…gg-function.enabled'

This closes apache#21789

(cherry picked from commit afdc079)
…alue when the argument type is string

This closes apache#22031

(cherry picked from commit 263555c)
…native-agg-function.enabled option can't turned on per job when using it via SqlClient

This closes apache#22031

(cherry picked from commit 62a3b99)
- Only obtain execution exception if the job is in globally terminal state

- [hotfix] Unsubscribe finished TestEventSources from test commands.  Otherwise,
  any command with SINGLE_SUBTASK scope might be dispatched to a finished source.
  This will result in TestJobExecutor.waitForFailover timing out while waiting for the
  command to be executed and ACKed.

- [hotfix] Mark TestEventSource.scheduledCommands volatile

- [hotfix] Make sure to process all commands in TestEventSource
…ger constructor and mark it as deprecated

This closes apache#22094.
…sk manager in FineGrainedSlotManagerTest.

We use TaskManagerTracker.addPendingTaskManager to allocate task manager
in FineGrainedSlotManagerTest. This make the resource requirements
different between FineGrainedSlotManager and TaskManagerTracker. And the
FineGrainedSlotManager may trigger resource recycling after the requirementCheckDelay.

So we use processResourceRequirements to allocate task manager. And set
the requirementCheckDelay to 0 to stabilize this test.

(cherry picked from commit bec6a45)
…ns in column list of a partial-insert statement

This closes apache#22109
…leUp timing out.

We're starting TMs with two slots, and in case both slots don't arrive simultaneously, we might have an additional restart of the job. Unfortunately calling OnceBlockingNoOpInvokable#cancel would effectively unblock all future #invoke calls by setting the running flag to true. We address the issue by tracking this flag for each execution attempt separately.
… causes issues with Hugo version 0.111.0 and higher. This closes apache#22113

(cherry picked from commit 3ea83ba)
…eadSchedulerTest#testRequestTimeoutIsRefreshedAndSuccess.

(cherry picked from commit a306831)
nji302 and others added 30 commits January 3, 2024 11:02
This reverts commit b6a8953.
This reverts commit d7c2db2.
This reverts commit a42c5c5.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet