Skip to content

fix(APDR): add asset events to partitioned DagRun #61433

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Open
Lee-W wants to merge 8 commits into
base: main
Choose a base branch
from
Open

fix(APDR): add asset events to partitioned DagRun #61433

Lee-W wants to merge 8 commits into from
+34 −37

Conversation

@Lee-W
Copy link
Member

@Lee-W Lee-W commented Feb 4, 2026 •
edited
Loading

Why

consumed_asset_evnets was not appended for the partitioned DagRun

What

Ensure asset events are not missed for the partitioned DagRun

Was generative AI tooling used to co-author this PR?
  • Yes (please specify the tool below)
  • Read the Pull Request Guidelines for more information. Note: commit author/co-author name and email in commits become permanently public when merged.
  • For fundamental code changes, an Airflow Improvement Proposal (AIP) is needed.
  • When adding dependency, check compliance with the ASF 3rd Party License Policy.
  • For significant user-facing changes create newsfragment: {pr_number}.significant.rst or {issue_number}.significant.rst, in airflow-core/newsfragments.

@Lee-W Lee-W requested review from XD-DENG and ashb as code owners February 4, 2026 06:59
@boring-cyborg boring-cyborg bot added the area:Scheduler including HA (high availability) scheduler label Feb 4, 2026
@Lee-W Lee-W requested review from dstandish and removed request for XD-DENG and ashb February 4, 2026 06:59
@Lee-W Lee-W force-pushed the add-asset-event-to-partitioned-dag-run branch 2 times, most recently from 43213fb to f346fff Compare February 6, 2026 09:10
@Lee-W Lee-W self-assigned this Feb 9, 2026
@Lee-W Lee-W force-pushed the add-asset-event-to-partitioned-dag-run branch from f346fff to 57b22e1 Compare February 9, 2026 09:00
@uranusjr
Copy link
Member

uranusjr commented Feb 9, 2026

Hmm, how do non-partitioned events do this?

@Lee-W
Copy link
Member Author

Lee-W commented Feb 9, 2026

Hmm, how do non-partitioned events do this?

looks like they have a simliar implementation

airflow/airflow-core/src/airflow/jobs/scheduler_job_runner.py

Line 2090 in 5953b82

dag_run.consumed_asset_events.extend(asset_events)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@dstandish dstandish Awaiting requested review from dstandish

At least 1 approving review is required to merge this pull request.

Assignees

@Lee-W Lee-W

Labels

area:Scheduler including HA (high availability) scheduler

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@Lee-W @uranusjr