fix: Support for Airflow 3.1 #168
Merged
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
tomasfarias
force-pushed
the
fix/support-for-airflow-3.1
branch
from
a52c324 to
c6b9dca
Compare
tomasfarias
force-pushed
the
fix/support-for-airflow-3.1
branch
from
dfb80b7 to
ff59c96
Compare
tomasfarias
force-pushed
the
fix/support-for-airflow-3.1
branch
from
897d228 to
a578b2f
Compare
millin
reviewed
Nov 17, 2025
| dependencies = [ | ||
| "apache-airflow>=2.8", | ||
| "apache-airflow>=2.8,<4.0; python_version<'3.12'", | ||
| "apache-airflow>=3.0,<4.0; python_version>='3.12' and python_version<'3.13'", |
Contributor
There was a problem hiding this comment.
@tomasfarias Hi! I'm a little confused by this change.
Is there any reason why you specified 3.0 as the minimum version for Python 3.12?
According to the Airflow changelog, support for Python 3.12 was added starting with version 2.9.0.
Owner
Author
There was a problem hiding this comment.
I think I jumped ahead to the next version in our tests: We had 2.8, 3.0, and 3.1. So, I just jumped ahead to 3.0.
We could update the minimum version of Airflow to 2.9 for Python 3.12. It's not covered by our tests, but I think it should be relatively safe.
Owner
Author
There was a problem hiding this comment.
thanks, I'll try to get everything released soon. I've been travelling this week so releases are a bit delayed.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Closes: #166
Adds support for Airflow version 3.1 and later.
This new version of Airflow introduced a lot of changes to module import paths: Classes like
DAGnow come fromairflow.sdk. Moreover, some XCOM methods have been removed from operator classes. They are now available only in theTaskInstance.Moreover, and more painfully, our test suite broke with 3.1. This required a long and painful process to track which fixtures we need for things to work again.
Changes:
xcom_pushmethod to use theTaskInstancein newer versions of Airflow.