Azure Data Factory
Orchestrate remote jobs in Azure Data Factory with your Apache Airflow DAGs.
Azure Data Explorer
Learn how to orchestrate Azure Data Explorer queries with your Apache Airflow DAGs.
Azure Container Instances
Learn how to orchestrate containers with Azure Container Instances from your Airflow DAGs.
OpenLineage
Use OpenLineage and Marquez to get lineage data from your Airflow DAGs.
dbt
dbt is an open-source library for analytics engineering that helps users build interdependent SQL models for in-warehouse data transformation. As ephemeral compute becomes more readily available in data warehouses thanks to tools like Snowflake, dbt has become a key component of the modern data engineering workflow. Now, data engineers can use dbt to write, organize, and run in-warehouse transformations of raw data.
Databricks
Orchestrate Databricks jobs with your Airflow DAGs.
Amazon SageMaker
Follow a step-by-step tutorial for using Airflow to orchestrate the training and testing of a SageMaker model.
Snowflake
Get enhanced observability and compute savings while orchestrating Snowflake jobs from your Airflow DAGs.
Amazon Redshift
Orchestrate Redshift queries from your Airflow DAGs.
Great Expectations
Orchestrate Great Expectations data quality checks with your Airflow DAGs.
Talend
Orchestrate remote jobs in Talend with your Apache Airflow DAGs.
Jupyter notebook
Run a parameterized Jupyter notebook using Airflow and the Astro CLI.
Soda Core
Orchestrate Soda Core data quality checks with your Airflow DAGs.