Airflow — Xcom Exclusive
default_args = { 'owner': 'airflow', 'depends_on_past': False, 'start_date': datetime(2023, 3, 20), 'retries': 1, 'retry_delay': timedelta(minutes=5), }
In Airflow, XCom is implemented as a key-value store that's accessible to all tasks in a DAG. When a task wants to share data with other tasks, it can use the xcom_push method to store a value in XCom. Other tasks can then use the xcom_pull method to retrieve that value. airflow xcom exclusive
task2 = BashOperator( task_id='task2', bash_command='echo {{ task_instance.xcom_pull("greeting") }}', dag=dag, ) from datetime import datetime, timedelta from airflow import
dag = DAG( 'xcom_example', default_args=default_args, schedule_interval=timedelta(days=1), ) from datetime import datetime
Apache Airflow is a popular open-source workflow management platform that enables users to programmatically define, schedule, and monitor workflows. One of its key features is XCom, a mechanism for exchanging messages between tasks in a DAG (directed acyclic graph). In this article, we'll dive into the world of Airflow XCom and explore its exclusive capabilities.
from datetime import datetime, timedelta from airflow import DAG from airflow.operators.bash_operator import BashOperator