Airflow: Mastering Key Concepts and Conquer Challenges

سرفصل های دوره

Building of better data pipelines by overcoming with day to day challenges

1. Introduction and Installation

1. Introduction to Airflow

2. Overview of Airflow features and benefits

3. DAG Important Concepts

4. Installing and configuring Airflow on local environments

5. Installation Challenges

2. Workflow Design and Management

1.1 Architecture PDF.pdf

1. Understanding Apache Airflow architecture and components

2. Apache Airflow Executors A comprehensive guide

3. Examining the example DAG and guide to create a DAG

4.1 simple dag.zip

4. Part 1 Creating a simple DAG in Apache Airflow

5.1 advanced dag.zip

5.2 complex dag.zip

5. Part 2 Creating a complex DAGs in Apache Airflow

6. Task dependencies and Scheduling

7. Managing Workflow Execution, Retries and SLAs

8. Handling Complex Dependencies and Parallelism in DAGs

3. Operators and Sensors

1.1 m3v1.zip

1. Introduction to Operators in Apache Airflow

2.1 m3v2 bash.zip

2.2 m3v2.zip

2. Deep dive into common Operators

3.1 file sensor.zip

3.2 http sensor.zip

3. Introduction to Sensors in Apache Airflow

4.1 custom sensor.zip

4. Custom Operators and Sensors

5. Use cases of custom Operators and Sensors in Apache Airflow

6.1 custom operator jinja template.zip

6. Custom Operator - Jinja template

4. Advanced Concepts and Scaling

1.1 m4 branchingcode.zip

1.2 m4v1.zip

1. Introduction to SubDAGs and Branching

2.1 m4v2.zip

2. Data Exchange in Airflow with XCom

3. Mastering Connections and Variables in Airflow

4. Scaling and Optimizing Apache Airflow

5. Understanding of Machine Learning

6.1 m4v6 titanic 1.zip

6.2 titanic.csv

6. Integrating ML workflows in Apache Airflow

7.1 m4v6.zip

7. Challenges in Advanced Airflow Workflows and their Resolutions

5. Incremental Data Load

1. Understanding Incremental Data Processing

2.1 filemaker with date.zip

2.2 m5v2.zip

2. Incremental Data Processing with Custom Airflow Operator

3. Efficient Transformation and Loading Strategies

179,000 تومان

افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: Udemy