Apache Airflow Essential Training

سرفصل های دوره

If you already know the basics of Apache Airflow but are eager to learn more, this course is for you. Certified Google cloud architect and data engineer Janani Ravi guides you through several essential features in Apache Airflow. After a quick review of what Airflow is all about, Janani dives into working with the TaskFlow API and using it to perform a variety of operations. She shows you how to integrate PostgreSQL in Airflow, as well as how to use sensors and work with hooks in Airflow. Level up your use of Apache Airflow with this essential course.

This course was created by Janani Ravi. We are pleased to host this training in our library.

01 - Introduction

01 - Apache Airflow essential training

01 - apache airflow essential training.mp4.zip

02 - 1. Working with the TaskFlow API

01 - Prerequisites

02 - Quick Airflow setup overview

03 - DAG using PythonOperators

04 - DAG using TaskFlow

05 - Passing data using XCom with operators

06 - Passing data using the TaskFlow API

07 - Tasks with multiple outputs

08 - Passing multiple outputs in TaskFlow

03 - 2. Performing Operations Using TaskFlow

01 - Branching using operators

02 - Branching using the TaskFlow API

03 - Complete branching pipeline using TaskFlow

04 - Interoperating and passing data between operators and TaskFlow

05 - Performing SQL operations with TaskFlow

06 - Data transformation and storage using TaskFlow

04 - 3. Integrating PostgreSQL in Airflow

01 - Installing PostgreSQL on macOS

02 - Installing PostgreSQL on WSL

03 - Connecting to PostgreSQL

04 - Using the PostgreSQL operator

05 - Performing PostgreSQL insert operations

06 - Performing PostgreSQL join operations

07 - A complete end-to-end pipeline with PostgreSQL

08 - Configuring PostgreSQL as a metadata database and using the LocalExecutor

05 - 4. Using Sensors in Airflow

01 - Introducing the FileSensor

02 - Creating a pipeline using the FileSensor

03 - Running DAGs with a FileSensor

04 - Creating and running a pipeline with SQLSensors

06 - 5. Working with Hooks in Airflow

01 - Setting up for a PostgreSQL pipeline with hooks

02 - Creating and running a pipeline with PostgresSQL hooks

03 - Setting up access to Amazon S3 buckets

04 - Setting up a connection to Amazon S3 buckets

05 - Creating and running a pipeline with an S3 hook

07 - Conclusion

01 - Summary and next steps

45,900 تومان

خرید اشتراک افزودن به سبد خرید

خرید دانلودی فوری

در این روش نیاز به افزودن محصول به سبد خرید و تکمیل اطلاعات نیست و شما پس از وارد کردن ایمیل خود و طی کردن مراحل پرداخت لینک های دریافت محصولات را در ایمیل خود دریافت خواهید کرد.

تولید کننده: LinkedIn Learning (Lynda)