From the course: AWS Certified Machine Learning Engineer Associate (MLA-C01) Cert Prep

Unlock this course with a free trial

Join today to access over 24,700 courses taught by industry experts.

Apache Airflow, SageMaker Pipelines

Apache Airflow, SageMaker Pipelines

From the course: AWS Certified Machine Learning Engineer Associate (MLA-C01) Cert Prep

Start my 1-month free trial Buy for my team

Apache Airflow, SageMaker Pipelines

“

(bright music) - [Instructor] Hello guys, and welcome again. In today's lesson, we're going to talk about Apache Airflow and SageMaker Pipelines. So first of all, we have the Amazon Managed Workflows for Apache Airflow, which is the MWAA. This is a managed service that runs Apache Airflow workflows in a secure and a scalable environment. And also we have Amazon SageMaker pipelines, which is a purpose-built service for automating and managing machine learning workflows. So the managed workflow for Apache Airflow: Some of the key features include the managed environment, so it provides a secure and a scalable managed environment in order to run Apache Airflow workflows. Also, the AWS integration with other services, so it seamlessly integrates with AWS services like Amazon S3, Redshift, and Glue, And also you have custom plugins as well, so it supports custom operators and plugins for tailored workflows. It could also efficiently handle multi-step workflows and task dependencies if you…

Contents