From the course: AWS Certified Machine Learning Engineer Associate (MLA-C01) Cert Prep
Unlock this course with a free trial
Join today to access over 24,700 courses taught by industry experts.
Amazon SageMaker Inference Recommender
From the course: AWS Certified Machine Learning Engineer Associate (MLA-C01) Cert Prep
Amazon SageMaker Inference Recommender
- [Instructor] Hello guys, and welcome again. So in today's session, we are going to talk about the Amazon SageMaker Inference Recommender tool, which is a tool that recommends the best instance types and configurations for the inference workloads. So Amazon SageMaker Inference Recommender, it is a tool which helps optimize the deployment of machine learning models by recommending the best instance types and configurations in order to deploy the machine-learning models efficiently. So it ensures that the models run smoothly and cost effectively, which provides high performance without unnecessary expenses. So it automates the process of benchmarking and evaluation of different instances, which simplifies the task of identifying the most suitable options. So it saves times and effort by systematically testing various instances in order to find the most optimal one in terms of performance and in terms of cost. So best instances are selected based on several factors, including the…
Practice while you learn with exercise files
Download the files the instructor uses to teach the course. Follow along and learn by watching, listening and practicing.
Contents
-
-
-
-
-
-
-
-
-
(Locked)
Intro: Model deployment53s
-
(Locked)
Online inference (real-time)20m 57s
-
(Locked)
Batch transform2m 17s
-
(Locked)
Other deployments8m 8s
-
(Locked)
Multi-model vs. multi-container endpoints10m 24s
-
(Locked)
Hands-on learning: Multi-model endpoint7m 16s
-
Hands-on learning: Multi-container endpoint2m 49s
-
(Locked)
SageMaker deployment7m 48s
-
(Locked)
Hands-on learning: XGBoost (churn prediction)6m 43s
-
(Locked)
Hands-on learning: Script mode3m 1s
-
(Locked)
Hands-on learning: Bring your own (BYO) Docker4m
-
(Locked)
SageMaker instance types3m 2s
-
(Locked)
SageMaker SDK7m 11s
-
(Locked)
Distributed training5m 20s
-
(Locked)
SageMaker Debugger3m 33s
-
Hands-on learning: SageMaker serverless inference6m 9s
-
(Locked)
SageMaker Autopilot3m 33s
-
(Locked)
Amazon SageMaker Inference Recommender6m 37s
-
(Locked)
Amazon SageMaker Serverless Inference5m 24s
-
(Locked)
Inference pipeline5m 3s
-
(Locked)
Hands-on learning: SageMaker Model Monitor15m 51s
-
(Locked)
SageMaker Neo6m 29s
-
(Locked)
SageMaker security6m 54s
-
(Locked)
Deployment target services10m 10s
-
(Locked)
Maintainable, scalable, cost-effective deployments8m 38s
-
(Locked)
Automatic scaling metrics4m 16s
-
(Locked)
Performance tradeoff analysis4m 10s
-
(Locked)
Apache Airflow, SageMaker Pipelines6m
-
(Locked)
Isolated ML system13m 12s
-
(Locked)
Exam cram11m 16s
-
(Locked)
-
-
-
-