Skip to content
Machine Learning Operations Engineer
AI-300Intermediate

MLOps and GenAIOps on Azure — Take Models from Notebook to Production

AI-300 exam prep: operationalize machine learning and generative AI on Azure — training pipelines, endpoints, monitoring, CI/CD, and GenAIOps.

Start LearningHands-on labs + AI-300 exam prep
About

About This Course

The AI-300 certifies the Machine Learning Operations Engineer — the role that owns everything that happens after a model works on someone's laptop. This is deliberately not a data science course. Every topic is approached through an operations lens: how do you automate it, version it, monitor it, secure it, and roll it back when it degrades. Training orchestration here means pipeline design, not model architecture.

The course covers both halves of the modern MLOps mandate. The first is classical machine learning operations on Azure Machine Learning — workspaces and compute, assets and environments defined as infrastructure as code, training pipeline orchestration, model registration and feature retrieval, deployment to managed endpoints, and monitoring with automated retraining. The second is GenAIOps, the operational discipline around generative AI: deploying and managing foundation models, running the Foundry Agent Service, versioning prompts as first-class artifacts, optimizing RAG systems, fine-tuning, and the evaluation and observability tooling that tells you whether any of it is actually working.

That evaluation and observability material is where the course spends real time, because it is where generative AI projects most often fail in production. You will work through systematic evaluation and validation of generative outputs, then instrument live solutions so regressions surface before your users find them — alongside the security, identity, and responsible AI practices that keep the whole pipeline governed.

Outcomes

What You'll Learn

01

Provision and manage Azure Machine Learning workspaces and compute infrastructure

02

Orchestrate training pipelines, register models, and manage assets as code

03

Deploy models to managed endpoints and monitor them for drift and degradation

04

Build CI/CD for machine learning with Azure Pipelines, Bicep, and the azure-ai-ml SDK

05

Evaluate, validate, and observe generative AI solutions in Microsoft Foundry

Before You Start

Prerequisites

  • Working Python knowledge — the course uses azure-ai-ml, azure-ai-evaluation, and azure-ai-projects
  • Familiarity with core Azure services and the Azure portal
  • Basic machine learning concepts; the course teaches operations, not data science
  • Comfort with YAML and the command line is helpful for the IaC and pipeline modules
Audience

Who Is This Course For

This course is for the people who put models into production and keep them there — MLOps and platform engineers, data scientists who have outgrown the notebook, DevOps engineers picking up AI workloads, and AI engineers who now own generative solutions running in front of real users.

You should be comfortable in Python and know your way around Azure. You do not need to be a data scientist: the course deliberately teaches the operational discipline rather than model theory, so a solid engineering background matters far more than a research one. If you already hold the AI-102 or AI-103, this is the natural next step into the operations side of the platform.

Curriculum

What's Inside

01

MLOps Infrastructure and Workspace Management

  • Provisioning and configuring Azure Machine Learning workspaces
  • Compute targets, clusters, and cost-aware infrastructure choices
  • Workspace access control and resource organization
02

Assets, Environments, and Infrastructure as Code

  • Managing datasets, models, and components as versioned assets
  • Building and curating reproducible training environments
  • Defining machine learning infrastructure with Bicep and YAML
  • Automating workspace provisioning end to end
03

Training Orchestration and Model Registration

  • Designing and running training pipelines with the azure-ai-ml SDK
  • Parameterizing and scheduling repeatable training jobs
  • Registering models and managing the model registry
  • Feature retrieval and the managed feature store
04

Deployment, Monitoring, and Retraining

  • Deploying models to managed online and batch endpoints
  • Endpoint scaling, traffic splitting, and safe rollout
  • Monitoring for data drift and model performance degradation
  • Triggering automated retraining loops
05

CI/CD, Security, and Responsible AI

  • Building CI/CD pipelines for machine learning workloads
  • Identity, networking, and secrets across the ML lifecycle
  • Responsible AI practices and governance for deployed models
06

Foundry, Foundation Models, and GenAIOps

  • Microsoft Foundry platform fundamentals and GenAIOps principles
  • Deploying and managing foundation models
  • Building and operating agents with the Foundry Agent Service
  • Prompt engineering, versioning, and prompt lifecycle management
  • RAG optimization and advanced fine-tuning
07

Generative AI Evaluation and Observability

  • Systematic evaluation and validation of generative AI solutions
  • Building evaluation datasets and automated quality checks
  • Instrumenting generative AI workloads for production observability
  • Tracing, diagnosing, and remediating AI risks