IEOR 4570 Agentic AI - Resources


Slides, code examples, and live demos from IEOR 4570, a hands-on course on building and shipping AI Agents. Source code to slides and examples at github.com/x/ieor-4570-agentic-ai.

Lectures


Introductionslides

Course introduction and an overview of building production-grade AI agents.

Examples: hello-world

Large Language Modelsslides

The architecture and evolution of modern LLMs, from Markov chains to Transformers.

Examples: markov-chains-basic, markov-chains-books, tiny-llama-completions, tiny-llama-chat

Chatbotsslides

From terminal to web: the client-server architecture behind an LLM chatbot.

Examples: markov-chains-temperature, ollama-completions, qwen-web-chat

In-Context Learningslides

Role-play, InstructGPT, and the principles of a good one-shot prompt.

Examples: few-shot, five-questions, five-questions-web

Reasoningslides

From chain-of-thought prompting to reasoning models, and what changed for the person steering them.

Harnesses and Tool Callingslides

Agent harnesses, tool calling, function calling, and MCP for LLM-based agents.

Examples: qwen-chat, qwen-tool-calling, gemini-hello-world, gemini-web-tool-calling

Guardrails and Agent Frameworksslides

Guardrails on the agent loop and the OpenAI Agents SDK.

Examples: guardrails-password-challenge, guardrails-password-challenge-web, agents-sdk-chat, agents-sdk-web

Other Agent Frameworksslides

Google ADK, Claude Agent SDK, LangGraph, and Pydantic AI, mapped to the OpenAI Agents SDK and the platforms each one connects to.

Examples: adk-web

Evaluationsslides

Deterministic checks, golden references, rubrics, gold and silver datasets, pass@k, and offline vs. online evals.

Examples: nyc-311-agent

Retrieval Augmented Generationslides

Classic (semantic) RAG, retrieval as a tool call, reranking, hybrid search, and filesystem RAG.

Examples: magic-item-shop-classic-rag, magic-item-shop-semantic-rag, magic-item-shop-filesystem-rag

Tracing and Monitoring
Constrained Decoding and Watermarking
Text2SQL Agents
Multi-agent Architectures
Sessions, State, and Memory
KV-Cache
Coding Agents

Live Demos


five-questions-webdemo src

Play five questions against Gemini while watching its context, then rewind and ask again to see that no object was ever chosen.

gemini-web-tool-callingdemo src

A web chatbot with a weather tool that shows every tool call the harness runs before the answer.

guardrails-password-challenge-webdemo src

Get the model to reveal a password across seven levels, each stacking a new guardrail on the last.