IEOR 4570 Agentic AI - Resources


Slides, code examples, and live demos from Columbia DSi IEOR 4570, a hands-on course on building and shipping AI Agents. Materials focus on the basics of LLMs, modern agent development, and deploying to GCP with OpenAI Agents SDK, LiteLLM, and Gemini. Source code to slides and examples at github.com/x/ieor-4570-agentic-ai.

Lectures


Introductionslides

Course introduction and an overview of building production-grade AI agents.

Examples: hello-world

Large Language Modelsslides

The architecture and evolution of modern LLMs, from Markov chains to Transformers.

Examples: markov-chains-basic, markov-chains-books, tiny-llama-completions, tiny-llama-chat

Chatbotsslides

From terminal to web: the client-server architecture behind an LLM chatbot.

Examples: markov-chains-temperature, ollama-completions, qwen-web-chat

In-Context Learningslides

Role-play, InstructGPT, and the principles of a good one-shot prompt.

Examples: few-shot, five-questions, five-questions-web

Sampling, Constrained Decoding, and Watermarking
Reasoningslides

From chain-of-thought prompting to reasoning models. How In-Context Learning becomes Reasoning.

Harnesses and Tool Callingslides

Agent harnesses and tool calling for LLM-based agents.

Examples: qwen-chat, qwen-tool-calling, gemini-hello-world, gemini-web-tool-calling

Guardrails and Agent Frameworksslides

Guardrails on the agent loop and the OpenAI Agents SDK.

Examples: guardrails-password-challenge, guardrails-password-challenge-web, agents-sdk-chat, agents-sdk-web

Other Agent Frameworksslides

Google ADK, Claude Agent SDK, LangGraph, and Pydantic AI.

Examples: adk-web

Evaluationsslides

Deterministic checks, golden references, rubrics, gold and silver datasets, pass@k, and offline vs. online evals.

Examples: nyc-311-agent

Retrieval Augmented Generationslides

Classic (semantic) RAG, retrieval as a tool call, reranking, hybrid search, and filesystem RAG.

Examples: magic-item-shop-classic-rag, magic-item-shop-semantic-rag, magic-item-shop-filesystem-rag

Text2SQL Agentsslides

Agents that perform retrieval from SQL databases.

Examples: subway-survey-text2sql, subway-survey-text2sql-improved, nyc-311-agent, nyc-311-agent-improved

Tracing and Monitoringslides

Tracing agents with OpenTelemetry and Langfuse.

Examples: nyc-311-agent-langfuse

Multi-agent Architectures
Sessions, State, and Memory
KV-Cache
Coding Agents

Live Demos


five-questions-webdemo src

Play five questions against Gemini while watching its context, then rewind and ask again to see that no object was ever chosen.

gemini-web-tool-callingdemo src

A web chatbot with a weather tool that shows every tool call the harness runs before the answer.

guardrails-password-challenge-webdemo src

Get the model to reveal a password across seven levels, each stacking a new guardrail on the last.