← LearnGo to the exam
AI-integrated development
LLMs and AI APIs, prompting, tool use, LangChain, Ollama, Hugging Face, RAG, guardrails and evals, with three AI full-stack projects.
This phase has a version for each choice below. You see the one you pick. You can switch later and your progress is kept. See every module in the library.
How LLMs WorkPractice
0/16 lessons- Tokens and next-word prediction50 min
- The context window50 min
- Sampling and temperature50 min
- What models cannot do50 min
- Hallucination and trust55 min
- Module assignment: Helpdesk guard55 min
- Byte pair encoding by hand40 min
- Why the same text costs different tokens by language35 min
- Logits and probabilities40 min
- Three training stages40 min
- Attention in plain words45 min
- Word order and position40 min
- Token embeddings inside the model45 min
- Perplexity40 min
- Stop sequences and end-of-text40 min
- Parameters, memory and quality45 min
LLM APIsPractice
0/18 lessons- Your first chat API call50 min
- Streaming responses50 min
- API keys and secrets50 min
- Cost, rate limits and errors55 min
- Structured output and JSON55 min
- Module assignment: Safe ticket triage service55 min
- Choosing a model for a task40 min
- Request settings and stop reasons50 min
- Images and files as input40 min
- Timeouts and cancellation40 min
- Record-and-replay tests40 min
- Background jobs for slow calls45 min
- Batch requests for offline work35 min
- Pinning model versions and deprecations35 min
- A thin adapter for providers45 min
- The same calls in Python40 min
- Provider content filters and refusals35 min
- Stateless calls and rebuilding history35 min
Prompt EngineeringPractice
0/19 lessons- Roles and system prompts50 min
- Clear instructions and structure50 min
- Showing examples (few-shot prompting)50 min
- Reasoning and chain of thought55 min
- Prompt injection basics55 min
- Module assignment: Ticket triage prompt lab55 min
- Prompt chaining45 min
- Self-consistency40 min
- Self-critique and revision45 min
- Least-to-most prompting45 min
- Positive versus negative instructions40 min
- Delimiters and sections40 min
- Prompt templates with variables40 min
- Versioning prompts in files45 min
- Classifier prompts with definitions45 min
- Long documents: map then reduce45 min
- Asking clarifying questions40 min
- What a system prompt can hide40 min
- A/B testing two prompts45 min
Tool Use and AgentsPractice
0/22 lessons- Function calling50 min
- The agent loop55 min
- Agent design patterns55 min
- The MCP idea55 min
- Safe tool design55 min
- Module assignment: The safe order helpdesk agent55 min
- Parallel tool calls and result ordering40 min
- Writing tool descriptions the model can use40 min
- Forcing and limiting tool choice40 min
- Retrieval as a tool45 min
- Human checkpoints45 min
- Agent memory45 min
- Planning and re-planning40 min
- Budgets and timeouts for runs45 min
- Idempotent tools40 min
- Sandboxing code execution45 min
- Multi-agent handoffs40 min
- Subagents with their own tools45 min
- Reading agent traces35 min
- Browser and computer-use agents35 min
- Limiting tool result size40 min
- Error messages the model can act on40 min
LangChainPractice
0/14 lessons- What LangChain is50 min
- Prompt templates and output parsers55 min
- Multi-step chains and memory55 min
- When not to use LangChain50 min
- Module assignment: Ticket triage pipeline90 min
- Document loaders45 min
- Chat models and message types40 min
- Binding tools to a chat model45 min
- Stateful graphs50 min
- Callbacks and tracing hooks45 min
- Retrievers and vector store wrappers45 min
- Runnable methods: invoke, stream, batch35 min
- Fallbacks and retries40 min
- Dependency layout and version pinning40 min
Local Models with OllamaPractice
0/18 lessons- Why run a model locally50 min
- Install Ollama and run a model55 min
- Calling Ollama from code55 min
- Quantization and hardware55 min
- Choosing between local and cloud55 min
- Module assignment: Local-first gateway60 min
- Reading model tags and variants40 min
- Context length settings45 min
- Keep-alive and unloading40 min
- Local vision models40 min
- Tool calling with local models45 min
- Getting valid JSON from a local model40 min
- Benchmarking tokens per second40 min
- Running Ollama in Docker40 min
- Binding to a network address safely35 min
- Model storage and disk space35 min
- LoRA adapters explained45 min
- A small local model in CI tests40 min
Hugging FacePractice
0/15 lessons- The Hugging Face Hub50 min
- Hosted inference from TypeScript55 min
- Running models in JavaScript with transformers.js55 min
- Embedding models from the Hub55 min
- Module assignment: FAQ search60 min
- Dataset cards and licences45 min
- Tokenisers from the Hub45 min
- Text classification pipelines40 min
- Zero-shot classification45 min
- Named entity recognition40 min
- Summarisation and translation models40 min
- Image classification in the browser45 min
- Speech recognition with Whisper-style models45 min
- Pinning model revisions35 min
- Caching models and offline use40 min
RAG: Retrieval-Augmented GenerationPractice
0/19 lessons- What RAG is and why it exists50 min
- Vector search50 min
- Chunking documents50 min
- Better retrieval with hybrid search and reranking55 min
- Building RAG over documents55 min
- Module assignment: A tested RAG pipeline55 min
- Context packing within a budget40 min
- Citations that can be checked45 min
- HyDE: searching with a drafted answer40 min
- Parent-document retrieval40 min
- Metadata filters and access rules45 min
- Ingesting PDFs, tables and scans45 min
- Incremental re-indexing and deletes40 min
- Answer faithfulness checks45 min
- Multi-hop questions and iterative retrieval45 min
- Graph RAG basics45 min
- Code-aware chunking and retrieval45 min
- Caching embeddings and answers45 min
- Reading retrieval failures45 min
Guardrails and EvalsPractice
0/17 lessons- Input and output checks50 min
- Defending against prompt injection55 min
- Building an eval set55 min
- Using a model as judge55 min
- Regression testing and monitoring55 min
- Module assignment: A guarded support bot with an eval gate55 min
- Detecting and redacting personal data45 min
- Scope limits for a bot40 min
- Abuse controls40 min
- Output leakage checks40 min
- Red teaming a bot45 min
- Precision, recall and F145 min
- Labelling guidelines and review queues45 min
- Agreement between labellers45 min
- Flaky evals and repeated runs45 min
- Safety policy as tests45 min
- Tuning thresholds for guard checks45 min
Project: AI Chat with Your DocsPractice
0/5 lessonsProject: AI Support AgentPractice
0/5 lessonsEmbeddings and Vector StoresPractice
0/12 lessons- Choosing an embedding model45 min
- Distance metrics in practice40 min
- Normalising vectors35 min
- How HNSW search works45 min
- Index settings and recall45 min
- Vector quantization40 min
- pgvector in Postgres45 min
- Hosted vector databases40 min
- A local store on disk45 min
- Upserts, deletes and versions45 min
- Embedding drift when you change models40 min
- Batching and rate limits for embeddings45 min
Observability, Cost and LatencyPractice
0/12 lessons- What to log for model calls35 min
- Tracing a multi-step request35 min
- Token and cost accounting40 min
- Budgets, alerts and hard caps40 min
- Latency: first token versus total35 min
- Cutting latency40 min
- Exact and semantic caches45 min
- Routing from cheap to strong models40 min
- Quality drift on dashboards40 min
- Load tests for cost and latency45 min
- Error budgets and fallbacks40 min
- Trace retention and access40 min
AI Full-Stack AppsPractice
0/17 lessons- Spec for an AI feature in a web app35 min
- Server route that calls a model40 min
- Chat UI state in React45 min
- Saving conversations in Postgres45 min
- Accounts and sign-in40 min
- Scoping data to the current user40 min
- Per-user quotas40 min
- Ingestion jobs with status45 min
- Feature flags for model changes40 min
- Human confirm before AI actions40 min
- Image upload and vision in an app40 min
- Showing sources and citations in the UI40 min
- Feedback buttons feeding evals40 min
- Serverless deploys and timeouts40 min
- Config per environment40 min
- Responsive chat layout40 min
- Incident runbook for AI features45 min
Machine Learning BasicsPractice
0/16 lessons- What Machine Learning Is35 min
- Features and Labels40 min
- Train, Validation and Test Sets35 min
- Linear Regression40 min
- Loss and Gradient Descent45 min
- Logistic Regression and Classification50 min
- Decision Trees and Random Forests50 min
- Overfitting and Underfitting45 min
- Regularization45 min
- Cross-Validation45 min
- Confusion Matrix and ROC Curves45 min
- Regression Error Metrics40 min
- Clustering Basics45 min
- Neural Network Intuition45 min
- Scikit-Learn Pipeline Project50 min
- Saving and Serving a Model45 min
Python and Data BasicsPractice
0/16 lessons- Python syntax and core types40 min
- Functions and modules45 min
- Lists, dicts and sets45 min
- Comprehensions and iteration45 min
- Reading and writing files35 min
- Reading JSON and CSV40 min
- Virtual environments and pip45 min
- Errors and exceptions45 min
- Testing with pytest40 min
- NumPy arrays40 min
- Vectorised operations in NumPy45 min
- Pandas Series and DataFrames45 min
- Cleaning messy data45 min
- Grouping and joining tables45 min
- Plotting data with matplotlib and pandas35 min
- Small analysis project55 min
Phase exam
A timed mixed test across every module in this phase.
Pick your options above to see the matching modules.