INTERMEDIATE · 6 MODULES · 38 LESSONS
Interactive Experiences with AI: Maps, 3D and Real-Time Audio
Build web experiences that wow people and hold up in real use: a 3D map that reacts to live music and an interactive event guide that works offline.
- For you if
- You already build frontends with TypeScript and want to do maps, 3D, and audio in the browser.
- By the end
- You'll know how to hold 60 frames per second, make animation accessible, and prototype with an AI agent without losing control.
- You need
- Basic TypeScript and React, Node.js, and a Chromium browser. A microphone and a coding agent are optional.

Curriculum
01Foundations: interactive experiences that reach production
- Module introduction: why a prototype is not a product
- Anatomy of two cases: an audio-reactive map and a venue navigator
- Choosing the rendering technology: DOM, SVG, Canvas 2D, WebGL and maps
- The Encuentro Bruma 2027 case: requirements, constraints and budgets
- Project step: verifiable requirements and a Vite scaffold
023D maps with MapLibre GL JS: terrain and open tiles
- Module introduction: Cumbre Sonora's stage
- The MapLibre mental model and camera: style, sources, layers and motion
- 3D terrain: raster-dem, hillshade and sky
- Open vector tiles and attribution: OpenFreeMap, your own PMTiles and licenses
- Custom layers with Three.js: sharing the map's WebGL2 context
- Project step: the Bruma valley in 3D
03Real-time audio with the Web Audio API
- Module introduction: listening in the browser, with permission and without surprises
- AudioContext and microphone: autoplay, permissions and errors
- AnalyserNode and FFT: from bins to bands
- Detecting beats with spectral flux: threshold, envelope and cooldown
- Other sources: file, tab audio and a synthetic fallback
- Project step: the audio engine with a debug panel
04Reactive visuals: WebGL, performance and accessibility
- Module introduction: beauty and responsibility in the same frame
- One render loop: from audio to uniforms
- Audio-driven shaders: ripples in a ring buffer
- GPU performance: one draw call, merged geometry and measurement
- Reduced motion and calm mode: CSS, JavaScript and MapLibre
- Flashing, pause, keyboard and text alternatives
- Project step: Cumbre Sonora with calm mode
05Venue navigator: data, floor plans, search and offline
- Module introduction: what an attendee needs in a crowded hallway
- Data model: sessions, speakers, rooms and floors
- Floor plans: base image and an SVG room layer
- Search with MiniSearch: prefixes, typos and accents
- URL state, jumping between floors and time zones
- Static and offline build: PWA, precache and deployment
- Project step: the Encuentro Navigator
06Prototyping with AI agents and capstone
- Module introduction: fast and under control
- Prototyping with a coding agent: spec, plan and prototype
- Guardrails: CLAUDE.md, checks and hooks
- Reviewing generated code: a checklist for graphics and audio
- Testing interactive work: pure functions, Playwright and fake media
- Capstone (1): integrating the navigator, the map and live mode
- Capstone (2): verification, deployment and handoff
Reviews
What students say
These reviews are from enrolled students who completed at least 50% of the course. We moderate reviews only on content grounds (spam, offensive language, personal data), never for being critical or negative.
No approved reviews yet.
Be the first to share your experience!