Context

Why this project exists

AR Theremin is designed as a collection of lightweight augmented reality scenes that make musical interaction and theremin history easier to explore. The project blends performance, learning, and visual experimentation so users can move between playing, observing, and understanding the instrument.

Purpose

The main concept is to turn camera-based AR into a responsive instrument interface while also presenting supporting scenes that explain the theremin, showcase media, and extend the experience with more playful AR moments like the UFO flyover scene.

• The theremin scene focuses on real-time hand-driven pitch and volume control.
• The timeline scene adds historical context through tracked media.
• The anatomy and UFO scenes show grounded placement in world space.
• The visualization scene turns sound into animated particles around a tracked target.

Technology

The application uses 8th Wall for world, image, and object tracking, MediaPipe for hand landmarks, Three.js for rendering, and the Web Audio API for synthesis and playback. A shared settings system keeps important controls consistent across scenes.