Back to corpus
architecturetechnical paper candidatescore 54

MotionMix Architecture

MotionMix is a motion-to-music performance system. A webcam tracks body movement via pixel differencing, maps motion zones to audio parameters, and drives a real-time music engine. Multiple phone cameras provide visual coverage with AI director auto-switching. The system learns progressively: each training session captures new motion vocabulary, unlocking new sound transformations.

Open full HTMLDownload HTMLCorpus JSONPaper schema

Full HTML reader

Read the full artifact

Open in new tab

Extracted abstract or opening context

> Your body is the phrase. Motion discovers sound. Every session expands what's possible. MotionMix is a motion-to-music performance system. A webcam tracks body movement via pixel differencing, maps motion zones to audio parameters, and drives a real-time music engine. Multiple phone cameras provide visual coverage with AI director auto-switching. The system learns progressively: each training session captures new motion vocabulary, unlocking new sound transformations. | Concern | Owner | Network | |---------|-------|---------| | **Audio generation** | Mac1 webcam (pixel-diff tracker) | Local only | | **Visual coverage** | 5 phone cameras (MJPEG streams) | WiFi to Mac1 | | **Director switching** | Rust multicam-server scoring | WebSocket | | **Recording (video)** | Each phone records 4K locally | None during session | | **Recording (audio)** | Browser MediaRecorder on Mac1 | None | | **Visualizer (live)** | Canvas 2D orb in dashboard | Local only | | **Visualizer (production)** | TouchDesigner on Mac2 | OSC/bridged | The LUME/DYK + K11 Rekordbox architecture adds one missing authority layer above the raw camera and motion feeds: `LumeBodyTruth`. | Machine | Responsibility | |---|---| | Mac4 | Unity DYK visuals, Femto Mega depth/RGB, first Sony/mocopi integration target | | K11 | Rekordbox, AirDeck gesture bridge, pose viewer, keyboard/MIDI command safety gate | | MotionMix hub | Shared fused body bus and future `LumeBodyTruth` publisher | | iPhones | Supplemental SAN/camera/motion evidence and training data |

Promotion decision

What has to happen next

Promote into a technical note or architecture paper with implementation anchors.

Why this is not always a full paper yet

Corpus pages are public-safe readers for discovered workspace artifacts. They are not automatically final papers. A corpus item becomes a polished paper only after the editable source, evidence checkpoints, references, figures, render path, and release status are attached through the paper schema.