Back to corpus
architecturetechnical paper candidatescore 22

Body As Input Overview

The body-input layer gathers evidence about what the performer is doing. It must work when only a camera is available, and it should improve when mocopi, watch, phone, or depth sensors are available.

Open full HTMLDownload HTMLCorpus JSONPaper schema

Full HTML reader

Read the full artifact

Open in new tab

Extracted abstract or opening context

The body-input layer gathers evidence about what the performer is doing. It must work when only a camera is available, and it should improve when mocopi, watch, phone, or depth sensors are available. | Source | Role | Hard dependency? | | --- | --- | --- | | Camera pose | Primary baseline for hand/torso/head gestures | Yes, for camera gestures | | iPhone CoreMotion | Phone motion/body energy when phone is carried | No | | Sony mocopi | Higher-quality skeleton/body source | No | | Apple Watch / SensorLogger | Wrist motion, HR, compass/barometer/location where enabled | No | | Femto/Bolt/Mega cameras | RGB/depth/pose assist depending on host support | No | | MotionMix BodyTruth | Intended fused body-state authority | Only after stability checks | The architectural rule is camera-first: basic gestures must not stop working because mocopi is off, charging, or disconnected. For DJ/AirDeck, this matters more than model sophistication. The user must be able to raise a hand and get a predictable command even without wearing sensors. - `CMDeviceMotion` into `SensorFrameFFI`; - camera pose/statistics where enabled; - mocopi features through `MocopiFeatureExtractor`; - watch/pocket features; - SAN capture frames through `SANTrajectoryLogger`.

Promotion decision

What has to happen next

Promote into a technical note or architecture paper with implementation anchors.

Why this is not always a full paper yet

Corpus pages are public-safe readers for discovered workspace artifacts. They are not automatically final papers. A corpus item becomes a polished paper only after the editable source, evidence checkpoints, references, figures, render path, and release status are attached through the paper schema.