Back to corpus
architecturetechnical paper candidatescore 28

Stage 0: RESEARCH -- LUME Full System Architecture

**Unity project (22 C# files, ~3200 lines):** - `LumeUdpReceiver.cs` -- Magic-byte dispatch for LUME/LUMD - `LumePointRenderer.cs` -- Cloud/Depth render modes, GraphicsBuffer - `LumeDepthReprojector.cs` -- GPU pinhole reprojection from LUMD - `LumeOpticalFlow.cs` -- Frame-diff scalar + Lucas-Kanade dense flow - `LumeAudioFftReceiver.cs` -- LUMF consumer, [DefaultExecutionOrder(200)] - `LumeVfxRuntimeBridge.cs` -- Pushes globals to VFX Graph, [DefaultExecutionOrder(210)] - `LumeTransientForcePusher.cs` -- Impulse ev

Full HTML reader

Read the full artifact

Open in new tab

Extracted abstract or opening context

### Hardware Stack - **K11 (GMKtec NucBox K11):** Ryzen 9 8945HS, Radeon 780M (~9 TFLOPS), 32GB DDR5, 1TB NVMe. Windows 11 Pro. No CUDA. - **Orbbec Femto Bolt:** USB-C depth camera, 640x576 ToF (confirmed via pyorbbecsdk, published LUMD on :9700) - **Orbbec Femto Mega:** Legacy camera, larger with rear Jetson hump. USB-C. - **UMA-8 mic array:** 8-channel USB-A. Publishes LUMF on :9701 via audio_pub.py. - **Sony mocopi:** 6x BLE IMU sensors. Native app on phone publishes to :12351. LUMM wire format spec exists but bridge not yet deployed. - **Network:** Tailscale mesh connecting mac1, mac4, mac5, cloud-vm, K11. ### LUME Software on K11 (existing, verified) **Python publishers (3 files, ~1170 lines total):** - `pointcloud_pub.py` (556 lines) -- LUME/LUMD dual-format. Real Femto via pyorbbecsdk or synthetic. Ships 40B LUMD headers with intrinsics in every datagram. - `audio_pub.py` (315 lines) -- LUMF 84B fixed datagrams. RMS, 4 EQ bands, 8 MFCC, onset/transient detection. Mic mode via sounddevice or synthetic. - `mocopi_bridge.py` (256 lines, at MotionMix/server/) -- Parses Sony binary TLV protocol from :12351, extracts 27-bone positions. Currently forwards as JSON to capture server HTTP :9405. Needs rewrite to publish LUMM UDP. **Unity project (22 C# files, ~3200 lines):** - `LumeUdpReceiver.cs` -- Magic-byte dispatch for LUME/LUMD - `LumePointRenderer.cs` -- Cloud/Depth render modes, GraphicsBuffer - `LumeDepthReprojector.cs` -- GPU pinhole reprojection from LUMD - `LumeOpticalFlow.cs` -- Frame-diff scalar + Lucas-Kanade dense flow - `LumeAudioFftReceiver.cs` -- LUMF consumer, [DefaultExecutionOrder(200)] - `LumeVfxRuntimeBridge.cs` -- Pushes globals to VFX Graph, [DefaultExecutionOrder(210)] - `LumeTransientForcePusher.cs` -- Impulse events from transients, [DefaultExecutionOrder(220)] - `LumeCalibrationPanel.cs` -- F12 IMGUI panel, JSON persistence - `LumeMotionGate.cs` -- SuperHot-style time scaling from motion, [DefaultExecutionOrder(150)] - `LumeProceduralTunnel.cs` -- 6144-point cylindrical helix - `LumeAudioReactor.cs` -- Outline flash + HSV jitter from audio - `LumeCalibration.cs` -- Calibration storage - `LumeVfxEditor.cs` + 5 preset ScriptableObjects -- VFX presets - 3 Editor scripts: AutoWire, BootstrapTunnelScene, VfxGraphBootstrap - 2 Compute shaders: LumeDepthReproject.compute, LumeOpticalFlow.compute **Wire formats (documented in lume_wire_format.md):** | Magic | Format | Port | Size | Status | |-------|--------|------|------|--------| | 0x4C554D45 LUME | Synthetic cloud | :9700 | Variable (450pt chunks) | Working | | 0x4C554D44 LUMD | Raw depth | :9700 | 40B hdr + 716px chunks | Working | | 0x4C554D46 LUMF | Audio FFT | :9701 | 84B fixed | Working | | 0x4C554D4D LUMM | Mocopi skeletal | :9702 | 772B fixed (27 bones) | Spec exists,

Promotion decision

What has to happen next

Promote into a technical note or architecture paper with implementation anchors.

Why this is not always a full paper yet

Corpus pages are public-safe readers for discovered workspace artifacts. They are not automatically final papers. A corpus item becomes a polished paper only after the editable source, evidence checkpoints, references, figures, render path, and release status are attached through the paper schema.