Interfaces 2026

Welcome to Interfaces

Interfaces is the bridge between dance and computer art. We capture the dynamics and expression of movement and transport them into the world of code-generated art — connecting choreographers, dancers, visual artists, and computer nerds on the same platform.

🎥

Capture motion from any source
Scan a video file entirely in your browser using ffmpeg.wasm + MediaPipe Pose — no upload needed. Or stream live from your webcam, a WebSocket feed, or load pre-recorded data from the database.

🗄️

Relational motion database
Every scan is a RawData record. Wrap it in a Choreo (with an author, name, and type) to give it context and make it discoverable. Use the Database tab to explore, organise, and remix what's stored.

🎨

Generative art playground
Write p5.js sketches that consume live pose data via a unified dataSource.getFrame() interface — the same code works whether the data comes from a video scan, a live webcam, or a stored choreo. Save and reload your sketches as JsScripts at any time.

🤝

Open & shareable
Interfaces is about sharing and remixing. Tag the creators of the content you use and share the results — fame, coins, or just the fun of it.

🧰

Clean, export, and hand off motion data
Use the Post-Process sink to clean jitter/noise, then export BVH motion for Blender (and other DCC tools) directly from the Playground sink panel.

📚

In-app guides when you need them
Open the Docs tab any time for onboarding guides, feature docs, and changelogs without leaving the app.

Ready? Head to the to explore what's stored, or jump straight into the to start creating. Need guidance first? has a 15-minute onboarding path.

Docs Viewer

Browse project guides and changelogs directly in the app. Documents are loaded from the repository docs/ folder via /api/v1/docs.

Document: Order:

Loading documentation index…

Tip: use date order to spot outdated docs quickly.

Database

This is the relational heart of Interfaces. Every scan, choreography, and generative script lives here as a structured record that can be linked, re-used, and remixed. Use the forms below to add records, the ✕ buttons to remove them, and ▶ Playground to load a Choreo straight into the editor.

Raw API: /api/v1/choreos/ | /api/v1/choreotypes/ | /api/v1/rawdata/ | /api/v1/jsscripts/ | /api/v1/dockpresets/

Transfer / Backup

Export your full database as one JSON backup file and import it on another Interfaces instance. Import replaces existing records in this database.

ChoreoTypes

A ChoreoType is a named category for a movement style or session context — e.g. "Contemporary", "Video Scan", or "Improvisation". Choreos reference a ChoreoType so you can filter and group related recordings.

RawData

A RawData record holds the raw JSON payload of a motion scan — typically an array of per-frame landmark objects produced by MediaPipe. RawData is the factual backbone: a Choreo links to it to add metadata such as a name, author, and type. Large payloads are stored but not rendered here to keep the UI fast.

Choreos

A Choreo is the publishable unit of a motion recording. It wraps a RawData payload with human-readable metadata (name, author, modification time) and an optional ChoreoType tag. Think of it as the "track" record in a music library — the raw scan is the audio file, the Choreo is the labelled, shareable entry. Click ▶ Playground to load any Choreo directly into the editor for playback or generative art.

JS Scripts

A JsScript is a saved Playground sketch — a p5.js snippet that you can reload into the editor at any time. Use Import JS File to upload an existing script from disk, or save the current editor contents directly from the Playground's Save Script button.

Dock Presets

A DockPreset stores a named Playground widget arrangement as JSON using canonical widget names like data_source and data_sink.

Current Status

Data Source Database · empty

Output Stream p5.js · sketch idle

Data Sink None · idle

JavaScript Editor

Saved scripts live in the database and work with any output engine. Use the Built-in sketches selector in the Output panel to load a ready-made p5.js template.

Output

Data Source ○

Source:

Select a choreo and click Load to prepare playback.

FPS: 30

Frame:

0 / 0

— ⟷ —

Frame Inspector

Curve View

Joint: Dim:

Position

Velocity (Δpos / frame)

Acceleration (Δvel / frame)

Load a choreo to enable curve view.

○ Webcam stopped

○ Pose estimation off

Pose landmarks are delivered to the sketch via dataSource.getFrame().landmarks in each draw cycle.

⚙ Pose Settings

Fine-tune how MediaPipe detects and tracks poses from your webcam. Changes take effect when pose estimation is next enabled.

Detection: 0.50

Presence: 0.50

Tracking: 0.50

Delegate:

Video file:

Scan FPS: 5

Resolution:

Hand Scan: ⚠ extra CPU/GPU — enable only when needed

⚙ Pose Settings

Adjust how MediaPipe detects and tracks poses while streaming the video. Settings are applied at the start of the next scan.

Detection: 0.50

Presence: 0.50

Tracking: 0.50

Delegate:

○ Select a video file and click Scan.

Video is streamed through MediaPipe Pose in VIDEO mode — temporal tracking gives smoother results than per-frame detection. All processing runs in your browser via ffmpeg.wasm + MediaPipe Pose. The video file never leaves your device. Each scanned frame includes a videoTimestampMs field (video playback position in milliseconds) so you can re-align pose data with the original video even when frames are dropped — useful for syncing a 3D skeleton with the video in tools like Blender. Enable Hand Scan above only when per-frame hand data is needed; it uses extra CPU/GPU and may cause frame drops on slower devices. Scanned frames are delivered to the sketch via dataSource.getFrame().landmarks.

○ Disconnected

Send emits a message into the broadcast channel (all connected clients receive it).

Data Sink

Sink:

Quick workflow: 1) choose source (Webcam, Video, or loaded DB choreo), 2) export from this panel, 3) import into Blender with Forward -Z and Up Y.

Export leading t-pose — prepend a synthesized BVH rest pose frame

World movement — track hip position throughout the sequence (choreo recordings)

Recording: off

Buffers frames with 3D world landmarks, then exports them as a .bvh motion-capture file — importable directly into Blender, Maya, Unity, and Unreal. Requires a source that provides worldLandmarks (webcam or video scan).

Leading t-pose (default on) prepends one synthesized rest frame so imported rigs can bind from a canonical t-pose before choreography motion starts.

Export modes:
Stationary (default) — ROOT hip position is always (0, 0, 0); only orientations change. Best for looping assets: walk cycles, idles, gestures.
World movement — ROOT hip position tracks the performer's actual movement across the capture area using image-space coordinates. Best for natural full-body choreography sequences. Requires frames with image landmarks (webcam/video sources or DB choreos that stored both landmark sets).

For Database source choreos, use Export Loaded DB Choreo as BVH to skip manual record / stop timing.

Blender import: File → Import → Motion Capture (.bvh), then set: Forward Axis → -Z | Up Axis → Y.
The rotation order (ZXY) is read automatically from the file — no manual setting needed.

Applies signal-processing filters to the loaded DB choreo and saves the cleaned result as a new entry. Requires DB source with a loaded choreo.

Parameter help is also available below in How to choose filter settings for keyboard and touch users.

Interpolate Null Frames Fill gaps where pose was not detected using linear interpolation.

Max gap length (frames):

Reject Velocity Outliers Detect and replace teleporting joints using speed analysis.

Threshold factor:

One Euro Filter Adaptive smoothing — reduces jitter while preserving fast movement.

Min cutoff: Beta:

Savitzky-Golay Filter Polynomial smoothing — preserves motion peaks such as jump apices.

Window size (frames, odd):

How to choose filter settings

Quick cleanup: Interpolation + One Euro defaults are a safe start.
Noisy data: increase One Euro Min cutoff slowly (e.g. 1.0 → 1.5).
Fast choreography: raise Beta or disable SG if accents get flattened.
Outlier misses: lower Threshold factor; false removals: raise it.

Load a DB choreo to enable.