Reverse Synesthesia

Color, movement and light in front of the camera become notes. Everything runs in this browser; no video leaves the device.

Headphones help: speakers next to a camera are fine, but loud ones invite you to dance, which plays more notes.

Source

Input Camera Mirror (move right, go right)

Mapping

Mode Strips / keys Rows Sample size Threshold Stability Hue to pitch

Rows apply to Motion keys and the Scanner; sample size to Center sample; hue mapping to Color voices and Center sample.

Color → sound

Pitch from Octave from Velocity from

Every voice measures the hue, saturation and brightness of its own patch: a strip, the moving cell, the torch, a scanner band, the center sample. Hue as pitch picks a pitch class through the hue mapping; any other source is a position across the range, or within one octave when something picks the octave.

Pitch

Lowest Highest Quantize Root Scale

Voices & arpeggiator

Voicing Max voices Arpeggiate the held notes Pattern Octaves Tempo Step Gate Clock

The Scanner always steps on this clock; the arpeggiator applies to the other modes.

Synth

Play through the built-in synth Wave Attack Release Cutoff Resonance Image → filter Glide Delay Volume

MIDI

Enable Web MIDI

Output Channel Send image as CCs (74 brightness, 1 motion, 71 saturation, 16 hue) Input Input role

To reach a DAW, send to a virtual port: IAC Driver (macOS), loopMIDI (Windows), snd-virmidi (Linux).

Presets

Settings are remembered in this browser.