Skip to main content
SearchLoginLogin or Signup

Synthesthesia: Sharing patterns for a choreographic audio and visual live coding experience.

Synthesthesia: Sharing patterns for a choreographic audio and visual live coding experience.

Published onNov 11, 2023
Synthesthesia: Sharing patterns for a choreographic audio and visual live coding experience.
·

Abstract

What if we could use the same patterns to produce audio and visuals? The desire was strong, so we developed an extension for the live coding environment Hydra. 12, and an integration of Hydra in Strudel3.

Strudel patterns in Hydra

How can we share patterns for audio and visuals production? The following running examples introduces how to use the same pattern to produce sounds, shapes, colors, and effects. It uses the strudel extension for Hydra.

Running example: Introducing Hydra and Strudel integration with the hydra extension.

note: To stop the sound, click inside the figure and press Ctrl + .

See full example here

Hydra visuals in Strudel

There are many visual representation of pitches and sound, from traditional notation that represents pitch using the vertical position of notes in pentagrams to audio responsive visuals. Next running examples introduces some of these using Hydra integration in Strudel.

Running example: pitch notation, rhythm synchronization and audio responsiveness using Hydra integration in Strudel.

See full example here

Acknowledgments

This work was supported in part by the European Union’s Horizon Europe Research and Innovation Program through the DAFNE+ Project under Grant 101061548.

Comments
0
comment
No comments here
Why not start the discussion?