Subscribe to Make Magazine Today!

Gestural Speech Synth
Vowel Shapes

Matt Gilbert’s speech synthesizer let’s you recreate vocalsounds via touch interface –

Rather than typing or otherwise encoding text, the way you control speech with this synth is by imitating the shape made by a throat when speaking. When you lay your hand onto the controller, the tips of your fingers correspond to your mouth and your forearm corresponds to the back of your throat. The more you press down, the more you open that part of the throat. Currently, this synth can only control vowel sounds, but it does so fluidly; you don’t choose between one vowel or another, but you move fluidly between them through different gestures. This allows for more variation in inflection and emphasis.

For video, more info and other acoustic works see – Gestural speech synth

Related:
Scrollbar Scarf
Also from the same maker – Scrollbar ScarfUpdated Link


  • nelsonii

    I love how he connected the strings to sliding pots and then “spring” loaded them (with rubber bands). Very inventive.

  • Tom

    How is the scrollbar scarf related to this ?

  • Collin Cunningham

    the scarf is work from the same maker

  • Volkemon

    @ Tom- I was wondering too, but have a ‘related peeve’ anyway.

    @collin- thanx for the answer. I must have missed the ‘from the same maker’ (MAKEr…;) link before…maybe not. I looked close to try to figger out the ‘related’ content of the scarf.

  • Collin Cunningham

    I added that little explanation after Tom asked
    We appreciate the input!