Singing Speech Synthesizer With Theremin-Like Controls

Craft & Design Music Technology
Singing Speech Synthesizer With Theremin-Like Controls
YouTube player

The embedded video is a collection of soundbytes that give a good general background of the Glove-TalkII system from Sidney S. Fels and Geoffrey E. Hinton.at The University of British Columbia. But the brief samples of the system in operation that it includes are, frankly, not a great advertisement for its capabilities or its potential. The best videos don’t seem to be available as embeds, yet, and to really appreciate how Glove-TalkII works, I recommend following this link to download a short AVI clip from the project homepage, showing operator Sageev Oore “singing” the alphabet song using hand gestures.

As with a Theremin, pitch is controlled by hand position in space. Closed-finger gestures, with one hand, create voiced consonant sounds, while open-finger gestures with the same hand give sustained vowel sounds. Hard stops, like “puh” and “buh” and “tuh,” are controlled with the fingers of the opposite hand. Looks like lots and lots of fun. [Thanks, Laura!]

Discuss this article with the rest of the community on our Discord server!
Tagged

I am descended from 5,000 generations of tool-using primates. Also, I went to college and stuff. I am a long-time contributor to MAKE magazine and makezine.com. My work has also appeared in ReadyMade, c't – Magazin für Computertechnik, and The Wall Street Journal.

View more articles by Sean Michael Ragan

ADVERTISEMENT

Ready to dive into the realm of hands-on innovation? This collection serves as your passport to an exhilarating journey of cutting-edge tinkering and technological marvels, encompassing 15 indispensable books tailored for budding creators.

FEEDBACK