Singing Speech Synthesizer With Theremin-Like Controls

Craft & Design Music Technology
Singing Speech Synthesizer With Theremin-Like Controls
YouTube player

The embedded video is a collection of soundbytes that give a good general background of the Glove-TalkII system from Sidney S. Fels and Geoffrey E. Hinton.at The University of British Columbia. But the brief samples of the system in operation that it includes are, frankly, not a great advertisement for its capabilities or its potential. The best videos don’t seem to be available as embeds, yet, and to really appreciate how Glove-TalkII works, I recommend following this link to download a short AVI clip from the project homepage, showing operator Sageev Oore “singing” the alphabet song using hand gestures.

As with a Theremin, pitch is controlled by hand position in space. Closed-finger gestures, with one hand, create voiced consonant sounds, while open-finger gestures with the same hand give sustained vowel sounds. Hard stops, like “puh” and “buh” and “tuh,” are controlled with the fingers of the opposite hand. Looks like lots and lots of fun. [Thanks, Laura!]

6 thoughts on “Singing Speech Synthesizer With Theremin-Like Controls

  1. Austin.Y says:

    Lol @ 4:10

    “potentially you could actually watch somebody’s movements (wiggles hands), and understand what they’re saying…without any sound”

    Too bad no one has ever come up with a language that accomplishes that…

  2. Andrew Sayler says:

    This concept was introduced by H. W. Dudley, R. R. Riesz, and S. A. Watkins in an article called “Synthetic Speaker” in the Journal of the Franklin Institute, vol 227, June 1939.
    Dudley worked extensively in the Bell Labs, where he laid the groundwork for various vocal compression techniques. The apparatus in the video bears much resemblance to what Dudley named the “Voder” His Voder “contained 10 contiguous band-pass filters which covered the speech band. These filters were activated by volume controls operated by finger keys. Three additional finger keys provided transient excitation of the selected filters for stop-consonant sounds. The filter was supplied with either a noise or buzz oscillator. A pedal controlled the pitch of the buzz oscillator.” (“ITT Reference Data for Radio Engineers”, Fifth Edition, 1968)
    It’s interesting to see someone applying modern technology to concepts that were not practical within the technology of their day. Bravo!

  3. MAKE | Playing A Human Theremin says:

    […] MAKE | Singing Speech Synthesizer With Theremin-Like Controls […]

Comments are closed.

Discuss this article with the rest of the community on our Discord server!
Tagged

I am descended from 5,000 generations of tool-using primates. Also, I went to college and stuff. I am a long-time contributor to MAKE magazine and makezine.com. My work has also appeared in ReadyMade, c't – Magazin für Computertechnik, and The Wall Street Journal.

View more articles by Sean Michael Ragan

ADVERTISEMENT

Maker Faire Bay Area 2023 - Mare Island, CA

Escape to an island of imagination + innovation as Maker Faire Bay Area returns for its 15th iteration!

Buy Tickets today! SAVE 15% and lock-in your preferred date(s).

FEEDBACK