Jump to content
Sign in to follow this  
  • entries
    30
  • comments
    12
  • views
    706

WoP #27: Auditory Illusions

Sign in to follow this  
SgtLongcoat

72 views

Ever heard a song or some other set of sounds and thought you could make out some sound or phrase that, on close examination, wasn't really there? I'm not talking about misheard lyrics, but lyrics that didn't even exist at a point in a song. Well there's a reason for that. The reason is that, due to the way the song is layered, a specific set of frequencies that the song's instruments play is close enough to the set of frequencies that would be heard if a human were talking, that the brain can perceive it as such.

Don't believe me? Here's a video of various songs broken up into sets of notes based on the frequencies in their audio files, and then played solely on a virtual piano. There is no other instrument being played here, simply a piano. See how much if it you can make out:

No, the video doesn't just consist of All Star, but it is a common enough song that you should be able to pick out at least some of the lyrics. So, why exactly does this work?

As a human speaks, the frequency of their voice changes in order to create the sounds of various sets of letters. At the same time, their voice cuts in and out, also to get the proper sounds of the syllables being said, to make it more smooth. By copying these frequencies precisely at the precise times they occur, it's possible to use any instrument in order to simulate human speech patterns, thus creating the illusion of a voice being heard.

This not enough to convince you that a computer could mimic a human voice? Look up a video of a neural network analyzing human speech. It can actually get pretty freaky to listen to.

Sign in to follow this  


0 Comments


Recommended Comments

There are no comments to display.

Create an account or sign in to comment

You need to be a member in order to leave a comment

Create an account

Sign up for a new account in our community. It's easy!

Register a new account

Sign in

Already have an account? Sign in here.

Sign In Now

Terms of Use

The pages of APlusPhysics.com, Physics in Action podcasts, and other online media at this site are made available as a service to physics students, instructors, and others. Their use is encouraged and is free of charge. Teachers who wish to use materials either in a classroom demonstration format or as part of an interactive activity/lesson are granted permission (and encouraged) to do so. Linking to information on this site is allowed and encouraged, but content from APlusPhysics may not be made available elsewhere on the Internet without the author's written permission.

Copyright Notice

APlusPhysics.com, Silly Beagle Productions and Physics In Action materials are copyright protected and the author restricts their use to online usage through a live internet connection. Any downloading of files to other storage devices (hard drives, web servers, school servers, CDs, etc.) with the exception of Physics In Action podcast episodes is prohibited. The use of images, text and animations in other projects (including non-profit endeavors) is also prohibited. Requests for permission to use such material on other projects may be submitted in writing to info@aplusphysics.com. Licensing of the content of APlusPhysics.com for other uses may be considered in the future.

×