Adventures in 3D Sound: Bach and Binaural Recording

Friday, April 29, 2011 - 06:00 AM

Dummy head Edgar Choueiri and Fritz (Frank Wojciechowski)

Edgar Choueiri's digital audio filter can take almost any recording and turn it into 3D — stereo tracks take on new depth and sound amazingly realistic after a quick pass through his algorithm.

But the only way to experience perfectly realistic 3D audio is by listening to a binaurally recorded track. Binaural recording follows the same principle as a 3D camera, which simultaneously captures a scene from two slightly different vantage points — one from the perspective of each of your eyes. Instead of two camera lenses, binaural recording uses two microphones inside the ear canals of a dummy head. At Princeton University's 3D Audio and Applied Acoustics Lab, Choueiri has two dummy heads: one from the German company Neumann (famous for its high-quality microphones) which he calls Fritz, and another from Denmark named Lars. 

A binaural recording captures sound exactly as you would hear it live, through just two channels. When Kurt Andersen visited Choueiri's lab, he made a binaural recording using Fritz, which was later processed for perfect 3D realism by Choueiri's filter.

Video: A First Listen to 3D Sound

Choueiri has also applied his algorithm to existing stereo recordings.  You can experience Bach's Mass in B minor in full 3D glory below — plus, to hear exactly how the algorithm changes the sound, we've posted a section in which Choueiri's filter switches on and off.  

Audio: Mass in B minor, Cum Sancto Spiritu, Johann Sebastian Bach (3D for speakers)


Audio: Mass in B minor, Cum Sancto Spiritu, Johann Sebastian Bach (3D filter on/off)

As you listen, the sound image you'll hear won't be quite the same as being in a hall with the performers. That's because in stereo recordings like this one, the instruments and voices have been recorded with lots of different microphones and then placed in your left and right ears (using panning) by the person who mixed that recording. Because of crosstalk (when sounds intended for your right ear end up in your left ear, and vice versa), that placement ends up sounding less precise to the ear — in other words, if the sound was a picture, the crosstalk makes it fuzzy. Choueiri's algorithm eliminates that effect, and lets you experience the acoustic space exactly as that audio engineer reconstructed it — it sharpens the image and gives it added depth and texture. It's still not real life, but it sounds pretty darn close.

Tags:

More in:

Comments [9]

Steve Weiss from Santa Rosa, CA

Thanks for sharing. There is a great article about Choueiri's work and other aspects of listening to music in the January 28, 2013 New Yorker Magazine.

Jan. 29 2013 06:42 PM
DPLblog from Berks County, PA

IT sounds like this is meant to represent the feeling of live music specifically. What about processed music, or digitally created sound art like <a href="http://cleanstudio.blogspot.com/2013/01/untitled.html">9 Beet Stretch</a>, which is Beethoven's 9th Symphony stretched to last a full 24 hours. This music takes place in time, but not really in space.

Jan. 24 2013 02:33 PM
Dan Howes from B.C Canada

hey! This is simply BRILLIANT! I engineer and produce music for a living and what this could possibly do for modern music, mixing songs for this depth of sound and realism has amazing potential.

Do you think we could hear some rocknroll with the filter on it? Pink Floyd, or Zep maybe

May. 17 2011 11:29 PM

@Wayne: The website underwent some maintenance last night, and it seems the retooling may have inadvertently dropped some of the audio. Everything should be back up now!

May. 10 2011 11:06 AM
Wayne from New Jersey

It seems (at least for me) that the links are now missing for all the audio clip examples for 3D audio.

May. 09 2011 09:27 PM
carolyn from Tennessee from tennessee

I thought the sound was amazing, I do not generally enjoy listening to such deep, warm music on my sounds systems, but, if you close your eyes, this could let you image being in the best seat in the hall!

May. 08 2011 11:40 AM

I prefer the quality without processing. there is an audible loss of clarity using the 3D filter.
Spatial clues, timbre etc is eliminated. Also very Ping Pong! May be suitable for general consumption but I think this degrades quality far too much for me to be enthusiastic plus the economic reality of Feature production with just one binaural mic set up would be a commercial nightmare!

May. 06 2011 06:30 PM
djohn from Studio 360 djohn

Hi Fredrik,

Edgar has the ability to tweak his 3D filter for a variety of listening environments. In this case, he used a fairly universal filter suited for a wide range of speaker positions. The upshot is a bigger sweet spot with a slightly less precise 3D sound stage. Thanks for listening!

May. 03 2011 04:27 PM
Fredrik from Stockholm

This sounds very impressive. How sensitive is the listening position relative the speakers?

May. 03 2011 10:26 AM

Leave a Comment

Register for your own account so you can vote on comments, save your favorites, and more. Learn more.
Please stay on topic, be civil, and be brief.
Email addresses are never displayed, but they are required to confirm your comments. Names are displayed with all comments. We reserve the right to edit any comments posted on this site. Please read the Comment Guidelines before posting. By leaving a comment, you agree to New York Public Radio's Privacy Policy and Terms Of Use.

Supported by

Supported by

Feeds