OUT OF YOUR HEAD – Part 3
Virtual: 1. being something in effect, though not so in name; for all practical purposes; actual; real.
Audio: 1. of hearing; 2. of sound.
Virtual Audio: 1. sound that is specially processed to contain significant psycho-acoustic information to alter human perception into believing that the sound is actually occurring in the physical reality of three-dimensional space.
This month, I would like to talk about the different ways the Virtual Audio Processing System was used to process audio into a spatialized sound field. This system was very advanced for the time (1991) and the results still stand up remarkably well today. Please read “Out Of Your Head Part 2” for the hardware background information on the Virtual Audio Processing System.
WHAT IS VIRTUAL AUDIO?
Virtual Audio is a process of encoding audio in three dimensions, passively or interactively. Virtual Audio requires no special decoding equipment and provides a very accurate model of our hearing process. Virtual Audio is so accurate that the listener cannot distinguish Virtual Audio recorded sound from reality. Playback can be experienced on stereo, surround speakers or standard headphones.
The Selective Hearing Process:
In the field of audio, the selective hearing process is fundamental to stress-relief. The selective hearing process in the human auditory system is the ability of the brain to tune into audio cues and tune out unwanted audio cues in the listener’s environment. Selective hearing means listening only to audio cues that the listener wants to hear and not to those he does not want to hear, all at the same time. Sometimes this is called “the cocktail effect”. The selective hearing process can be conscious or subliminal. When recording with normal recording technology, the selective hearing process is lost because the specific information for brain to process audio spatially is not encoded. The human brain can no longer selectively hear. The brain will try very hard to distinguish individual audio cues or try to break down the basic components of the audio cues, but will be unsuccessful. Since normal recording methods do not encode the three-dimensional spatial cues necessary for the brain to carry out the selective hearing process, the brain will be unable to pull apart or selectively hear different component audio cues. The exception being that, if the volume of a specific audio cue is very loud, the brain will then be able to perceive the louder sound. Cues that are the same approximate volume will all blend in together.
Since the brain is trying very hard to decipher different sounds unsuccessfully, a type of stress is induced. The medium of standard audio technology itself actually induces stress. This stress will inhibit the listener from being emotionally involved with the audio cues optimally. With the use of Virtual Audio, the natural phenomenon of selective hearing is retained in the recording process.
Numerous audio cues that are moving in a sound field, which have been recorded using normal audio recording techniques can become confusing to the brain, since the listener cannot selectively hear specific sounds. When using Virtual Audio technology, the listener can selectively hear many sounds, stationary or moving without confusion. Sound encoded in Virtual Audio enables the human brain to do what it normally does in nature: to selectively hear various component audio cues in the listening environment.
Virtual Audio encoded material inherently contains much more information to be processed by the human brain than normal audio. The result is greatly enhanced communication and emotional response from the recording by using Virtual Audio technology. When recording the sounds of nature or music, the use of the Virtual Audio process is very important, and in fact, fundamentally necessary for relaxation, meditation and the relief of stress.
Since a majority of my current work is using sound to expand consciousness, understanding this information cannot be underestimated. All my work has to be encoded into 3-D as a fundamental requirement.
THE VIRTUAL AUDIO RECORDING PROCESS
The basic procedure of using the Virtual Audio Processing System (VAPS) in the recording process involved sending a mono audio source through a channel of the VAPS computer and then positioning the sound in a 360 degree space. Instead of the traditional panning of the left/right stereo field, VAPS allowed a 360 degree panning capability. VAPS also allowed the construction of each wall of a Virtual Room as well as the ability to locate those walls anywhere in a 360 degree space.
For the recording artist, producer or engineer, an understanding of the VAPS recording process is necessary for the best results. There are five basic levels of processing. At the higher level, a Virtual Audio environment can be created that is indistinguishable from reality. At the lower level, the result is Spatially Enhanced Stereo (SES), which has much more width, height, depth and clarity than the original stereo recording. Listed below, from elementary to complex, are the five levels of VAPS processing:
SES Process:
The first level of processing is called the SES Process. This process involved taking a two-track finished master and processing it through the VAPS. A two-track recording could be processed in such a way that the width is expanded past the stereo speaker field. The depth and clarity were greatly enhanced. Vertical information could be heard as well. The feeling of being immersed in a 360 degree sound field was presented on headphones. The exact translation of the sound field is directly proportional to the production characteristics of the recording. This process was very easy, fast and very affordable.
SES Mix Process:
The second level of processing was called the SES Mix Process. This process is similar to the SES Process except it is done at the actual mix stage of the recording. The VAPS was placed on the stereo output of the mixing console before the two-track recorder. The advantage of this method is more precise control of the placement of each sound source in space. By having more individual control of each sound source, a more three-dimensional recording can be accomplished. This process was very cost effective for professional recording.
SES Mix-Plus Process:
The third level of processing was called the SES Mix-Plus Process. It is a combination of the SES Mix Process and the Multi-Track Process (see below). The advantage of this method is that it still has the time and cost effectiveness of the SES Mix process, with the addition of three-dimensional room simulation and special effects such as sound moving around or over your head. The motion of individual sound sources is possible. The SES Mix-Plus Process was used for professional recording when special effects are desired.
Multi-Track Process:
The fourth level of processing was the Multi-Track Process. This process allows individual control of each sound source as well as three-dimensional room simulation for each sound source. The Multi-Track Process is the most advanced of the Virtual Audio processes. It does require more time than the other levels since much more detail is possible when locating sound sources and designing virtual room spaces. Using this method, proximity effects can be created. Proximity is the effect of sound moving close and moving away from the listener. The Multi-Track Process was used for professional recording applications where the most control and effect in creating realistic Virtual Audio environments was required.
Virtual Audio Live Recording Process:
The fifth level of processing was the Virtual Audio Live Recording Process. Using the Virtual Audio Live Recording Processor (a special type of artificial head), live location recording can be accomplished simply and easily. The recording is a complete 360 degree virtual recording of the actual event. This process is used in live situations where the VAPS computer was not appropriate. The live Virtual Audio recording, when utilized correctly, is quite impossible to distinguish from reality.
Like the VAPS computer, Virtual Audio Live Recording was totally compatible on speakers and headphones. This method was very easy, convenient and was cost effective.
All levels of processing were completely compatible with each other. Any combination of these different processes will combine with each other without any artifacts such as phase shift or smearing of the audio image. All the Virtual Audio processes were compatible in mono. Although the Virtual Audio effect cannot be achieved in mono, the clarity and intelligibility of the sound sources could be dramatically improved.
By understanding these different levels of processing, the end application and the playback medium (speakers, headphones, surround-sound systems, etc.) would insure the optimum result using the VAPS computer.
Advantages of VAPS Process (over normal audio):
Imaging was excellent, including depth and height whether playback was in the usual equilateral-triangle stereo listening situation or in a narrow-stage arrangement, such as loudspeakers flanking a television screen. Listening area was wide, without sharp sweet-spot limitations.
A good approximation of a Virtual Audio presentation could be made available by using four loudspeakers: a front pair and a pair to the sides or behind the listening position. The second pair received the same signals as the front pair, at a slightly reduced level. No signal processing was required.
Headphone listening of Virtual Audio was excellent, and a complete 360 degree immersed sound field could be obtained. Virtual Audio removed the annoying “in the center of your head” feeling that is common with headphones and exteriorized all the sounds outside your head.
Mono playback was also not compromised due to the amplitude and phase flatness of the VAPS technology. Although the spatial quality was lost, intelligibility was greatly enhanced.
Application Summary:
When mixing-down several sound sources recorded on a multi-track recorder, VAPS could be used on every track to design a sound field particular to each sound source. These various tracks where then mixed down to a normal two-track stereo master. The master mix could then be used directly for CD recordings, video sound tracks, or stereo broadcasting on TV and FM radio bands. Home audio enthusiasts could enjoy an unsurpassed Virtual Audio environment on their conventional stereo headphones or speakers, hearing full reproduction of the artist’s or producer’s original intention. Another notable application of Virtual Audio was in the manufacturing of video and multi-media software for the consumer market. These types of products could offer Virtual Audio sound tracks, which recreate the effects experienced in a movie theater with amazing realism.
I saw further potential applications in a wide range of fields: Virtual Audio processing of conventional recordings and remixing for two-channel speaker reproduction; processing of video game sound; and processing of sampled sound sources for electronic musical instruments.
I created many more special techniques for spatialized audio such as a biofeedback system to help focus attention on specific brainwaves to advance the healing process of disease such as cancer. I also designed a system to use spatial sound techniques combined with ultrasound to help blind people see/hear their environment. I assembled all that data and applied for a patent in April 29, 2002. You can check the patent info here:
http://www.google.co.ug/patents/US20030007648
The Present
Over time, as computer power became more available and software more accessible, the VAPs concept evolved radically. Today, in my recording studio, I am using proprietary software on a new MacPro platform to render 3-D spatial environments. I am using a HeadAmp Blue Hawaii electrostatic amplifier with two Stax SR-009 electrostatic headphones along with an Antelope Zodiac DAC for critical monitoring. The software allows me to build virtual rooms using computer graphic modeling and design the acoustic properties of each room in 3-D. This system is far more accurate and detailed than the original VAPS. The original VAPS could only render 4 channels of spatial sound in realtime. The new VAPS can render up to 256 channels in realtime! The original VAPS could only process audio at 24 bit at 44.1 kHz and 48 kHz sample rates. The new system allows me to process in 32 bits and up to 192 kHz sample rates!
Next month, I will discuss my current Virtual Audio Processing System in more detail.
See you next month here at the Event Horizon!
You can check out my various activities at these links:
http://transformation.ishwish.net
http://currelleffect.ishwish.net
http://www.audiocybernetics.com
http://ishwish.blog131.fc2.com
http://magnatune.com/artists/ishwish
Or…just type my name Christopher Currell into your browser.
Current Headphone System:
Woo Audio WES amplifier with all available options, Headamp Blue Hawaii with ALPS RK50, two Stax SR-009 electrostatic headphones, Antelope Audio Zodiac+mastering DAC with Voltikus PSU, PS Audio PerfectWave P3 Power Plant. Also Wireworld USB cable and custom audio cable by Woo Audio. MacMini audio server with iPad wireless interface.
Want to join discussion?
Feel free to contribute!