Past Development Projects
I have been a Senior Staff Research Engineer and team manager at Qualcomm, focused on the perceptual and technical aspects of immersive audio and extended reality technologies.
Use headphones for playback
ViMiC – Virtual Microphone Control
ViMiC is a spatial sound projection system based on recording principles used by audio engineers.
Developed in collaboration with Communication Acoustics and Aural Architecture Research Laboratory, RPI.
- Standalone demo (mac only)
- External for Max/MSP via Jamoma.org
- Jamoma Modules for ViMiC via github, or via UserLib installer
Audio Unit plugin
The Spatial Sound Description Interchange Format (SpatDIF)
I initiated SpatDIF, a format to describe spatial audio information in a structured way. This open format is under development, more under www.spatdif.org.
Content Analysis of spatial sound scenes: separation, classifying and tracking of sounding objects and acoustical properties in 3D
I worked on a real-time analysis framework for large scale microphone arrays which can be used for spatial audio content production and for retrieving acoustical scene information from the environment. This project was supported through a DAAD scholarship.
SOFiA – sound field analysis toolbox for MATLAB
Compositional Applications of Auditory Scene Synthesis in Concert Spaces via Gestural Control
- Project description [video]
- Concert-photos of world premier of “Ex Asperis” by Canadian composer Sean Ferguson
- In collaboration with IDMIL, MPCL, and DCS
Eureka! Science Festival
Creation of a spatialization system with interactive soundscapes for different age groups.
TrakHue – Gestural Control of Live Electronics
DJ Spat – Spatial Interaction for DJs
A system for mixing sound in space through motion-tracking of DJ gestures.
ICAD 2006 Telematic Music Performance
A multinational telematic concert performance led by the late Pauline Oliveros between McGill University (Canada), Rensselaer Polytechnic Institute Location (US, New York State), Stanford University Location (US, California), KAIST (South Korea).
- Program notes [ pdf ]
- Project description and score [ pdf ]
- Video excerpt
- In collaboration with CA3RL, CCRMA, and KAIST
A wireless binaural headphone using ultrasound headtracking
This thesis describes a wireless head-tracking system based on ultrasonic optimized to be used within a rear-seat car entertainment system in combination with a video screen. Negative effects of acoustic reflections and measurement noise were reduced and computational complexity was optimized for long battery life. A variety of DSP algorithms are evaluated for this specific task using a real-time testing environment implemented in Pure Data (PD) and compared with a wired Polhemus position tracker (see image).
Acoustical Modeling and Analysis of the St. Stephans Cathedral Vienna
Design of CATT-Acoustics model to guide acoustical improvements for choir performances during the Mozart Year 2006.