Live audio processing?

[telefunkenvf14]

Can anyone provide some ideas/guidance on processing live audio in Mathematica?

As an example, I'd like to feed it audio from a microphone (on my Windows 7 laptop), compute the FFT and display the frequency spectrum in real time. I have some guesses as to how one might go about this---temp .WAV files and reading in blocks of raw binary data---although perhaps there are lower level OS functions that would work better.

-RG

[Kathy_Bautista]

Can anyone provide some ideas/guidance on processing live audio in Mathematica?

As an example, I'd like to feed it audio from a microphone (on my Windows 7 laptop), compute the FFT and display the frequency spectrum in real time. I have some guesses as to how one might go about this---temp .WAV files and reading in blocks of raw binary data---although perhaps there are lower level OS functions that would work better.

-RG

Currently Mathematica does not contain any built-in functionality to process live audio like it can with live video using the CurrentImage command. But if you could send me additional details, I can file a suggestion to our developers on your behalf to see if it can be incorporated into a future version.

For those of you who aren't aware of the CurrentImage function, check out a recent blog post from my colleague Jon McLoone, who used Mathematica to make a webcam intruder alarm. Cool stuff!
http://blog.wolfram.com/2010/11/10/how- ... athematica

-Kathy

[telefunkenvf14]

Can anyone provide some ideas/guidance on processing live audio in Mathematica?

As an example, I'd like to feed it audio from a microphone (on my Windows 7 laptop), compute the FFT and display the frequency spectrum in real time. I have some guesses as to how one might go about this---temp .WAV files and reading in blocks of raw binary data---although perhaps there are lower level OS functions that would work better.

-RG

Currently Mathematica does not contain any built-in functionality to process live audio like it can with live video using the CurrentImage command. But if you could send me additional details, I can file a suggestion to our developers on your behalf to see if it can be incorporated into a future version.

-Kathy

I think I'd just need some help accessing audio streams as they're being recorded, and some practical advice on how to implement the related audio processing efficiently in MMA (which may not even be possible--don't know if the front end could keep up or not---maybe CUDA would make it doable, if I ever get CUDA running on my machine....) For example, if I'm recording an audio file in REAPER (digital audio workstation software), there may be a way to read the binary data as it's being continuously dumped into WAV format on my harddrive. Then again, I may have to use some confusing Windows audio API (doesn't look that easy to me ) and live with audio from a crappy, built-in soundcard.

Another alternative would be to try and access streaming binary data directly from my firewire based audio interface. It's a Fireface 800, made by RME.

While I'm wishing... can you prod a developer to put MIDI *IMPORT* on the to-do list?

-RG

(Edited to request midi import... it was late when I made the original request!)

[Clemens_Dempers]

I have also wondered about a live audio feature. Thought that if it is available for video, audio should also be there.