Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Audio processing #3

Open
greglook opened this issue Jul 26, 2014 · 3 comments
Open

Audio processing #3

greglook opened this issue Jul 26, 2014 · 3 comments
Assignees
Milestone

Comments

@greglook
Copy link
Member

Use Minim (or some equivalent library) to provide audio-processing to the wonderdome. This will ideally provide both beat-detection and very basic frequency power bands via the Fourier transform. This is likely to be performance intensive, so will need lots of tuning.

This component would be another type of input, which would send events like the following:

{:type :audio/beat
 :power 0.8444}

{:type :audio/freq
 :elapsed 138 ; ms
 :power [0.662, 0.328, 0.153, 0.989, ...]}
@greglook greglook self-assigned this Jul 26, 2014
@greglook greglook added this to the BM-2014 milestone Jul 26, 2014
@greglook
Copy link
Member Author

Looks like someone put 2.2.0 on clojars already: https://clojars.org/ddf.minim

@greglook
Copy link
Member Author

greglook commented Aug 1, 2014

Needs to be fleshed out more, but basic audio input is in! c187014

Next steps:

  • Wire it up to the rest of the system during construction.
  • Polish the test harness code.
  • Experiment with windowing functions in the FFT.
  • Experiment with rolling-average power levels rather than instantaneous values.

@greglook
Copy link
Member Author

Two more tasks:

  • Install the physical microphone
  • Write a tunes mode which responds to audio input as a proof-of-concept

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant