I started working on a new audio processing application that will be a completely different type of sound effects. It is not even quite the sound effect as it is usually understood. It is something between a sound effect and a musical instrument or sound generator.
This application will also process the source signal, but unlike the usual audio effects, it does this based not on static parameter values, but on the basis of determining the internal structure of the input signal over time.
In classic sound effects, even if they dynamically react to changes in the amplitude or even the spectrum (which is much less common) of the signal, all processing is determined by a set of static parameters. It doesn't matter that these parameters can be changed by the LFO, since the LFO parameters are still static in relation to the structure of the input signal. In that effects, you know (mostly) how to change the input signal depending on the change in these parameters.
In my new app, signal processing will be determined by the time-varying structure of the signal itself.
This app analyzes the spectrum of the input signal and, based on statistical processing of data vectors and self-balanced feedbacks, reveals new fragments appearing in the input signal. Next, the fragments of the input signal will be reassembled in a different order by the genetic algorithms that will create the best (from their point of view) composition based on the contents of these fragments and some specified rules of creation the composition.
The result should be quite unusual. But this is not a mainstream effect. This is an app for pure creativity and experimentation. You influence the result not by the settings (although they will also be), but by the character and rhythm of the input signal.
Imagine that you can provide to the input both finished compositions and tracks, as well as mixes of sounds of various musical instruments (modular synths will be just great), sounds of nature and noises, and on the output will be a composition built from fragments of these sounds according to the new dynamic rules.
This is a preview of the work of the first part of this app, which finds new fragments in the spectrum of the input signal, linking their appearance to the internal rhythm as much as possible. The parameters in the left corner are adjusted via self-balancing feedback.
While this application is still under development, take a look at my other sound processing and experimental apps:
Classic FX - A complete sound effects processor and a mono to stereo converter with equalizer, effects and reverb, based on specially designed high-quality processing algorithms and suitable for any kind of audio sources. Classic FX will add brightness and expand the sound space of any instrument from recorded musical instruments to software and even modular synthesizers.
SynthScaper - Synthesizer specially designed for creating and experiments with ambient soundscapes in wide range from noises to melodic instruments and everything in between.
SynthScaper LE - The special lightweight version of SynthScaper LE lets you easily create and modify your own multi-timbral pads and atmospheric soundscapes.
FieldScaper - Advanced field recorder combined with a sound warp engine and a collection of ready to use dynamic presets for iPad and iPhone. Discover new ways to create and construct unusual and exciting sounds from any environmental audio recordings or samples recorded from other apps.
SoundScaper - SoundScaper is an experimental sound mini lab for creating unusual soundscapes, atmospheric textures, drones, glitches and noises based on circuit bending principles.
