This interface is a visualisation and a manipulation tool to transcribe rhythmic patterns from an audio stream to a simple step sequencer representation and manipulate it. The user can switch from one to another in the same graphical interface The visualization function provides an interface displaying a pattern of one bar as a matrix. The vertical lines of the matrix correspond to the beats and sub-beats of the pattern (typically a sixteenth of the given bpm) while the horizontal lines represent each one of twelfth rhythmic tracks. The matriks are automatically filled according to the occurrence of an event on a certain beat of a certain rhythmic track. The rhythmic tracks correspond to frequency bands of the incoming signals, which give an approximate transcription of the polyphonic rhythmic content of the incoming audio signal.
The user can interact with the matriks in 3 different ways:
- adjust frequency gain for each of the twelve frequency bands, with a dial button,
- superimpose a sound beat synchronous, track depending by selecting a case of the matrix. The user can choose beetween standard beat box samples and adjust their volume. This way he can for instance superimpose samples where the energy is high and better understand the audio content. A button with an "automatic filling" function can fill the matriks regarding the energy level and superimpose samples to the original sound.
- a slider called "Filter" makes a temporal filtering : preserving or cutting only the point selected in the matriks.
Responsible partners/teams: IRCAM Real-time Applications and IRCAM Hypermedia Studio teams
- Schnell, N. and al. "FTM — Complex Data Structures for Max/MSP" In Proceedings of the International Computer Music Conference (ICMC), Barcelona, Spain, 2005
- Schnell, N. and Schwarz, D. "Gabor — Multirepresentation Real-Time Analysis/Synthesis" In Proceedings of the 8th International Conference on Digital Audio Effects (DAFx’05), Madrid, Spain, 2005