Digital Signal Processing and System Theory

Talk Hannes Hinkelmann

saaa Real-Time Auralization of electrical brain acitvity

Date: 15.05.2014, 13:00 h - 13:30 h
Room: Aquarium

Hannes Hinkelmann
CAU Kiel, Germany


The main purpose of this project is to generate acoustic signals by using EEG Data (Electroencephalography). We distinguish between the two submodules Direct and Indirect Auralization. The Direct Auralization takes the EEG data of several input channels to modulate the frequency of an adjustable carrier signal (Frequency Modulation). Changing the modulation parameters influences the impact of the EEG input on the frequency range of the audio output. By using several speakers and putting the modulated signals of different channels to spatially distributed loudspeakers we get a solid impression about the electrical activity of different parts of the brain. The Indirect Auralization uses control signals which are extracted by a Brain Computer Interface (BCI) from the EEG data to play music. Eye blinking for example creates a recognizable and detectable pattern which can be used. The main idea is to create a user friendly software which allows physically disabled people to control music. We have a few sets of several overlayable and dubbed wave tracks for different music styles. The user dictates the software the construction of the beat for each style by using eye blinks. He can select successively which tracks he wants to activate or deactivate.