Infrastructure at MTDML
In addition to a new eye tracking system from PupilLabs, the perception lab offers various physiological measurement systems from MindMedia (EEG, muscle tension (sEMG), heart rate, relative blood flow, skin conductance, respiration, temperature, etc.) and a wireless EEG system from Brain Products with up to 64 channels (LiveAmp 64 System). There is an acoustically optimized room (incl. a mobile anechoic chamber) for performing the measurements.
Visual stimuli can be presented via a mobile pressure-sensitive interactive 86" video screen and various VR glasses (currently 4x Oculus Quest Pro, 10x Oculus Quest 2, 2x HTC Vive Pro Eye, 1x HTC Vive Focus 3, 1x PICO 4). In addition to different bone conduction headphones from Shokz, various headphones from Sennheiser, Beyerdynamic and AKG, electrostatic headphones from STAX and a digitally controllable multi-channel system from Genelec (SAM series) are available for auditory stimuli.
The XR-Lab primarily focuses on research in the field of Acoustical Extended Reality (AXR), i.e. the use of virtual, augmented or mixed reality technologies in connection with acoustic (here: mainly music-related) research questions.
In addition to a motion capture system from OptiTrack with 13 cameras and a synchronized eye-tracking system, various VR/AR systems (currently 4x Oculus Quest Pro, 10x Oculus Quest 2, 2x HTC Vive Pro Eye, 1x HTC Vive Focus 3, 1x PICO 4), a DSP multi-channel speaker system, a dodecahedron with individually controllable speakers and several 3D-scanners (Revopoint POP & Revpoint POP 2) are available.
Computer Audition Lab
Computer Auditon (CA) uses methods from the field of artificial intelligence (AI) to obtain semantic information from audio files, e.g. determination of the genre or recognition of emotions. Another emerging subject in this area is that of computational creativity (CC). CC is a multidisciplinary field that seeks to obtain creative behavior from computers - in our lab, this primarily means music generation.
For these mostly very GPU performance intensive methods we have 5 prototyping systems with 1 NVIDIA RTX 3090 and 4 RTX 3080 GPUs in our lab and we also have direct access to the 2021 newly implemented High Performance Cluster of the University of Osnabrück with 2 nodes with 4 NVIDIA A100 80 GB Tensor-Core GPUs each.
The recording studio consists of a separate control and recording room. In addition to the standard equipment infrastructure of a recording studio, a wide range of electronic (e.g. EMS VCS 3, Synthi E and Synthi 200, a variant of the Synthi 100), acoustic (grand piano, drums etc.) and hybrid (e.g. Disklavier) instruments are available.
There is also a mobile recording studio with which the concerts of the numerous ensembles, choirs and bands or the symphony orchestra of the institute are regularly recorded.
In addition to workplaces for 22 people with Windows, Linux and MacOS notebooks/workstations, the MTDML workspace also includes a 3D printer (Ultimaker 3 Extended) and an electronics workplace (microcontrollers, sensors etc.). The MTDML workspace is used for seminars and practical courses as well as for individual project work.
The room is also equipped with a video mixing console and multiple cameras from Blackmagic for hybrid seminars, video conferencing and live streaming events.