Equipment: MTDML | Music Technology and Digital Musicology Lab

Das Bild zeigt einen Serverraum. Im Vordergrund ist ein Wagen mit einem Bildschirm, Tastatur und Maus zu sehen. Auf der rechten Seite sind mehrere Serverschränke zu sehen, die hinter perforierten Türen angeordnet sind.

Computer Audition Lab

Computer Audition uses methods from artificial intelligence and machine learning to extract semantic information from audio data. Examples include the automatic classification of musical genres and the recognition of emotions.

Another key research area is Computational Creativity. This multidisciplinary field investigates how creativity can be modelled, simulated, imitated, and better understood with the help of computers. In our lab, the primary focus is on computer-generated music.

For these typically highly compute- and GPU-intensive methods, our lab provides six prototyping systems equipped with NVIDIA RTX PRO 6000, NVIDIA RTX 3090, and NVIDIA RTX 3080 GPUs. In addition, we have direct access to the High-Performance Computing Cluster of Osnabrück University, which was newly established in 2021. The cluster comprises eight NVIDIA A100 Tensor Core GPUs with 80 GB of memory each, eight NVIDIA H100 GPUs, and 51 CPU compute nodes with 128 CPU cores each.

Das Bild zeigt eine Nahaufnahme eines Audiomischpults in Schwarz-Weiß. Zu sehen sind zahlreiche Regler und Schieberegler, die in mehreren Reihen angeordnet sind. Die Drehknöpfe und Tasten sind gleichmäßig auf der Oberfläche des Mischpults verteilt, und die Schieberegler befinden sich auf einer separaten Ebene.

Recording studio

The recording studio consists of a separate control room and recording room. In addition to the standard infrastructure of a recording studio, a wide range of electronic (e.g. EMS VCS 3, Synthi E and Synthi 200, a variant of the Synthi 100), acoustic (grand piano, drums etc.) and hybrid (e.g. Disklavier) instruments are available.

There is also a mobile recording studio, which is regularly used to record the concerts of the institute's numerous ensembles, choirs and bands or the symphony orchestra.

Das Bild zeigt eine Frau, die ein Virtual-Reality-Headset und eine EEG-Haube mit Elektroden trägt. Die Elektroden sind über Kabel mit anderen Geräten verbunden, vermutlich zur Erfassung von Gehirnaktivität. Im Hintergrund steht eine andere Person in einem weißen Laborkittel, die auf einem Klemmbrett Notizen macht.

Perception laboratory

The Perception Lab is equipped with a new eye-tracking system from Pupil Labs, as well as a range of physiological measurement systems from MindMedia and Empatica. These systems can be used to record EEG, muscle activity (sEMG), heart rate, relative blood flow, skin conductance, respiration, body temperature, and other physiological parameters. The lab’s equipment is complemented by a wireless EEG system from Brain Products with up to 64 channels (LiveAmp 64). An acoustically optimized room, including a mobile anechoic chamber, is available for conducting measurements.

Visual stimuli can be presented using a mobile, pressure-sensitive, interactive 86-inch display or a range of VR headsets. The current equipment includes two Apple Vision Pro headsets, four Oculus Quest Pro headsets, ten Oculus Quest 2 headsets, fourteen Oculus Quest 3 headsets, two HTC Vive Pro Eye headsets, one HTC Vive Focus 3, and one PICO 4.

For the presentation of auditory stimuli, the lab provides various Shokz bone-conduction headphones, headphones from Sennheiser, Beyerdynamic, and AKG, electrostatic headphones from STAX, and a digitally controllable multichannel system from Genelec’s SAM series.

Das Bild zeigt eine orangefarbene, dreidimensionale Skulptur eines menschlichen Kopfes, die sich in einem 3D-Drucker befindet. Die Skulptur ist zentriert, und der Druckkopf des 3D-Druckers ist oberhalb des Modells positioniert. Der Innenraum des Druckers ist in einem metallischen Grau gehalten, und mehrere mechanische Bauteile und Führungen sind um die Skulptur herum sichtbar.

Workspace

In addition to workstations for 22 people with Windows, Linux and MacOS notebooks/workstations, the MTDML workspace also has 3D printers (Ultimaker 3 Extended, Original Prusa MK4) and an electronics workstation (microcontrollers, sensors, etc.). The MTDML workroom is used for seminars and practical courses as well as for individual project work. The room is also equipped with a video mixer and several Blackmagic cameras for hybrid seminars, video conferences and live streaming events.

The UOS DIGILAB can be used for additional requirements (e.g. VR treadmills, AR hardware such as Microsoft HoloLens 2, Magic Leap One or tools such as laser cutters, CNC milling machines, cutting plotters or textile processing).

Das Bild zeigt ein dodekaederförmiges Lautsprechersystem, das aus mehreren Lautsprechereinheiten besteht, die auf jeder Fläche des Dodekaeders angebracht sind. Die Lautsprecher sind gleichmäßig verteilt und nach außen gerichtet, sodass Schall in verschiedene Richtungen ausgestrahlt werden kann. Das Lautsprechersystem ist an einem Ständer befestigt.

XR Lab

The XR Lab focuses primarily on research in the field of **Acoustical Extended Reality (AXR)**. Its work explores the use of virtual, augmented, and mixed reality technologies in the investigation of acoustical and, in particular, music-related research questions.

The lab is equipped with a 13-camera OptiTrack motion-capture system with synchronized eye tracking, as well as a wide range of VR and AR devices. These currently include two Apple Vision Pro headsets, fourteen Meta Quest 3 headsets, one Meta Quest 3S, four Meta Quest Pro headsets, ten Meta Quest 2 headsets, two HTC Vive Pro Eye headsets, one HTC Vive Focus 3, one PICO 4, and one Ray-Ban Wayfarer.

Additional equipment includes a DSP-controlled multichannel loudspeaker system, a dodecahedral loudspeaker with individually controllable drivers, and several 3D scanners, including the Revopoint POP and Revopoint POP 2.

The lab’s facilities will soon be expanded with a 21-camera Gaussian splatting rig.