Brain-computer interfaces (BCIs) are a cutting-edge assistive technology, with high potential but a lack of design optimisation. BCIs are often visually taxing and repetitive, making them uncomfortable to use long-term. In this project, I wanted to find a way of optimising BCIs for both neural and aesthetic alignment - in other words, 'neuroaesthetic resonance'.
I worked with neuroscientists to understand the science behind BCIs and integrate scientifically validated data practices into my design process.
Through multiple prototypes, I developed techniques for creating immersive audiovisual experiences from brain data that can drive BCI systems.
I used custom scripts and a connected user-facing app to optimise the design in real-time, both for users' aesthetic preferences and brain responses.
I developed an innovative BCI system that uses brain signals, called EEG, to dynamically generate an immersive audiovisual experience.
Typical BCIs use repetitive flashing lights and unpleasant droning sounds, set to specific frequencies, to elicit responses from a user's brain.
My system instead delivers these frequencies through gently pulsating light patterns and ambient soundscapes - both of which can be optimised in real-time to maximise brain response and align with a user's aesthetic preferences.
In consultation with neuroscientists, I developed an EEG processing pipeline that collects brain signal data and sends it to other applications in a clean, simplified format.
Using Processing, Max, TouchOSC and custom Python scripts, I created a system that generates real-time light patterns and ambient soundscapes in response to incoming brain data.
I built a physical installation, including hundreds of custom-soldered LEDs and a power management system, that transforms any space into a BCI.
Take a look at the video below to see the installation in action. Colours and lights undulate gently whilst ambient soundscapes envelop and evolve. All of these elements are generated and optimised in real-time to align with a user's brain responses and aesthetic preferences.
The design combines digital data pipelines, a user-facing app, and an audiovisual installation.
