Researchers Enable People to Compose Music With Only Their Brains
The Brain Composer lets you write melodies with your mind.
Brain-computer interface devices have come a long way in the last few years, allowing people with limited physical abilities to type, control prosthetics, and even play video games. Now, thanks to a team of Austrian researchers, so-called BCIs can now help people compose music.
Using a device that interprets electrical impulses from the brain, researchers have developed an interface that enables users to write melodies using only their thoughts.
In a study published on September 6 in the journal PLOS One, researchers at Graz University of Technology and University of Graz in Austria explained how they exploited a well-known electrical brain signal, the “P300 event-related potential,” to make the device work.
Their results are promising for the future of this field: Amateur and professional musicians not only achieved high levels of accuracy with the program, but they also had a positive experience using it. This is a big deal — if the point of BCI systems is to assist physically disabled people, they have to be pleasant and easy to use.
The interface uses an EEG cap to measure brain signals.
What makes the device so intuitive is its use of the P300 event-related potential, which is well studied. This signal, which is associated with focusing attention, can be detected by a type of non-invasive headgear fitted with electrodes called an electroencephalogram (EEG) cap. It sends these relatively noisy signals to an amplifier, which allows a computer to more easily read the user’s brain waves. The brain waves then translate into commands to the computer.
From here, the challenge is simply to train a user to create the proper brain waves that correspond to software controls. Here’s what it looks like:
In the study, a combination of nonprofessional and professional musicians learned how to use the BCI and were given composition tasks: copy-spelling words, copy-composing a melody, and then composing their own melody. Nonprofessionals completed the copy-spelling task with 88.2 percent accuracy, while a professional composer achieved 100 percent accuracy. When copying a composition, the nonprofessionals were 88.6 percent accurate, and one professional composer was 93.6 percent accurate.
These scores are quite good and above the 70 percent threshold that researchers consider to be successful. The only issue is how long it takes users to control the software. In the word-copying task, the nonprofessionals took an average of 77 seconds to copy one five-letter word. This is very slow.
But the fact that the users composed actual melodies (bits of which you can hear in the video above), plus their high levels of satisfaction with the experience, prove that this concept can work.
“This was the first step towards establishing a Brain Composing system as a tool for entertainment and, even more important, self-expression for severely disabled people,” write the study’s authors.
If you liked this article, check out this video about headphones that can monitor your brainwaves.
