PixelPlayer AI system picks out instruments from the mix


PixelPlayer AI system picks out instruments from the mix

Well, check out an AI project being worked on at MIT’s Computer Science and Artificial Intelligence Laboratory (CSAIL).

PixelPlayer

PixelPlayer is described as “deep-learning system” that can analyse a video of a musical performance, and isolate the particular instruments involved, making them louder or softer.

It can identify the sounds of more than 20 commonly seen instruments.

Seen is a key phrase because previous efforts to separate sounds have apparently focused exclusively on audio, which MIT states often requires extensive human labeling.

You can hear the system in action below: