This AI generates music from silent piano performances

Ce n'est pas bluffant, mais le cas d'usage est intéressant, et surtout la comparaison avec Shazam ou SoundHound.

Scientists have developed an AI that can generate music from silent piano performances, just by watching the movements of the player’s hands.

The system, called Audeo, analyzes top-down videos of someone tickling the ivories to predict which keys are being pressed in each frame. It then produces a transcript of the music, which a synthesizer translates into sound.

The researchers trained and tested the AI on footage of pianist Paul Barton playing tunes by famous composers.

They then evaluated the accuracy of the Audeo’s compositions by playing them to music-recognition apps, such as Shazam and SoundHound.

The apps identified the tune 86% of the time — just 7% less than they recognized the source videos.

via Inside AI : lire l’article source

Laisser un commentaire

Votre adresse e-mail ne sera pas publiée. Les champs obligatoires sont indiqués avec *

Ce site utilise Akismet pour réduire les indésirables. En savoir plus sur comment les données de vos commentaires sont utilisées.