PhD student Hang Chu and Professors Raquel Urtasun and Sanja Fidler have trained recurrent neural networks to make an all-singing and dancing AI.
From The Guardian article:
Known to its creators as “neural karaoke”, the project from the University of Toronto can take any digital photo and transform it into a computer-generated singalong.
Chu trained a neural network on 100 hours of online music. Once trained, the program can take a musical scale and melodic profile and produce a simple 120-beats-per-minute melody. It then adds chords and drums.
But computer-generated music was just the start. The Toronto team next taught the program how to dance. Fed with an hour of footage from the video game Just Dance, the program tracked human poses and so learned to connect moves with music. Suitably trained, the program can make a digital stick figure dance to the music it has made. The results are more dad dancing than Travolta, but one cannot expect too much from a single one hour lesson.
The researchers have submitted a paper on their work to the 5th International Conference on Learning Representations (ICLR17), which will be held April 24 - 26, Palais des Congrès Neptune, Toulon, France.
– The Guardian: It's no Christmas No 1, but AI-generated song brings festive cheer to researchers
– The Register: Top of the bots: This AI isn't a cold, cruel killing machine – it's a pop music hit machine
– U of T News: Have yourself an AI Xmas: U of T computer science researchers create 'neural karaoke'
– SD Times: University of Toronto researchers train AI system to sing Christmas songs
– Inquisitr: Artificial Intelligence program writes a Christmas carol with moments of cheer and darkness
– Philadelphia Media: A computer just wrote and sang a creepy song about 'A Christmas Story'
U of T researchers are not only generating AI Christmas carols, but fans willing to sing them
Five Americans in Rome discovered The Guardian article on the ‘neural karaoke’ program. The group says they immediately fell in love with the Christmas tune, and sang it over and over and over again until sunrise. The following day, they filmed themselves merrily singing the song, and thanked the researchers.