YouTube Unveils Groundbreaking AI Music Tools: Clone Artist Voices and Transform Hums into Melodies

YouTube recently introduced exciting experimental AI features, including Dream Track for YouTube Shorts. This innovative tool generates up to 30-second soundtracks using AI versions of popular artists' voices. While many musicians have expressed concerns about AI and the use of their voices without consent or compensation, nine prominent artists, including John Legend, Troye Sivan, Charli XCX, and T-Pain, have collaborated on this project.

To use Dream Track, users simply input an idea into the creation prompt and select one of the participating artists. This feature leverages Google DeepMind's Lyria, a cutting-edge music generation model designed for high-quality vocal and instrumental production, giving users significant control over the finished product. Additionally, all content created with Lyria will include a SynthID watermark for identification.

Artists Charlie Puth and T-Pain have produced sample Dream Tracks as inspiration, although many involved have shared their reservations about AI. "When I was first approached by YouTube, I was cautious and still am. AI is set to transform the world and the music industry in ways we do not yet fully understand," said Charli XCX. She expressed hope that this experiment could pave the way for positive and non-exploitative collaborations.

YouTube is also launching Music AI Tools through its Music AI Incubator, designed to transform creative input, such as generating guitar riffs from hummed melodies or reimagining a pop hit as a reggaeton anthem. A sample video by producer and songwriter Louis Bell highlights these capabilities.

As YouTube navigates the introduction of AI tools, the platform is committed to responsible usage, unveiling new policies for labeling AI-generated videos and allowing public figures, including musicians, to report deepfakes. Currently, Dream Track is available to a select group of creators and artists, while those in the Music AI Incubator can expect access to the tools later this year.