Launching voice AI Eleven laboratories offers an early look at a latest model that turns tooltips into song lyrics. To raise awareness, the company is using a similar playbook that Sam Altman used when OpenAI introduced Sora, a video-generating artificial intelligence that collects ideas on social media and turns them into text.
Founded by former Google and Palantir employees, ElevenLabs specializes in using machine learning (ML) to clone and synthesize voices in various languages. It offers many tools, including one that lets you copy full-length movies. It is due to this fact not surprising that the company focused on the music industry.
Imagine the possibilities with this model: generate a fun lullaby to play for your kids to place them to sleep, create a clever jingle for a marketing campaign, create a fun musical intro for your podcast, and more. Is there a likelihood that someone will use ElevenLabs AI to create the next hit? Many AI music startups are already emerging, including Harmonai, Lyrical Labs, Suno AI, Loudly, and others.
It’s also possible that users could sell AI-generated songs on the ElevenLabs marketplace, which launched in January. The company’s voice library now allows users to sell their AI-cloned voice for money while maintaining control over its availability and the way it is rewarded.
VB event
AI Impact Tour: AI Audit
Join us when we return to New York on June 5 to interact with top executives and delve into strategies for auditing AI models to make sure integrity, optimal performance, and ethical compliance across organizations. Secure your entry to this exclusive, invitation-only event.
Ask for an invitation
However, AI-based music generation is not welcomed by everyone. As with all generative AI applications, the query is what ElevenLabs trained the model on and whether it included copyrighted material. And if so, has he obtained permission from the rights holder or does he consider that training without permission is protected under fair use. Some oppose development such technology because artists may lose their jobs. The problem is that the AI will easily have the ability to recreate a particular artist’s style and then they’ll not be needed to release latest music. They don’t desire to make that Christmas album? No problem. Just use artificial intelligence to do it. Let’s not forget about the possibility of using it to provide deepfakes.
VentureBeat has reached out to ElevenLabs for additional comment on its music model and will update this post if we hear back. We don’t know the maximum song length it could produce, but based on an example posted on X by the company’s head of design Ammaar Reshi, it’s likely the AI will generate lyrics for a three-minute song.