ElevenLabs Launches Cutting-Edge AI Tool to Create Stunning Sound Effects

Voice cloning startup ElevenLabs has launched an innovative tool that allows users to generate sound effects via text prompts. First announced in February, this advanced feature is now accessible to everyone.

With this tool, users can produce a variety of sound effects by simply typing in phrases such as “waves crashing,” “metal clanging,” “birds chirping,” and “racing car engine.”

Additionally, the sound effects tool can create instrumental music clips of up to 22 seconds, with prompts like guitar loops, jazz saxophone solos, and techno music loops enhancing its versatility.

Free-tier users are entitled to 10,000 characters for sound generation each month, with each sound request averaging around 150 characters. This means that users can effectively generate close to 60 unique sound effects each month. However, they are required to credit “elevenlabs.io” in the title when publishing any content that features these sound clips.

ElevenLabs has revealed that they utilized Shutterstock’s audio library, which contains licensed tracks, to train their sound generation model. Feedback from various alpha testing participants, including video game developers, film producers, social media creators, and marketers, has been instrumental in refining the tool.

It’s important to note that ElevenLabs prohibits sound generation based on prompts that violate its Prohibited Content and Uses Policy, which includes sensitive subjects like self-harm, child safety threats, and fraud.

While the AI-driven sound generation sector is still relatively niche, it is becoming increasingly competitive. ElevenLabs faces competition from several notable players in the space, including Stability AI-backed Harmonai with Dance Diffusion, Google’s MusicLM, OpenAI’s Jukebox, and Meta’s AudioCraft model. Additionally, TikTok and Adobe have also ventured into generative music creation tools.

AI, music generation, sound effects, ElevenLabs, sound tools