Music and audio generation
AI that creates music, sound effects and audio from text descriptions.
What is it?
Audio generation models create new sound from a description: a short melody, a full song with vocals, background music or a sound effect such as rain or footsteps. They learn patterns of rhythm, harmony and timbre from large collections of audio.
You describe the genre, mood, instruments and length, and the model produces a clip. Some tools also write lyrics, separate a song into parts (stems), or continue a piece you start. The results can be useful for drafts and background audio, but quality and control vary.
Which models use it?
- Suno and Udio are services that generate songs, including vocals, from text prompts.
- Stable Audio from Stability AI generates music and sound effects.
- Google and Meta have published music generation research models, such as MusicLM and MusicGen.
- ElevenLabs and other audio tools offer AI sound-effect generation.
How to use it
- Decide what you need: background music, a jingle, a full song or a sound effect.
- Describe genre, mood, tempo, instruments and length in simple words.
- If the song has vocals, provide or approve the lyrics yourself.
- Generate several versions and choose the one that fits best.
- Check the tool's licence before using the audio in commercial or public projects.
Benefits
- Quick background music for videos, podcasts and games.
- Helps musicians sketch ideas and try different styles.
- Custom sound effects without a recording session.
Limits and risks
- Fine control (exact chords, structure, mixing) is limited.
- Copyright questions around training data and output ownership are still being debated and decided in courts.
- Imitating a real artist's voice or style can break rules and harm artists; avoid it.
- Output can sound generic or repetitive.
Prompt template
Copy it, replace the parts in [brackets] and paste it into any AI chat.
Create [length, e.g. 30 seconds] of [genre] music for [use, e.g. a product video intro]. Mood: [uplifting / calm / tense]. Tempo: [slow / medium / fast]. Instruments: [e.g. acoustic guitar, soft piano, light drums]. Structure: [gentle start, build-up, clean ending]. No vocals. Do not imitate any specific real artist.
More in Images, video, voice and more
- Multimodal AI and visionAI that can read images, screenshots and documents as well as text, and answer questions about them.
- Image generation (diffusion)Creating new pictures from a text description, usually with diffusion models.
- Video generationCreating short video clips from a text prompt or a still image.
- Speech-to-text and text-to-speechAI that turns speech into written text and reads text aloud in natural-sounding voices.
- 3D generationCreating 3D models and scenes from text prompts or photos.