multimodal-audiocraft

Topics in the source

• AudioCraft: Audio Generation
• When to use AudioCraft
• Quick start
• Installation
• Basic text-to-music (AudioCraft)
• Using HuggingFace Transformers
• Text-to-sound with AudioGen
• Core concepts

Comprehensive guide to using Meta's AudioCraft for text-to-music and text-to-audio generation with MusicGen, AudioGen, and EnCodec. Use AudioCraft when: Need to generate music from text descriptions Creating sound effects and environmental audio Building music generation applications Need melody-conditioned music generation Want stereo audio output Require controllable music generation with style transfer Key features: MusicGen: Text-to-music generation with melody conditioning AudioGen: Text-to-sound effects generation EnCodec: High-fidelity neural audio codec Multiple model sizes: Small (300M) to Large (3.3B) Stereo support: Full stereo audio generation Style conditioning: MusicGen-Style for reference-based generation Use alternatives instead: Stable Audio: For longer commercial music generation Bark: For text-to-speech with music/sound effects Riffusion: For spectogram-based music generation OpenAI Jukebox: For raw audio generation with lyrics | Model | Size | Description | Use Case | |-------|------|-------------|----------| | musicgen-small | 300M | Text-to-music | Quick generation | | musicgen-medium | 1.5B | Text-to-music | Balanced | | musicgen-large | 3.3B | Text-to-music

This is an excerpt. Refer to the complete source and its current requirements.