Skip to main content

Overview

Audio to Video turns an audio track into a generated video. Add an optional reference image and prompt to guide the scene while matching the output duration to the selected audio segment.

How It Works

  1. Upload audio - Use the file upload API and copy its file_path
  2. Add optional guidance - Provide a reference image and a prompt describing the scene
  3. Choose the segment - Set start time, end time, and output resolution
  4. Create the job - Submit the request and poll until its status is complete
  5. Download the result - Retrieve the generated video from downloads

Use Cases

  • Music visuals - Generate shareable visuals for songs and audio clips
  • Podcast promotion - Turn excerpts into video content
  • Narrated stories - Pair spoken audio with generated scenes
  • Social media - Convert audio-first content into video posts
  • Creative visualization - Explore visual interpretations of sound and speech

Best Practices

Use a focused prompt - Describe the subject, setting, movement, and visual style you want.
  • Use clean audio - Clear source audio without clipping or excessive noise produces a stronger input
  • Match the image to the prompt - When using a reference image, avoid instructions that conflict with it
  • Start with a short segment - Test the visual direction before generating a longer clip
  • Choose the needed resolution - Higher resolution takes more processing and may use more credits
  • Check segment bounds - end_seconds must be greater than start_seconds

Code Example

Input files must be direct URLs or file_path values returned by the file upload API.
cURL

Pricing

Credits are charged for frames that render. The create response provides an estimate, and the completed job reports the final total in credits_charged. See Billing for current rates.

API Reference

Audio to Video API Reference

View all request fields, limits, and response formats

Image to Video

Animate a still image into a video

Text to Video

Generate video directly from a text description