What Is Motion Transfer?
Motion Transfer uses a 'conditioning video' - an input video that serves as a motion reference - to influence how your generated video will move.
You can use Motion Transfer with a text prompt to generate content that closely mirrors the motion and composition of your conditioning video, or use it in conjunction with an image to either drive movement within the selected image or re-style an image to create a style transfer driven by the motion of the conditioning video.
How It Works
Step 1: Access Motion Transfer
Navigate to the prompt interface
Look for the Motion Transfer option in the advanced settings
Toggle on Motion Transfer to reveal additional options
Step 2: Upload Your Conditioning Video
Click the upload area or drag and drop your conditioning video
Supported formats include MP4, MOV, and other common video formats. Note: Videos longer than 10s will be trimmed to only use the first 10s
Your conditioning video will serve as the motion reference for the final output
Step 3: Configure Your Generation Settings
For Text-to-Video:
Enter your text prompt describing what you want to generate
The AI will create content matching your prompt while following the motion patterns from your conditioning video
For Image-to-Video:
Upload both your conditioning video AND your input image as a starting keyframe
Your static image will be animated according to the motion in your conditioning video
Step 4: Adjust Advanced Settings
Motion Strength: Control how closely the output follows the conditioning video's motion. The higher the value the more aggressively it follows the conditioning video’s motion
Step 5: Generate and Review
Click "Generate" to start the process
Monitor the generation progress
Once complete, review your video in the preview player
Download or save your final video
Here's a quick walkthrough on Motion Transfer: