Motion Transfer lets you use an input video as a motion reference to influence how your generated video will move. Use Motion Transfer with a text prompt to generate content that closely mirrors the motion and composition of your conditioning video, re-style it, or use it in conjunction with a reference image to drive movement within the selected image.
How it works
By default, Marey controls on fal will be displayed as a form but can be switched to an editable JSON, or a read-only text snippet in your preferred langauge. To change the page layout, click 'Form' (default) in layout dropdown menu.
Here's a breakdown of the inputs you'll need to set for Motion Transfer. For demo purposes, we'll stick to the default 'Form' layout:
Prompt: This is where you'll write your prompt in the Prompt description box. Be descriptive about camera details (e.g. 35mm, handheld shot), scene or environment, subjects and action of your video. Prompts with at least 50 words produce the best results.
Video URL: Select a video to be used as a reference. The motion and movement present in this video will be transferred to your newly generated video.
Additional Settings: There are three additional settings with Motion Transfer, including reference image URL, negative prompt, and seed value.
Reference Image URL: Apply the motion and movement from your reference video to an image of your choosing.
Negative Prompt: Add or remove negative prompts to help guide the model away from undesirable results.
Seed: Select your desired seed value. Seed determines the randomness and different possibilities of each generation. By default, seed will be set to '9'. Use '-1' for a random seed value.
Preview and Export
Once you click generate your video will begin being processed. Once the generation is finished, the video will be displayed in the 'Result' panel with a 'Download' and 'Share' button below the video.
You can also switch the results to JSON, which will provide you with a URL that can be copy and pasted into a browser for easy sharing and download.
