Pose Transfer lets you transfer a human performance from one video to another. Preserve an actor's movements--even facial expressions--from a reference video and apply those in a newly generated video. Use Pose Transfer with just a prompt, or in combination with a reference image to dictate the first frame of your new video.
How it works
By default, Marey controls on Fal will be displayed as a form but can be switched to an editable JSON, or a read-only text snippet in your preferred langauge. To change the page layout, click 'Form' (default) in layout dropdown menu.
Here's a breakdown of the inputs you'll need to set for Pose Transfer. For demo purposes, we'll stick to the default 'Form' layout:
Prompt: This is where you'll write your prompt in the Prompt description box. Be descriptive about camera details (e.g. 35mm, handheld shot), scene or environment, subjects and action of your video. Prompts with at least 50 words provide best results.
Video URL: Marey will preserve the human performance from this video. Movements, poses and facial expressions from this video will be applied to a net new video.
Additional Settings: There are a number of additional settings used with Pose Transfer, including First Frame Image URL, Reference Image URL, Negative Prompt, and Seed.
First Frame Image URL: Set the starting from for your video. The human movement from your Video URL will be applied to this image.
Reference Image URL: Apply the performance from your reference video to an image of your choosing. The reference image will be the first frame of your newly generated video.
Negative Prompt: Add or remove negative prompts to help guide the model away from undesirable results.
Seed: Select your desired seed value. Seed determines the randomness and different possibilities of each generation. By default, seed will be set to '9'. Use '-1' for a random seed value.
Preview and Export
Once you click generate your video will begin being processed. Once the generation is finished, the video will be displayed in the 'Result' panel with a 'Download' and 'Share' button below the video.
You can also switch the results to JSON, which will provide you with a URL that can be copy and pasted into a browser for easy sharing and download.