Using Parseq to Sync Animations in Stable Diffusion with the Deforum Extension

In this video, I'm demonstrating the use of Parseq [sd-parseq.web....] to sync animations in Stable Diffusion, utilizing the Deforum extension [github.com/def...]. You can try it with this easy-to-follow guide to help you understand the necessary steps to achieve seamless animation synchronization.
Step 1: Install the Deforum Extension
Before syncing animations, you must install the Deforum extension for Stable Diffusion. Visit the GitHub repository at [github.com/def...] and follow the installation instructions in the README file.
Step 2: Familiarize Yourself with Parseq
Parseq [sd-parseq.web....] is a web application designed to create and manage sequences, or "parses," that define the behavior of animations. To familiarize yourself with Parseq, visit the web app and explore its features. The user interface is straightforward and user-friendly, with clear instructions on creating, editing, and saving parses.
Step 3: Create a New Parse in Parseq
After familiarizing yourself with Parseq, it's time to create a new parse for your animation. Click the "New Parse" button in the Parseq interface and enter the necessary information, such as the animation name, description, and duration.
Step 4: Add Animation Keyframes in Parseq
Now that you have a new parse, add keyframes to define your desired animation behavior. Keyframes are points in time where a specific action occurs in the animation sequence. You can set them by clicking the "Add Keyframe" button to a particular frame in your animation. You can define properties such as position, rotation, scale, and opacity for each frame with keyframes. Experiment with different settings to achieve the desired animation effect.
Step 5: Save and Export the Parse
After completing the animation keyframes, save the parse by clicking the "Save" button. Then, export the parse as a JSON file by clicking the "Export" button. This JSON file will sync your animation with the Deforum extension in Stable Diffusion.
Step 6: Import the Parse JSON File into Stable Diffusion
Open the Stable Diffusion project where you want to sync the animation. In the Deforum extension panel, click the "Import Parse" button and locate the JSON file you exported from Parseq. The Deforum extension will then read the JSON file and apply the parse to your animation.
Step 7: Fine-tune and Preview the Animation
Now that the parse has been applied to your animation in Stable Diffusion, you may need to fine-tune some aspects to achieve the desired result. Use the Deforum extension's features to make any necessary adjustments. Preview the animation to ensure everything works as expected and synchronization is seamless.
Following the steps and with a practice, you can successfully use Parseq to sync animations in Stable Diffusion with the Deforum extension. The process may require some experimentation and fine-tuning, but the result will be a seamless and dynamic animation that brings your project to life.
#StableDiffusion
#Parseq
#DeforumExtension
#AnimationSync
#AnimationTutorial
#SyncingAnimations
#DigitalArt
#MotionGraphics
#AnimationTips
#CreativeProjects

[@djflymethod]

Awesome video. Nice work

[@PigOnPCIn4K]

Wow holy shut man I just made something I thought was cool, just posted as a shirt if you check it but daaamn bro this is sooo next level!! Nicely done!

[@pseudokris]

Well done! I've been struggling to get Deforum + Parseq to maintain a consistent color palette. Look like you've sorted that out. It remains very consistent. Any advice on how to keep the colors from going all wonky?

[@six60six]

I use ControlNet "color" along with an INIT image and fixed seed to maintain color/lighting consistency.

[@pseudokris]

Awesome,@@six60six! I'll take a look at that. Thank you!

[@dougjord7833]

This is amazing!
Did you post-process the images?
What did you use to upscale it?
Absolutely fantastic!

[@six60six]

No post-processing outside of SD, but the generation was run at 910x512 and the images uprezed by 2x using a scaler through the extras in SD to get it as close to full HD as possible.

[@nikallasha]

Looks amazing! What range of values did you use for translation_z, x and y? Like your max and min values. I can't understand how Parseq's values correlate with Deforum's range of -10 to 10 for these parameters.

[@six60six]

Thank you! It actually depends on your FOV settings in Deforum, but with my FOV settings on this project, Parseq was using a range of -3 to 3. The greater FOV, the greater the Parseq variable needs to be in order to have a visual effect on the movement.

[@nikallasha]

@@six60six thanks! What FOV value did you use? Or are there other settings that matter in this case?

[@six60six]

@@nikallasha I don't remember the exact numbers off the top of my head, but the 2 variables are FOV, which is -180 to +180 (default is 30 but I believe I was at 80 or 100), and Midas_weight which is -1 to +1 (I believe I was at 0.35).

[@nikallasha]

@@six60six thank you so much!🙏🏻 I will try these

[@user-se9pl6ce9z]

You're not using music keyframe sync？

[@six60six]

I am, but only on a few parameters. There are also equations being used to control others.

[@acadvideoart]

[@--signald]

This looks great. I've been going crazy trying to get results like this and my camera keeps wandering off somewhere. New prompts never appear in the center of the camera view. Any clues on what I might be doing wrong?
Also, how did you get a background going, and then have the girl pop-up without disrupting the background? I always get a whole screen shift to a new prompt.

[@six60six]

You need to do the math for the camera movement and align it with the timing of the prompt changes so they appear where the camera is looking.

[@Ann-AI]

Thanks for the cool video and the explanation! Can you share the model that you used? Thanks!

[@six60six]

This was made with the SynthwavePunk model from civitai.
civitai.com/models/1102/synthwavepunk

[@satoshichaser6537]

upload the Parseq document so we can use it

[@six60six]

The parseq json for this was over 40k lines long and was loaded into Deforum via url since it was so big. Its so big that the sd-parseq site refuses to even load it anymore after I tried to edit further it after this pass. :(

[@yasu2011]

There is a document file created in your generated video folder you can always upload it easily
If possible you can try

[@yasu2011]

It should be a note file i guess

[@six60six]

@@yasu2011 The parseq data isn't included in the config file that's created when you run the generation, just the url to the file is included.