Disney-Princess / README.md
Remade's picture
Create README.md
2dcb926 verified
metadata
license: apache-2.0
language:
  - en
base_model:
  - Wan-AI/Wan2.1-I2V-14B-480P
  - Wan-AI/Wan2.1-I2V-14B-480P-Diffusers
pipeline_tag: image-to-video
tags:
  - text-to-image
  - lora
  - diffusers
  - template:diffusion-lora
  - image-to-video
widget:
  - text: >-
      The video starts with a portrait of a rabbit There's a d15n3y Disney
      princess transformation, the rabbit is now wearing a blue dress. The
      camera pans out to reveal the background as a brown, classical style
      hallway. There are white butterflies that appear to be falling. The rabbit
      still wears the dress from the d15n3y Disney princess transformation.
    output:
      url: example_videos/rabbit_disney_princess.mp4
  - text: >-
      The video starts with a portrait of a man. There's a d15n3y Disney
      princess transformation, the man is now wearing a blue dress. The camera
      pans out to reveal the background as a brown, classical style hallway.
      There are white butterflies that appear to be falling. The man still wears
      the dress from the d15n3y Disney princess transformation.
    output:
      url: example_videos/man_disney_princess.mp4

Disney Princess Effect LoRA for Wan2.1 14B I2V 480p

Overview

This LoRA is trained on the Wan2.1 14B I2V 480p model and allows you to make any person/object in an image become a Disney Princess version of themselves!

Features

  • Transform any image into a video of the subject as a Disney Princess version of themselves!
  • Trained on the Wan2.1 14B 480p I2V base model
  • Consistent results across different object types
  • Simple prompt structure that's easy to adapt

Community

  • Discord: Join our community to generate videos with this LoRA for free
  • Request LoRAs: We're training and open-sourcing Wan2.1 LoRAs for free - join our Discord to make requests!
Prompt
The video starts with a portrait of a rabbit There's a d15n3y Disney princess transformation, the rabbit is now wearing a blue dress. The camera pans out to reveal the background as a brown, classical style hallway. There are white butterflies that appear to be falling. The rabbit still wears the dress from the d15n3y Disney princess transformation.
Prompt
The video starts with a portrait of a man. There's a d15n3y Disney princess transformation, the man is now wearing a blue dress. The camera pans out to reveal the background as a brown, classical style hallway. There are white butterflies that appear to be falling. The man still wears the dress from the d15n3y Disney princess transformation.

Model File and Inference Workflow

📥 Download Links:


Recommended Settings

  • LoRA Strength: 1.0
  • Embedded Guidance Scale: 6.0
  • Flow Shift: 5.0

Trigger Words

The key trigger phrase is: d15n3y Disney princess transformation

Prompt Template

For best results, try following the structure of the prompt examples above. These worked well for me.

ComfyUI Workflow

This LoRA works with a modified version of Kijai's Wan Video Wrapper workflow. The main modification is adding a Wan LoRA node connected to the base model.

See the Downloads section above for the modified workflow.

Model Information

The model weights are available in Safetensors format. See the Downloads section above.

Training Details

  • Base Model: Wan2.1 14B I2V 480p
  • Training Data: Trained on 35 seconds of video comprised of 7 short clips (each clip captioned separately) of people transforming into a Disney princess!
  • Epochs: 45

Additional Information

Training was done using Diffusion Pipe for Training

Acknowledgments

Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!