Wan2.1 Video

Generate high-quality videos with Alibaba's Wan2.1 text-to-video and image-to-video models on CLORE.AI GPUs.

All examples can be run on GPU servers rented through CLORE.AI Marketplace.

Why Wan2.1?

• High quality - State-of-the-art video generation

• Multiple modes - Text-to-video, image-to-video

• Various sizes - 1.3B to 14B parameters

• Long videos - Up to 81 frames

• Open weights - Apache 2.0 license

Model Variants

Model	Parameters	VRAM	Resolution	Frames
Wan2.1-T2V-1.3B	1.3B	8GB	480p	81
Wan2.1-T2V-14B	14B	24GB	720p	81
Wan2.1-I2V-14B	14B	24GB	720p	81

Quick Deploy on CLORE.AI

Docker Image:

pytorch/pytorch:2.5.1-cuda12.4-cudnn9-devel

Ports:

22/tcp
7860/http

Command:

pip install diffusers transformers accelerate gradio && \
python -c "
import gradio as gr
import torch
from diffusers import WanPipeline
from diffusers.utils import export_to_video

pipe = WanPipeline.from_pretrained('alibaba-pai/Wan2.1-T2V-1.3B', torch_dtype=torch.float16)
pipe.to('cuda')
pipe.enable_model_cpu_offload()

def generate(prompt, steps, frames, seed):
    generator = torch.Generator('cuda').manual_seed(seed) if seed > 0 else None
    output = pipe(prompt, num_frames=frames, num_inference_steps=steps, generator=generator)
    export_to_video(output.frames[0], 'output.mp4', fps=16)
    return 'output.mp4'

gr.Interface(
    fn=generate,
    inputs=[
        gr.Textbox(label='Prompt'),
        gr.Slider(20, 100, value=50, label='Steps'),
        gr.Slider(16, 81, value=49, step=8, label='Frames'),
        gr.Number(value=-1, label='Seed')
    ],
    outputs=gr.Video(),
    title='Wan2.1 - Text to Video'
).launch(server_name='0.0.0.0', server_port=7860)
"

Accessing Your Service

After deployment, find your http_pub URL in My Orders:

1. Go to My Orders page

2. Click on your order

3. Find the http_pub URL (e.g., abc123.clorecloud.net)

Use https://YOUR_HTTP_PUB_URL instead of localhost in examples below.

Hardware Requirements

Model	Minimum GPU	Recommended	Optimal
1.3B T2V	RTX 3070 8GB	RTX 3090 24GB	RTX 4090
14B T2V	RTX 4090 24GB	A100 40GB	A100 80GB
14B I2V	RTX 4090 24GB	A100 40GB	A100 80GB

Installation

pip install diffusers transformers accelerate torch

Text-to-Video

Basic Usage (1.3B)

import torch
from diffusers import WanPipeline
from diffusers.utils import export_to_video

pipe = WanPipeline.from_pretrained(
    "alibaba-pai/Wan2.1-T2V-1.3B",
    torch_dtype=torch.float16
)
pipe.to("cuda")
pipe.enable_model_cpu_offload()

prompt = "A cat playing with a ball in a sunny garden"

output = pipe(
    prompt=prompt,
    num_frames=49,
    num_inference_steps=50,
    guidance_scale=7.0
)

export_to_video(output.frames[0], "cat_video.mp4", fps=16)

High Quality (14B)

import torch
from diffusers import WanPipeline
from diffusers.utils import export_to_video

pipe = WanPipeline.from_pretrained(
    "alibaba-pai/Wan2.1-T2V-14B",
    torch_dtype=torch.float16
)
pipe.to("cuda")
pipe.enable_model_cpu_offload()
pipe.enable_vae_tiling()

prompt = "Cinematic shot of a dragon flying over mountains at sunset, 4K, detailed"

output = pipe(
    prompt=prompt,
    negative_prompt="blurry, low quality, distorted",
    num_frames=81,
    height=720,
    width=1280,
    num_inference_steps=50,
    guidance_scale=7.0
)

export_to_video(output.frames[0], "dragon.mp4", fps=24)

Image-to-Video

Animate an Image

import torch
from diffusers import WanI2VPipeline
from diffusers.utils import load_image, export_to_video

pipe = WanI2VPipeline.from_pretrained(
    "alibaba-pai/Wan2.1-I2V-14B",
    torch_dtype=torch.float16
)
pipe.to("cuda")
pipe.enable_model_cpu_offload()

# Load input image
image = load_image("input.jpg")

prompt = "The person in the image starts walking forward"

output = pipe(
    prompt=prompt,
    image=image,
    num_frames=49,
    num_inference_steps=50,
    guidance_scale=7.0
)

export_to_video(output.frames[0], "animated.mp4", fps=16)

Prompt Examples

Nature & Landscapes

prompts = [
    "Time-lapse of clouds moving over mountain peaks, dramatic lighting",
    "Ocean waves crashing on rocks, slow motion, cinematic",
    "Northern lights dancing in the night sky, vibrant colors",
    "Forest in autumn with leaves falling, peaceful atmosphere"
]

Animals & Characters

prompts = [
    "A golden retriever running through a field of flowers",
    "A butterfly emerging from its cocoon, macro shot",
    "Samurai warrior drawing sword, dramatic lighting",
    "Robot walking through futuristic city streets"
]

Abstract & Artistic

prompts = [
    "Colorful paint swirling in water, abstract art",
    "Geometric shapes transforming and morphing, neon colors",
    "Ink drops spreading in milk, macro photography"
]

Advanced Settings

Quality vs Speed

# Fast preview
output = pipe(
    prompt=prompt,
    num_frames=17,
    num_inference_steps=25,
    guidance_scale=5.0
)

# Balanced
output = pipe(
    prompt=prompt,
    num_frames=49,
    num_inference_steps=50,
    guidance_scale=7.0
)

# Maximum quality
output = pipe(
    prompt=prompt,
    num_frames=81,
    num_inference_steps=100,
    guidance_scale=7.5
)

Resolution Options

# 480p (1.3B model)
output = pipe(prompt, height=480, width=854, num_frames=49)

# 720p (14B model)
output = pipe(prompt, height=720, width=1280, num_frames=49)

# 1080p (14B model, high VRAM)
output = pipe(prompt, height=1080, width=1920, num_frames=33)

Batch Generation

import os
import torch
from diffusers import WanPipeline
from diffusers.utils import export_to_video

pipe = WanPipeline.from_pretrained("alibaba-pai/Wan2.1-T2V-1.3B", torch_dtype=torch.float16)
pipe.to("cuda")
pipe.enable_model_cpu_offload()

prompts = [
    "A rocket launching into space",
    "Fish swimming in coral reef",
    "Rain falling on a city street at night"
]

output_dir = "./videos"
os.makedirs(output_dir, exist_ok=True)

for i, prompt in enumerate(prompts):
    print(f"Generating {i+1}/{len(prompts)}: {prompt[:40]}...")

    output = pipe(
        prompt=prompt,
        num_frames=49,
        num_inference_steps=50
    )

    export_to_video(output.frames[0], f"{output_dir}/video_{i:03d}.mp4", fps=16)
    torch.cuda.empty_cache()

Gradio Interface

import gradio as gr
import torch
from diffusers import WanPipeline
from diffusers.utils import export_to_video
import tempfile

pipe = WanPipeline.from_pretrained("alibaba-pai/Wan2.1-T2V-1.3B", torch_dtype=torch.float16)
pipe.to("cuda")
pipe.enable_model_cpu_offload()

def generate_video(prompt, negative_prompt, frames, steps, guidance, seed):
    generator = torch.Generator("cuda").manual_seed(seed) if seed > 0 else None

    output = pipe(
        prompt=prompt,
        negative_prompt=negative_prompt,
        num_frames=frames,
        num_inference_steps=steps,
        guidance_scale=guidance,
        generator=generator
    )

    with tempfile.NamedTemporaryFile(suffix=".mp4", delete=False) as f:
        export_to_video(output.frames[0], f.name, fps=16)
        return f.name

demo = gr.Interface(
    fn=generate_video,
    inputs=[
        gr.Textbox(label="Prompt", lines=2),
        gr.Textbox(label="Negative Prompt", value="blurry, low quality"),
        gr.Slider(17, 81, value=49, step=8, label="Frames"),
        gr.Slider(20, 100, value=50, step=5, label="Steps"),
        gr.Slider(3, 12, value=7, step=0.5, label="Guidance"),
        gr.Number(value=-1, label="Seed")
    ],
    outputs=gr.Video(label="Generated Video"),
    title="Wan2.1 - Text to Video Generation",
    description="Generate videos from text prompts. Running on CLORE.AI."
)

demo.launch(server_name="0.0.0.0", server_port=7860)

Memory Optimization

# Enable all optimizations
pipe.enable_model_cpu_offload()
pipe.enable_vae_tiling()
pipe.enable_vae_slicing()

# For very low VRAM
pipe.enable_sequential_cpu_offload()

# Clear cache between generations
torch.cuda.empty_cache()

Performance

Model	Resolution	Frames	GPU	Time
1.3B	480p	49	RTX 4090	~2 min
1.3B	480p	49	A100 40GB	~1.5 min
14B	720p	49	A100 40GB	~5 min
14B	720p	81	A100 80GB	~8 min

Cost Estimate

Typical CLORE.AI marketplace rates:

GPU	Hourly Rate	~49 frame videos/hour
RTX 3090 24GB	~$0.06	~20 (1.3B)
RTX 4090 24GB	~$0.10	~30 (1.3B)
A100 40GB	~$0.17	~40 (1.3B) / ~12 (14B)
A100 80GB	~$0.25	~8 (14B high-res)

Prices vary. Check CLORE.AI Marketplace for current rates.

Troubleshooting

Out of Memory

# Use smaller model
pipe = WanPipeline.from_pretrained("alibaba-pai/Wan2.1-T2V-1.3B")

# Enable all optimizations
pipe.enable_model_cpu_offload()
pipe.enable_vae_tiling()

# Reduce frames
output = pipe(prompt, num_frames=17)

# Reduce resolution
output = pipe(prompt, height=480, width=854)

Poor Quality

• Increase steps (75-100)

• Write more detailed prompts

• Use negative prompts

• Try 14B model for better quality

Video Too Short

• Increase num_frames (max 81)

• Use RIFE interpolation for frame interpolation

• Chain multiple generations

Artifacts/Flickering

• Increase guidance scale

• Use fixed seed for consistency

• Post-process with video stabilization

Wan2.1 vs Others

Feature	Wan2.1	Hunyuan	SVD	CogVideoX
Quality	Excellent	Excellent	Good	Great
Speed	Fast	Medium	Fast	Slow
Max Frames	81	129	25	49
Resolution	720p	720p	576p	720p
I2V Support	Yes	Yes	Yes	Yes
License	Apache 2.0	Open	Open	Open

Use Wan2.1 when:

• Need open-source video generation

• Want fast generation speed

• Apache 2.0 license required

• Balanced quality/speed needed

Next Steps

• Hunyuan Video - Alternative T2V

• OpenSora - Open Sora alternative

• Stable Video Diffusion - Image animation

• RIFE Interpolation - Frame interpolation