🎨 Stable Video Diffusion

A web GUI for creating dynamic videos and inpainting with Stable Video Diffusion using the Replicate API.

Experience it live at www.stablevideodiffusion.fun

Features

Inpainter now includes capabilities for transforming static images into dynamic videos, thanks to the integration of the Stable Video Diffusion model. Users can:

• Transform images into high-resolution videos with customizable frame rates and lengths.
• Utilize the inpainting feature to fill in missing parts of images.
• Explore a variety of applications in advertising, education, entertainment, and more.

How it Works

🚀 This Node.js app is powered by several robust technologies:

• Replicate: A platform for running machine learning models in the cloud.
• Stable Video Diffusion: An advanced model for converting images to videos and Stable Diffusion for text-to-image generation.
• Next.js server-side API routes for seamless communication with the Replicate API.
• React components in Next.js for the interactive GUI.
• Tailwind CSS: For modern, responsive styling.
• Lucide: For sleek, scalable icons.

Development Setup

To get started with Stable Video Diffusion:

Prerequisites:

1. A recent version of Node.js.
2. A Replicate API token.

Configuration:

Set your Replicate API token in your environment:

REPLICATE_API_TOKEN=<your-token-here>

Then install dependencies and run the server:

npm install
npm run dev

Open http://localhost:3000