Back to projects
Active

Video Factory

Agent-driven, programmatic video production that avoids AI slop: reviewable plan manifests, swappable media providers, and a deterministic Remotion compositor.

TypeScriptNode.jsRemotionReactffmpegClaude Code Plugin
GitHub Repository

Agent-driven video production engineered for craft and control. Combines a human-reviewable plan manifest, swappable provider contracts, and code-based Remotion rendering to generate video without the low-quality artifacts common in automated video pipelines.

The Problem

Most generative AI video platforms produce repetitive, uneditable video:

  • Generic b-roll loosely matched to keyword triggers.
  • Robotic, poorly paced narration.
  • Inflexible video outputs that require starting over from scratch if one subtitle or second of footage is wrong.

The Solution: Manifest-First Architecture

Video Factory decouples planning from rendering via a declarative manifest.json:

Brief ──► Director & Screenwriter ──► manifest.json (Plan)
                                             │
                                     [Human Review Gate]
                                             │
                                   Producer & Adapters
                                             │
                                    Remotion Compositor ──► Production MP4
  1. Human Review Gate: Before generating expensive media or spending external API credits, the agent drafts the scene breakdown, narration script, art direction, and visual cues into a structured manifest. You review, tweak, and approve the plan first.
  2. Zero-Key Core: The foundational tier renders high-resolution animated typography, code windows, and vector motion graphics locally using Node.js and ffmpeg without requiring paid API keys.
  3. Composable Provider Contracts: Voice (ElevenLabs), generative footage (fal.ai), precise word-level captions (Deepgram), and avatar segments (HeyGen) interact through simple JSON contracts over stdin/stdout. Swapping a vendor requires zero changes to the underlying compositor.
  4. Deterministic Remotion Engine: Videos are composed in React with Remotion. Renders are frame-accurate, reproducible, and can be exported cleanly to multiple aspect ratios (16:9, 9:16, 1:1) from a single manifest.

Claude Code Plugin

Video Factory packages as an installable plugin for Claude Code, allowing developers to scaffold projects, review manifests, and kick off production renders directly from the terminal.

Open Source