feat(character-animation): add local rigged character pipeline
New beta pipeline for reusable cartoon characters with SVG rigs, pose
libraries, action timelines, and Canvas/Remotion/HyperFrames rendering.
- pipeline_defs/character-animation.yaml: 11-stage manifest
- skills/pipelines/character-animation/: 11 stage director skills
- tools/character/: BaseTool implementations for char design, rigging,
pose libraries, action timelines, previews, and QA
- schemas/artifacts/{character_design,rig_plan,pose_library,
action_timeline,character_qa_report}.schema.json: canonical artifacts
- schemas/artifacts/scene_plan.schema.json: extended for character-led
scenes
- .agents/skills/{canvas-procedural-animation,character-animation-qa,
character-rigging,pose-library-design,svg-character-animation}/:
Layer 3 vendor knowledge
- AGENT_GUIDE / PROJECT_CONTEXT / README / ARCHITECTURE / PROVIDERS:
surface the new pipeline and its capability family
- tools/video/hyperframes_compose.py: SVG character rig support
- tests/contracts/test_character_animation_pipeline.py: contract tests
This commit is contained in:
calesthio
+13
-6
@@ -53,7 +53,7 @@ OpenMontage/
|
||||
│ ├── subtitle/ # SRT/VTT generation from timestamps
|
||||
│ └── video/ # 13 video gen providers, composition, stitching, trimming
|
||||
│
|
||||
├── pipeline_defs/ # 11 YAML pipeline manifests
|
||||
├── pipeline_defs/ # YAML pipeline manifests
|
||||
├── schemas/ # JSON Schema definitions for validation
|
||||
│ ├── artifacts/ # 11 artifact schemas (brief → publish_log)
|
||||
│ ├── checkpoints/ # Checkpoint state schema
|
||||
@@ -65,9 +65,9 @@ OpenMontage/
|
||||
│ ├── core/ # FFmpeg, Remotion, WhisperX, color grading skills
|
||||
│ ├── creative/ # Video editing, enhancement, data viz, prompt engineering
|
||||
│ ├── meta/ # reviewer, checkpoint-protocol, skill-creator
|
||||
│ └── pipelines/ # Per-pipeline stage-director skills (10 pipelines)
|
||||
│ └── pipelines/ # Per-pipeline stage-director skills
|
||||
│
|
||||
├── .agents/skills/ # Layer 3: 47 external technology skills (FFmpeg, ElevenLabs, FLUX, etc.)
|
||||
├── .agents/skills/ # Layer 3: external technology skills (FFmpeg, HyperFrames, GSAP, etc.)
|
||||
├── styles/ # Visual style playbooks (YAML) + loader
|
||||
├── remotion-composer/ # Node.js/React — Remotion video composition renderer
|
||||
├── tests/ # Contract tests, QA integration tests, eval harness
|
||||
@@ -200,13 +200,14 @@ stages:
|
||||
# ... through publish
|
||||
```
|
||||
|
||||
### Available Pipelines (11)
|
||||
### Available Pipelines
|
||||
|
||||
| Pipeline | Category | Description |
|
||||
|----------|----------|-------------|
|
||||
| `animated-explainer` | generated | AI-produced explainer with research, narration, visuals, music |
|
||||
| `animation` | animation | Motion graphics, kinetic typography |
|
||||
| `avatar-spokesperson` | talking_head | Avatar-driven presenter videos |
|
||||
| `character-animation` | animation | Local rigged cartoon characters with SVG rigs, pose libraries, GSAP timelines, and HyperFrames rendering |
|
||||
| `cinematic` | cinematic | Trailer, teaser, mood-driven edits |
|
||||
| `clip-factory` | custom | Batch short-form clips from long source |
|
||||
| `hybrid` | hybrid | Source footage + AI-generated support visuals |
|
||||
@@ -218,7 +219,7 @@ stages:
|
||||
|
||||
### Standard Stage Progression
|
||||
|
||||
All production pipelines follow a canonical 8-stage flow:
|
||||
Most production pipelines follow a canonical 8-stage flow:
|
||||
|
||||
```
|
||||
research → proposal → script → scene_plan → assets → edit → compose → publish
|
||||
@@ -231,6 +232,11 @@ Each stage:
|
||||
4. Has **review_focus** criteria and **success_criteria**
|
||||
5. Can require **human approval** before proceeding
|
||||
|
||||
Specialized pipelines may insert domain-specific stages. For example,
|
||||
`character-animation` adds `character_design` and `rig_plan` before
|
||||
`scene_plan`, then emits a HyperFrames workspace and final deliverable at
|
||||
`projects/<project-name>/renders/final.mp4`.
|
||||
|
||||
---
|
||||
|
||||
## Checkpoint System
|
||||
@@ -439,9 +445,10 @@ A standalone Node.js/React subproject in `remotion-composer/` using [Remotion](h
|
||||
|
||||
Consumed via `npx hyperframes` (no monorepo checkout needed). Runtime floor: Node.js ≥ 22, FFmpeg, `npx`.
|
||||
|
||||
- Handles kinetic typography, product promos, launch reels, website-to-video, registry blocks
|
||||
- Handles kinetic typography, product promos, launch reels, website-to-video, registry blocks, and SVG/GSAP character rigs
|
||||
- Driver: `tools/video/hyperframes_compose.py` materializes a workspace under `projects/<name>/hyperframes/`, then runs `lint → validate → render`
|
||||
- Layer 3 skills vendored at `.agents/skills/hyperframes*/`; Layer 2 guide at `skills/core/hyperframes.md`
|
||||
- The `character-animation` pipeline uses HyperFrames as the production render package. Browser previews are QA/debug artifacts only, not the render path.
|
||||
|
||||
### FFmpeg (fallback / simple cuts)
|
||||
|
||||
|
||||
@@ -503,6 +503,39 @@ If Remotion is not installed, compositions fall back to FFmpeg Ken Burns pan-and
|
||||
|
||||
---
|
||||
|
||||
### HyperFrames - HTML/CSS/GSAP Video Composition
|
||||
|
||||
> **GSAP-native local rendering.** HyperFrames is the preferred runtime for motion-graphics-heavy HTML compositions and the `character-animation` pipeline's rigged SVG character acting.
|
||||
|
||||
**Tool:** `hyperframes_compose` directly, or `video_compose` with `edit_decisions.render_runtime="hyperframes"`
|
||||
**Runtime:** CPU (Node.js >= 22, FFmpeg, and `npx` required)
|
||||
**Env var:** None
|
||||
|
||||
#### Setup
|
||||
|
||||
```bash
|
||||
node --version
|
||||
ffmpeg -version
|
||||
npx --yes hyperframes doctor
|
||||
```
|
||||
|
||||
The CLI is consumed as `npx hyperframes`. Do not use `npx @hyperframes/cli`; that package name is not the OpenMontage runtime path.
|
||||
|
||||
#### What HyperFrames Renders
|
||||
|
||||
| Use case | What it produces |
|
||||
|----------|------------------|
|
||||
| **Kinetic typography** | HTML/CSS text animation driven by GSAP timelines |
|
||||
| **Product / launch videos** | Structured HTML scenes, registry blocks, and transitions |
|
||||
| **Website-to-video** | Browser-captured site compositions with HyperFrames validation |
|
||||
| **Character animation** | SVG character rigs, pose/action timelines, and GSAP acting beats rendered to `renders/final.mp4` |
|
||||
|
||||
HyperFrames workspaces live under `projects/<project-name>/hyperframes/`. Final videos still follow the normal OpenMontage convention: `projects/<project-name>/renders/final.mp4`.
|
||||
|
||||
**Cost:** Free. Always local.
|
||||
|
||||
---
|
||||
|
||||
### Piper TTS — Offline Text-to-Speech
|
||||
|
||||
> **Completely free, fully offline TTS.** No network required. Good quality for drafts and budget-constrained projects.
|
||||
|
||||
Reference in New Issue
Block a user