Initial release — OpenMontage: the first open-source agentic video production system
11 production pipelines, 47 tools, 124 agent skills. Supports cloud APIs (fal.ai, OpenAI, ElevenLabs, Suno, HeyGen, Runway) and free local providers (diffusers, Piper TTS, WAN 2.1, Hunyuan, CogVideo). Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
This commit is contained in:
calesthio
@@ -0,0 +1,88 @@
|
||||
# HunyuanVideo 1.5 — Prompting Guide
|
||||
|
||||
> Source: [Tencent Prompt Handbook](https://github.com/Tencent-Hunyuan/HunyuanVideo-1.5/blob/main/assets/HunyuanVideo_1_5_Prompt_Handbook_EN.md)
|
||||
> For universal vocabulary, see: `skills/creative/video-gen-prompting.md`
|
||||
|
||||
## HunyuanVideo Prompt Formula
|
||||
|
||||
### Text-to-Video
|
||||
```
|
||||
Subject + Motion + Scene + [Shot Type] + [Camera Movement] + [Lighting] + [Style] + [Atmosphere]
|
||||
```
|
||||
|
||||
### Image-to-Video
|
||||
```
|
||||
Subject Motion Dynamics + Scene Motion Dynamics + [Camera Movement]
|
||||
```
|
||||
|
||||
For I2V, focus on describing MOTION, not appearance (the image provides appearance).
|
||||
|
||||
## HunyuanVideo-Specific Strengths
|
||||
|
||||
### Lighting as Atmosphere
|
||||
Tencent emphasizes: **"Light is the soul of atmosphere."**
|
||||
|
||||
Describe lighting with multiple dimensions:
|
||||
- **Style**: soft, hard, neon, ambient
|
||||
- **Direction**: side-lit, backlit, overhead, underlighting
|
||||
- **Quality**: harsh spotlight, diffuse glow
|
||||
- **Shadows**: long dramatic shadows, soft shadow edges
|
||||
- **Color temperature**: golden hour warmth, cool daylight blue
|
||||
- **Reflections**: wet surface reflections, metallic glints
|
||||
|
||||
### Camera Movement Library
|
||||
|
||||
| Movement | Type | HunyuanVideo Prompt |
|
||||
|----------|------|-------------------|
|
||||
| Crane / Pedestal | Vertical | "camera rises vertically" |
|
||||
| Truck / Tracking | Horizontal | "camera tracks left alongside subject" |
|
||||
| Dolly In | Push | "camera pushes forward toward subject" |
|
||||
| Dolly Out | Pull | "camera pulls back from subject" |
|
||||
| Pan | Rotation | "camera pans right across the scene" |
|
||||
| Orbit | Circular | "camera orbits around subject" |
|
||||
| Follow | Lock-on | "camera follows subject from behind" |
|
||||
| Static | Fixed | "static camera, no movement" |
|
||||
|
||||
### Style Keywords
|
||||
|
||||
**Photorealistic / Cinematic**:
|
||||
- Film noir, hard sci-fi, cinematic photography
|
||||
- Period drama, war documentary, nature documentary
|
||||
|
||||
**Animation / Illustration**:
|
||||
- 2D animation, Japanese anime
|
||||
- Watercolor painting, Chinese ink wash
|
||||
- Low-poly 3D, pixel art
|
||||
|
||||
## I2V Best Practice
|
||||
|
||||
When using image-to-video, the input image defines appearance. Your prompt should ONLY describe:
|
||||
1. How the subject moves
|
||||
2. How the environment changes
|
||||
3. Camera motion
|
||||
|
||||
**Good I2V prompt**: "The woman's hair blows in the wind as she turns to face the camera. Leaves scatter across the path. Camera slowly dollies in."
|
||||
|
||||
**Bad I2V prompt**: "A beautiful woman in a red dress standing in a forest" — this repeats what the image already shows.
|
||||
|
||||
## Example (T2V)
|
||||
|
||||
```
|
||||
A young woman in a flowing white dress walks barefoot along
|
||||
a deserted beach at golden hour. She trails her hand through
|
||||
the shallow surf, leaving ripples. Her hair catches the warm
|
||||
side-light from the setting sun. Medium tracking shot, camera
|
||||
follows alongside at knee height. Soft golden lighting with
|
||||
long shadows stretching toward the camera. Cinematic
|
||||
photography style, shallow depth of field. Peaceful,
|
||||
contemplative atmosphere.
|
||||
```
|
||||
|
||||
## Example (I2V)
|
||||
|
||||
```
|
||||
The cat stretches lazily, then leaps from the windowsill
|
||||
to the floor. Dust motes scatter in the shaft of light.
|
||||
Camera remains static, slight rack focus from window to
|
||||
landing spot.
|
||||
```
|
||||
@@ -0,0 +1,77 @@
|
||||
# LTX-2 — Prompting Guide
|
||||
|
||||
> Source: [LTX Official Prompting Guide](https://docs.ltx.video/api-documentation/prompting-guide)
|
||||
> For universal vocabulary, see: `skills/creative/video-gen-prompting.md`
|
||||
|
||||
## LTX-Specific 6-Element Structure
|
||||
|
||||
LTX-2 uses a clean, focused prompt structure:
|
||||
|
||||
1. **Establish the shot** — cinematography terms matching your genre
|
||||
2. **Set the scene** — lighting, color palette, textures, atmosphere
|
||||
3. **Describe the action** — natural sequence flowing from beginning to end
|
||||
4. **Define the character(s)** — physical cues (age, hair, clothes), not abstract labels
|
||||
5. **Camera movement(s)** — specify how and when; describe what appears AFTER the movement
|
||||
6. **Describe the audio** — ambient sound, music, speech, or singing
|
||||
|
||||
## LTX-Specific Tips
|
||||
|
||||
### Post-Movement Description
|
||||
LTX renders camera movements more accurately when you describe the result:
|
||||
- Instead of: "Camera pans left"
|
||||
- Write: "Camera pans left to reveal a bustling market square"
|
||||
|
||||
### Audio Prompting (Unique to LTX-2)
|
||||
LTX-2 generates synchronized audio. Use specific descriptors:
|
||||
|
||||
| Category | Examples |
|
||||
|----------|---------|
|
||||
| **Ambient** | "coffeeshop noise", "wind and rain", "forest with birdsong" |
|
||||
| **Voice style** | "energetic announcer", "resonant voice with gravitas", "childlike curiosity" |
|
||||
| **Volume** | "whisper", "mutter", "shout", "scream" |
|
||||
| **Music** | "soft acoustic guitar", "electronic beat building" |
|
||||
|
||||
Dialogue goes in quotes: `The narrator says: "Welcome to the future."`
|
||||
Specify language/accent: `speaks in British English with a warm tone`
|
||||
|
||||
### Style Categories
|
||||
LTX organizes styles into three families:
|
||||
|
||||
**Animation**: stop-motion, 2D animation, 3D animation, claymation, hand-drawn
|
||||
**Stylized**: comic book, cyberpunk, 8-bit pixel, surreal, minimalist, painterly
|
||||
**Cinematic**: period drama, film noir, fantasy, thriller, documentary, arthouse
|
||||
|
||||
## What to Avoid (LTX-Specific)
|
||||
|
||||
| Avoid | Reason |
|
||||
|-------|--------|
|
||||
| Internal emotional states ("sad", "confused") | Use visual cues: tears, slumped posture, furrowed brow |
|
||||
| Readable text and logos | Not reliably rendered |
|
||||
| Complex physics (explosions, splashing) | Causes artifacts; simple motion is fine |
|
||||
| Overloaded scenes | Many characters/actions reduces coherence |
|
||||
| Conflicting lighting descriptions | Pick one setup, commit to it |
|
||||
| Starting complex | Build up: simple prompt first, add layers |
|
||||
|
||||
## LTX Technical Notes
|
||||
|
||||
- **Duration**: ~5-8 seconds per generation
|
||||
- **Audio**: Generated automatically; describe what you want to hear
|
||||
- **~30% of outputs have artifacts** — re-run with a different seed
|
||||
- **Cannot render readable text** — don't include signs or titles
|
||||
- **Frame count must satisfy** `(n-1) % 8 == 0`: valid counts are 25, 49, 73, 97, 121, 161, 193
|
||||
|
||||
## Example
|
||||
|
||||
```
|
||||
A wide establishing shot captures a misty morning harbor.
|
||||
Weathered fishing boats bob gently, their paint peeling in
|
||||
patches of red and blue. A grey-haired fisherman in a dark
|
||||
wool peacoat steps onto the dock, carrying a heavy net over
|
||||
one shoulder. He pauses, looks out at the fog bank, then
|
||||
walks toward the nearest boat with steady, deliberate steps.
|
||||
The camera tracks alongside him at waist height, slowly
|
||||
pushing in as he reaches the boat and tosses the net aboard.
|
||||
Soft overcast light with a warm break in the clouds near
|
||||
the horizon. Ambient sound of water lapping, rope creaking,
|
||||
and distant foghorn.
|
||||
```
|
||||
@@ -0,0 +1,91 @@
|
||||
# Sora 2 — Prompting Guide
|
||||
|
||||
> Source: [OpenAI Sora 2 Cookbook](https://developers.openai.com/cookbook/examples/sora/sora2_prompting_guide)
|
||||
> For universal vocabulary, see: `skills/creative/video-gen-prompting.md`
|
||||
|
||||
## Sora-Specific Prompt Template
|
||||
|
||||
Sora responds best to a structured format with prose + cinematography block + action beats:
|
||||
|
||||
```
|
||||
[Prose scene description — characters, costumes, scenery, weather, details.
|
||||
Be as descriptive as possible to match your vision.]
|
||||
|
||||
Cinematography:
|
||||
Camera shot: [framing and angle]
|
||||
Lens: [focal length, type]
|
||||
Lighting: [key, fill, rim, practical sources with color temp]
|
||||
Mood: [overall tone]
|
||||
|
||||
Actions:
|
||||
- [Beat 1: specific gesture or movement]
|
||||
- [Beat 2: another distinct beat]
|
||||
- [Beat 3: reaction or dialogue]
|
||||
|
||||
Dialogue:
|
||||
[Short natural lines, kept brief for clip length]
|
||||
```
|
||||
|
||||
## Advanced Optional Fields
|
||||
|
||||
Sora uniquely responds to these production-level details that most models ignore:
|
||||
|
||||
| Field | Example |
|
||||
|-------|---------|
|
||||
| **Lens spec** | "40mm spherical", "85mm", "Anamorphic 2.0x" |
|
||||
| **Filtration** | "Black Pro-Mist 1/4", "slight CPL rotation" |
|
||||
| **Grade / palette** | "Warm Kodak-inspired grade", "teal-and-orange LUT" |
|
||||
| **Film stock emulation** | "16mm black-and-white", "35mm photochemical contrast" |
|
||||
| **Diegetic sound** | "faint rail screech, rain patters window, clock ticks" |
|
||||
| **Wardrobe** | "navy coat, sleeves rolled, suspenders loose" |
|
||||
| **Finishing** | "fine-grain overlay, mild halation, gate weave, soft vignette" |
|
||||
| **Shutter** | "180° shutter angle" |
|
||||
|
||||
## What Sora Does Differently
|
||||
|
||||
- **Prose-first**: Write a rich paragraph, then add technical blocks. Don't lead with camera specs.
|
||||
- **Character references**: Can lock onto up to 2 uploaded character IDs via API.
|
||||
- **Dialogue sync**: Short lines work. Complex multi-character dialogue does not.
|
||||
- **Edit commands**: "Same shot, switch to 85mm" or "Same lighting, new palette: teal, sand, rust" — Sora supports iterative refinement on existing generations.
|
||||
- **Creative freedom**: Shorter prompts → more creative latitude. Longer → more control.
|
||||
|
||||
## Color Palette Technique
|
||||
|
||||
Name 3-5 anchor colors instead of vague "warm tones":
|
||||
- "Amber, cream, walnut brown" (vintage warmth)
|
||||
- "Teal, sand, rust" (coastal desert)
|
||||
- "Cool blues with warm tungsten accents" (noir)
|
||||
|
||||
## Sora API Parameters (cannot be set in prompt)
|
||||
|
||||
- `model`: `sora-2` or `sora-2-pro`
|
||||
- `size`: 720x1280, 1280x720, 1080x1920, 1920x1080, 1024x1792, 1792x1024
|
||||
- `seconds`: 4, 8, 12, 16, 20
|
||||
|
||||
## Example
|
||||
|
||||
```
|
||||
Style: Hand-painted 2D/3D hybrid animation with soft brush textures,
|
||||
warm tungsten lighting, tactile stop-motion feel. Subtle watercolor wash;
|
||||
warm-cool balance; filmic motion blur.
|
||||
|
||||
Inside a cluttered workshop, shelves overflow with gears and yellowing
|
||||
blueprints. Small round robot sits on wooden bench, dented body patched
|
||||
with mismatched plates. Large glowing blue eyes flicker as it fiddles
|
||||
with a humming light bulb.
|
||||
|
||||
Cinematography:
|
||||
Camera: medium close-up, slow push-in with gentle parallax from hanging tools
|
||||
Lens: 35mm virtual; shallow depth of field
|
||||
Lighting: warm key from overhead practical; cool spill from window
|
||||
Mood: gentle, whimsical, touch of suspense
|
||||
|
||||
Actions:
|
||||
- Robot taps bulb; sparks crackle
|
||||
- Flinches, dropping bulb, eyes widening
|
||||
- Bulb tumbles in slow motion; catches it just in time
|
||||
- Puff of steam escapes chest — relief and pride
|
||||
|
||||
Background Sound:
|
||||
Rain, ticking clock, soft mechanical hum, faint bulb sizzle
|
||||
```
|
||||
@@ -0,0 +1,73 @@
|
||||
# VEO 3.1 / VEO 3 — Prompting Guide
|
||||
|
||||
> Source: [Vertex AI Video Gen Prompt Guide](https://cloud.google.com/vertex-ai/generative-ai/docs/video/video-gen-prompt-guide)
|
||||
> For universal vocabulary, see: `skills/creative/video-gen-prompting.md`
|
||||
|
||||
## VEO-Specific 14-Component Structure
|
||||
|
||||
VEO responds to the most comprehensive prompt structure of any model:
|
||||
|
||||
1. **Subject** — who/what the action revolves around
|
||||
2. **Action** — movements, interactions, expressions
|
||||
3. **Scene / Context** — location, time, weather, period
|
||||
4. **Camera Angles** — shot type and perspective
|
||||
5. **Camera Movements** — dynamic motion
|
||||
6. **Lens / Optical Effects** — how the camera "sees"
|
||||
7. **Lighting** — source, direction, quality
|
||||
8. **Tone / Mood** — emotional register
|
||||
9. **Artistic Style** — photorealistic, cinematic, animation, art movement
|
||||
10. **Ambiance** — color palettes, atmospheric effects, textures
|
||||
11. **Temporal Elements** — pacing, time flow, rhythm
|
||||
12. **Audio** — sound effects, ambient, dialogue (VEO 3 generates dialogue)
|
||||
13. **Cinematic Terms** — editing techniques (match cut, montage, split diopter)
|
||||
14. **Negative Prompt** — what to exclude
|
||||
|
||||
## VEO-Specific Strengths
|
||||
|
||||
- **Dialogue generation**: VEO 3 natively generates character speech. Write dialogue naturally.
|
||||
- **Audio integration**: Ambient sound, music, and voice are generated together with video.
|
||||
- **Negative prompts**: Explicitly supported — "no text overlays, no watermarks, no lens flare"
|
||||
- **Editing vocabulary**: Understands "match cut", "jump cut", "montage", "split diopter" as prompt terms.
|
||||
|
||||
## VEO Lens Effects (Unique)
|
||||
|
||||
VEO specifically responds to optical effects most models ignore:
|
||||
|
||||
| Effect | Prompt Language |
|
||||
|--------|----------------|
|
||||
| **Rack focus** | "rack focus from foreground flower to background figure" |
|
||||
| **Dolly zoom (vertigo)** | "vertigo effect as character realizes the truth" |
|
||||
| **Fisheye** | "fisheye lens distortion, skatepark POV" |
|
||||
| **Lens flare** | "anamorphic lens flare from setting sun" |
|
||||
|
||||
## VEO Art Movement References
|
||||
|
||||
VEO responds well to specific art movements as style anchors:
|
||||
- "Van Gogh-inspired swirling sky"
|
||||
- "Surrealist Dalí-esque melting landscape"
|
||||
- "Art Deco geometric patterns in the architecture"
|
||||
- "Bauhaus clean lines and primary colors"
|
||||
- "Gritty graphic novel illustration style"
|
||||
- "Chinese ink wash painting animation"
|
||||
|
||||
## Subtitle Prevention
|
||||
|
||||
VEO may add subtitles by default for dialogue. To prevent:
|
||||
- Add to negative prompt: "no subtitles, no captions, no text overlays"
|
||||
|
||||
## Example
|
||||
|
||||
```
|
||||
Subject: A lone astronaut in a weathered white spacesuit
|
||||
Action: Slowly turns to face the camera, visor reflecting a dying star
|
||||
Scene: Surface of a barren moon, cracked grey terrain, massive ringed
|
||||
planet filling the horizon
|
||||
Camera: Low-angle medium shot, slow arc around subject
|
||||
Lens: Wide-angle, deep focus keeping both astronaut and planet sharp
|
||||
Lighting: Harsh rim light from the star behind, cool blue fill from
|
||||
planet reflection, no atmosphere diffusion
|
||||
Mood: Awe, isolation, quiet grandeur
|
||||
Style: Photorealistic sci-fi cinematography, IMAX-scale
|
||||
Audio: Breathing inside helmet, faint radio static, low rumble
|
||||
Negative: No text, no HUD overlay, no lens flare
|
||||
```
|
||||
Reference in New Issue
Block a user