AI Video Playbook

Prompting

A prompt structure that works on every video model, the camera words that models understand, audio cues, and before and after examples.

A good video prompt is short, concrete and complete. It says who is in the shot, what they do, where, how the camera moves, how it is lit, what it looks like and what it sounds like. Shorter and denser beats longer: Seedance guides suggest 60 to 100 words, and one Omni tester found 40 words beating 150.

The universal structure

Write these eight parts in every prompt. The order can change per model (see the per model notes below), but none of them should be missing.

PartWhat to writeExample
SubjectWho or what, with 1 or 2 fixed traitsA wiry old fisherman in a yellow oilskin
ActionOne verb chain, in beats, ending in a still momentcoils a wet rope, pulls it tight, then stops and looks up
SettingPlace and time of dayon a pitching trawler deck at a grey North Sea dawn
CameraFraming plus one moveLow angle medium shot, slow dolly in
LensFocal length35mm
LightLight quality, sources, 3 to 5 palette colourscold blue light, a thin orange break on the horizon
StyleOne style line, reused word for wordnaturalistic 16mm film look, fine grain
AudioNamed sounds, dialogue, and "no music" if you do not want musicwind, waves slapping the hull, rope creak, no music

Put together:

Prompt
Low angle medium shot, 35mm, slow dolly in. A wiry old fisherman in a yellow
oilskin coils a wet rope on a pitching trawler deck, pulls it tight, then
stops and looks up at the sky. Grey North Sea dawn, cold blue light with a
thin orange break on the horizon, spray hitting the rail. Naturalistic 16mm
film look, fine grain. Audio: wind, waves slapping hull, rope creak, no music.

Three rules that fix most bad shots

  • One subject, one action, one camera move. This is the strongest agreement across every guide, official and community. If you need more, use another shot, or use the model's multi shot syntax ("Shot 1", "Shot 2", "cut to", or timestamps).
  • Re-describe everything in every shot. The model does not remember the previous shot. Repeat the character's traits, the place, the light and the style line each time. Copy them from your shot list, do not rewrite them.
  • End the action in a resting state. "Then settles", "then stays still", "coming to rest". It stops runaway motion, and on Kling it is the reported fix for generations that hang at 99%.

Camera vocabulary

Use standard film terms. Models know them. For a rare term, explain it in plain words as well.

Camera moves

TermWhat it doesGood for
Static, locked offThe camera does not move at allDialogue, product shots, anything that must stay sharp. Say it, or models add a slow drift
Push in (dolly in)Camera moves toward the subjectBuilding tension, a realization
Pull out (pull back)Camera moves away from the subjectReveals, endings
PanCamera turns left or right on the spotFollowing action across a scene, revealing a place
TiltCamera turns up or down on the spotRevealing height, a tall object or a face
Tracking (follow)Camera travels alongside or behind a moving subjectWalking, running, vehicles
Orbit (arc)Camera circles around the subjectHero moments, products
Crane up or downCamera rises or drops verticallyOpening or closing a scene
HandheldSlight natural shakeDocumentary, UGC, tension
Whip panA very fast pan that blursEnergetic transitions
Dolly zoomCamera moves while zooming the other way, so the background stretchesA shock moment; use rarely
Rack focusFocus shifts from one object to anotherMoving attention without moving the camera
POVWe see through the character's eyesImmersion, vlogs
Aerial (drone)High, flying view, often descendingEstablishing shots

Framing

TermWhat we see
Extreme close up (ECU)One detail: an eye, a drop on glass
Close up (CU)The face fills the frame
Medium close up (MCU)Head and shoulders
Medium shotWaist up
Wide shotThe whole body and the place around it
Over the shoulder (OTS)Past one person's shoulder toward another
Two shotTwo people in one frame
Low angleCamera below, looking up; the subject feels big
High angleCamera above, looking down; the subject feels small

Lenses

LensEffectUse it for
24mmWide, shows scalePlaces, establishing shots
35mmNatural, close to the eyeDocumentary, intimate scenes
50mmNeutralDialogue
85mmShallow focus, soft backgroundClose ups, portraits
135mmCompresses distanceLong lens looks, isolation
MacroTiny details very closeProducts, textures

Always name a lens. If you do not, the model guesses. On Hailuo 02 and 2.3, you can also use bracket commands such as [Push in], [Pan left], [Tilt up], [Tracking shot] and [Static shot]. Keep to 1 or 2 per shot.

Motion words

Describe movement, not a photograph.

  • Use concrete verbs: "coils", "slides", "slams", not "is busy" or "moves around".
  • Write actions as beats or counts: "takes four steps, pauses, turns".
  • Describe the physical result: "debris scatters on impact", "steam curls and fades".
  • Set the pace: slow, gentle, steady, at walking pace.
  • Say what stays still: "camera holds", "hands rest on the table". This reduces jitter.

Audio cues

Every model with native audio fills an empty audio slot, usually with music. Write the sounds you want and add "no music" unless you want the model's music. Many creators generate sound effects only and add music at the audio step.

  • Name each sound: "rain on the window, low fridge hum, a cup set down at 3 s".
  • Dialogue: put lines in quotes, keep them short, split long speech across shots.
  • Veo 3.1: use SFX: and Ambient noise: labels and describe audio in separate sentences.
  • Seedance 2.5: () for music, <> for sound effects, {} for dialogue; name the language before non Chinese dialogue. Vietnamese is one of the 11 dialogue languages.
  • Kling 3.0: speaker, then tone and language in brackets, then the line: Boy (casual tone, Korean): "...". Give each speaker a unique label, never "he" or "she".

Even with "no music", models sometimes add it. Seedance's own FAQ lists "BGM despite no BGM" as a known issue, and one X user reports it inventing sound or ignoring the audio reference in about 15 to 20% of runs. Plan to replace the audio in the edit if needed.

What to avoid

AvoidWhyWrite instead
"cinematic", "stunning", "epic", "masterpiece"Empty words; models ignore them or go genericThe actual technique: "85mm, shallow focus, warm rim light"
Readable text, signs, logosModels garble textAdd text in the edit; attach logos as images
Two or three camera moves at onceShaky, unstable pictureOne move, or "static"
Several actions in one shotLater actions get droppedOne action, or split into shots
Long prompts with the key detail at the endLate instructions are droppedSubject and action first; give a stubborn detail its own sentence
Blanket negatives like "no people"Can empty a scene you wanted busyScope it: "no extra people except the customer"
"No X" on Veo and RunwayWorks less well than stating the goalDescribe the wanted state: "camera locked", "empty street"
Words like "shirtless" or "exposed" on KlingTrip the content filterDescribe the clothing that is there

Wan is the exception for negatives: it has a real negative prompt field. Add terms there only for artifacts you actually see (morphing, warping, face deformation, flicker).

Image to video or text to video

Text to videoImage to video
InputPrompt onlyFirst frame (and sometimes last frame) plus prompt
Best forExploring ideas, wide establishing shots, B rollCharacters, products, hero shots, anything that must match
What to writeEverything: all eight partsOnly what changes: the motion, the camera, the sound
Common mistakeExpecting the same face twiceRe-describing the image, which weakens the motion

An image to video prompt can be very short:

Prompt
Camera locked off. She lifts the cup, blows across it once, sips, and sets it
down, then her gaze drifts to the window. Steam curls and fades. The curtain
moves slightly in a breeze, then settles. Ambient café murmur, spoon clink.

Per model notes

ModelWhat is differentGuide
Seedance 2.0 and 2.5Subject first; 60 to 100 words; give every @Image, @Video, @Audio a job; 2.5 follows timestamps such as "[1s to 4s]", 2.0 only follows "Shot 1, Shot 2"; strict moderationSeedance
Kling 3.0Plain directional words beat ornate phrasing; Custom Multi Shot with "Shot 1, Shot 2"; timing cues like "At the 4th second"Kling
Veo 3.1Camera first (cinematography, subject, action, context, style); SFX: and Ambient noise: labels; can pull stylized characters toward realism, so state the styleGoogle
Gemini OmniLess detail needed; for one scene write "In a single continuous shot" and "No scene cuts"; for edits, one change per turn plus "Keep everything else the same"Google
Wan 3.0One move plus one action per shot; real negative prompt fieldWan
MiniMax H3 and HailuoBracket camera commands on Hailuo; image to video is the safer start for commercial shotsHailuo
Runway Gen-4.5The image is the first frame, so the prompt should be motion onlyRunway

Before and after

A story shot

Before:

Prompt
A cinematic, stunning shot of a sad man at a ferry terminal at night in the rain, epic mood, 4K, masterpiece.

After:

Prompt
Medium close up, 85mm lens, slow push in. RIO, early 30s, short black curly hair,
thin silver hoop in left ear, rust orange work jacket over a grey hoodie, stands
at a rain wet railing at a night ferry terminal. He exhales hard, breath visible,
watches the ferry lights leave, then stays still. Sodium orange and teal light,
light drizzle. Stylized 3D animated film look. Audio: heavy breathing, steady rain, no music.

What changed: the empty adjectives went, and the prompt now names the framing, lens, one move, a character with fixed traits, one action with an end state, the light, the style and the sound.

A product shot

Before:

Prompt
Our earbuds on a table with the brand name glowing, camera flying around and zooming in, cool music.

After:

Prompt
Macro lens, slow push in. The matte black wireless earbud case from the attached
image sits on wet slate. The lid slowly opens, a soft blue LED glows inside,
water droplets catch a rim light. Dark studio, shallow depth of field. Ends with
the case fully open and still. Audio: soft click of the lid, no music. No text.

What changed: one camera move instead of two, the product comes from an image, the brand name moves to the edit, and the audio is named instead of left to the model.

A dialogue shot (Veo 3.1)

Before:

Prompt
Two paramedics talk about whether the job gets easier, emotional conversation.

After:

Prompt
[00:00-00:03] Medium two shot, static, 50mm. MARA (40s, tired paramedic) and JUN
(20s, rookie) sit in an ambulance bay at night, fluorescent light.
[00:03-00:06] Close up on JUN. JUN: "Does it ever get easier?" Ambient noise: distant siren, rain on roof.
[00:06-00:08] Close up on MARA, she half smiles. MARA: "No. You get better." SFX: radio crackle.

What changed: the conversation became two short quoted lines, each speaker has a label and a description, every beat has a time, and the sound uses Veo's own labels.

Sources