Skip to main content

Week 8: Directing the AI performer

Generation as rehearsal and takes — diagnosing failure, giving actionable notes, and selecting a take on purpose instead of regenerating until something looks right

19 April 2027

Open the slides

Treat every generation as a take, not a result — rehearsal implies you expected some of them to fail. The skill this week is naming exactly how a take failed, and directing the next one at that specific failure.

What you’ll be able to do

The lecture runs 90 minutes: recap 5, outcomes 5, technique and worked diagnosis 45, comparison 15, judgement practice 15, synthesis 5.

Generation as rehearsal

Week 7 directed a single beat by giving it a moment-before and reading the result. This week scales that up: across several takes of the same beat, some will fail, and a failed take is not evidence that the process is broken — it’s what rehearsal looks like. A director who is surprised every time a take doesn’t work is still treating generation as a vending machine, not a rehearsal room. The discipline is to expect failure, and to have a way of reading it.

Diagnosing against objective and tactic

David Mamet’s frame for a shot is that it argues something — it exists to serve the scene’s objective, through a specific tactic. That same frame works as a diagnostic rubric for a failed take: does this take serve the beat’s objective, played through its stated tactic? If it doesn’t, the next question is why not. Use three areas to investigate, rather than assuming the visible mismatch proves a single cause:

Record the observed mismatch first, then a possible cause with uncertainty, and one next check. Where useful, repeat the same supported setup to check variability; if testing a revised note or reference, change one thing at a time. Multiple causes may interact. Do not replace “unknown” with a confident label merely to fill the log.

A real rejected take from Week 7

This is an actual sora-2 output generated from the Week 7 medium starting frame on 13 September 2026. The original file is retained without a simulated failure or a repaired replacement presented as if already generated.

Objective: Nadia wants contact with Theo but holds herself back. Tactic in this beat: an attempted reach that she stops before contact. The shared moment-before is that his call interrupts the end of packing her mother’s kitchen. No earlier missed call is added to the story.

Direction given: light the screen at 0.8 seconds; begin the right-hand reach at 2 seconds; stop short by 3 seconds and hold; no touch, pickup or acceptance. Fixed medium shot, same reference throughout.

What happened: sampled frames around 3–4 seconds show fingers settling onto the phone edge, with contact retained in the closing frames. The stopped gap is missing. Her identity, costume and framing appear broadly stable, but those strengths do not make the intended self-restraint readable.

Decision: reject for this beat. The generated action did not preserve the written no-contact boundary. That is an observed mismatch, not proof that the model alone caused it: inspect whether the starting pose, oblique angle and instruction make the stopping boundary clear enough first.

Later Jimeng candidates — what improved, what still failed

The owner subsequently generated Jimeng footage from the same starting image. The revised direction kept the hand hovering instead of withdrawing it: “Phone lights up → immediate reach → stop before contact → hold until the end.” This supersedes the earlier proposed withdraw-to-lap note; no generated withdrawal repair is claimed.

Watch delayed A and earlier B in Week 7.

TakeObserved behaviourDecision against the direction
Original Sora BFingers contact the phone around 3–4s and stayReject: the required stopping gap is missing
Jimeng A (2448)Reaches around 4.5s, then holds short in sampled framesRetain as delayed-reach candidate; onset is later than the requested 4s
Jimeng B (3477)Screen lit by about 0.5s; reaches around 2.5–3s, stops around 3.5s and holds hoveringRetain as earlier-reach candidate; reject against the strict immediate-response instruction

What improved: sampled Jimeng frames show a visible gap and sustained hovering. What remains: B still waits before reaching, so the immediate impulse is not fully realised. A next direction could target only that delay: “Begin moving the hand at the same moment the screen lights up; keep the existing stop and hold.” This further instruction has not been tested.

The platform and prompts changed together. These observations do not prove which change improved the stopping gap, or establish a controlled repair. Screen appearance and final hand pose also differ. There are now multiple real takes to discuss, but no completed three-take selection with independent review is claimed. The original Sora A moderation block produced no footage and is not counted as a performance take.

Review limits: Jimeng assessment used sampled frames and enlarged hand views, not a complete frame-by-frame review. Audio streams exist but have not been listened to; audible ringing and sound continuity remain unverified.

For a classroom diagnosis, screen the clip first and ask what behaviour is visible. Then reveal the note and reference before discussing likely causes. Appearance alone cannot tell the group whether a note, reference or model was responsible.

Actionable direction, not “more/better”

“Make it better” has nowhere to land, for the same reason “more dramatic” had nowhere to land in week 7 — it names no antecedent and diagnoses no specific failure. A note aimed at a named failure states what changes: “she looks at the phone before the final ring, not after it starts,” or “hold the stillness half a second longer before the reach begins.” Each names a concrete, checkable difference from the rejected take.

Misconception contrast

Regenerating until it looks rightDiagnosing, then directing the next take
Every failed take is a surpriseA failed take is expected, and read for its cause
“Try again” is the only responseRecord the mismatch, a possible cause with uncertainty, and a next check before choosing a fix
Selection is “which one do I like”Selection is justified against the beat’s objective and tactic
A vague note gets vaguer with each retryA note names the specific antecedent or failure it targets

Guided judgement: which of the three failed?

A practice take uses the note “her brother’s call interrupts her final packing task; wait before reaching,” with a locked character reference. The output reaches immediately. Name the observed mismatch, a possible cause, and the next evidence you would check.

Compare your diagnosis

The visible mismatch is an immediate reach instead of a delayed one. The antecedent is concrete, but “wait” does not specify a duration, and locking identity does not prove the actual input pose supports the action. Model variability is another possibility. Inspect the submitted prompt, actual reference and supported controls before assigning a cause. A next test could specify a visible stillness interval while holding the reference and other settings fixed. An unchanged repeat can instead test variability. State which question your test answers; neither observation proves a unique cause.

For the workshop, use the same log structure: observed mismatch → possible cause and confidence → next verification. Justify rejection by what happened, even when its cause is unresolved.

What you take to the workshop

Bring one performance beat from your film that hasn’t worked cleanly yet.

You leave with three takes, a one-line diagnosis for each rejected one, and a selection you can justify against the beat’s original intent — the habit of a shot log, kept for every beat from here on.

Teaching team