Repository navigation
Description
Goal and scope
C1.T5, tracked under #351 (roadmap #263).
Support reverse generation for character replacement when selected people enter the scene one after another. Plan from an identifiable later anchor, generate toward earlier source time, then restore chronological playback for assembly.
Motivation and experience from #9194
The reported character-replacement experience in vllm-project/vllm-omni#9194 found substantially better replacement with reverse generation in scenes where people appear progressively. Starting from a later view with the selected people already identifiable gives the workflow an opportunity to establish their assigned identities before continuing toward earlier frames.
The skill's planning guidance supports selecting a later multi-person anchor, generating outward from it, and using backward continuation by reversing the source and restoring generated frames afterward. This is the planning rationale for testing reverse generation; the explanation is a working hypothesis, and the observed advantage is specific to the tested scenes. The skill explicitly requires a new plan for new footage and verification of actual quality.
Source: video-segment.md at PR head 0becba4.
User flow and key rules
- Inspect the full shot and record each selected person's entrance, visibility, occlusion and departure. Choose a later anchor where the assigned people are identifiable.
- Compare forward and reverse plans for the same excerpt. Record why the chosen direction fits its character visibility and action.
- Reverse the source deliberately and align references, guide intervals, prompts and continuation dependencies with generation direction. Preserve each person's stable mapping when local reference indices change.
- Keep generation dependency order separate from chronological assembly order. Reverse generated frames back, trim overlaps exactly once and restore the source soundtrack in forward time.
- Use shared project operations and preserve execution snapshots, authorization, locks and revisions.
Implementation impact
Coordinate planning/recovery with #261, source preparation and editable assembly with #262 and workbench #212, and model/guide/direction contracts with #264. Verify the selected backend can express the actual inputs before execution.
Deliverables and acceptance cases
A reusable later-anchor selection and reverse-generation procedure, direction-aware references/guides/prompts, chronological restoration and source/forward/reverse comparisons.
What a Day #358 — compare both directions on the inspected sequential-entrance segment within 01:19–01:46. Save exact comparison intervals and review all affected identity mappings.
Deliver the applicable built-in /character-replacement skill guidance, required capability fixes and case evidence. Existing capabilities may satisfy the task when verified; record any skill changes or the no-change verification result. The same case run may provide evidence for several capability tasks.
Acceptance criteria
- On a scene with sequential character entrances, compare forward and reverse generation using the same source, mappings, appearance scope, model/LoRA settings, resolution and resource constraints. Record direction-specific anchors, guides, prompts and seeds.
- Review replacement identity and mapping, late entrants, motion, clothing, background and joins. Attach source/forward/reverse comparisons and state where the observed advantage holds or fails.
- Verify reversed source/guide ranges, continuation dependencies, restored playback direction, frame coverage, overlap trimming and original audio timing.
- Preserve editable project state after reopening and record actual inputs, outputs, failures and remaining quality defects.
Built-in skill
Update the built-in /character-replacement skill with the sequential-entrance use case, later-anchor selection, direction-aware planning and restoration steps, and forward/reverse comparison evidence. Validate the updated instructions through a corresponding C1 case and record skill changes and execution evidence in the implementation PR.
Activity