Benchmarks
Complete Film vs Clip: The AI Video Benchmark That Matters
Film evidence
A complete-film benchmark reveals compounding errors
This cut is long enough for small defects to accumulate: repeated compositions, broken screen direction, timing drift, inconsistent weather, or an ending that feels detached from the opening. Those production risks stay invisible in a short highlight reel.
Judge the uninterrupted export first. Only then inspect individual shots. The benchmark is not whether the best frame is impressive; it is whether the film remains coherent, audible, correctly framed, and editorially purposeful from first image to final beat.
Omaha Beach: The Reality of D-Day · 03:01 · Full generated cut. This is a finished first-party Onira production, not customer proof or archive footage.
View the full film and production notesWhat to watch for
- Continuity over the full three-minute runtime
- Narration, score, and visuals remain synchronized
- The ending resolves the sequence instead of merely exhausting assets
AI video marketing usually presents the strongest unit a system can produce: one frame, one shot, or a short montage of shots. That evidence can show visual capability. It cannot show whether the system can produce a film.
A complete film adds dependencies that do not exist inside a selected clip. The opening has to make a promise. The middle has to develop it. The ending has to resolve or transform it. Voice, picture, music, sound effects, and captions have to share one timeline. People, places, objects, and actions have to remain understandable across time.
The benchmark should match the buyer's actual job.
A clip benchmark rewards selection
When a vendor publishes one excellent generation, the viewer cannot see how many candidates were rejected, which external tools were used, how much manual compositing occurred, or whether the shot belongs to a coherent sequence.
That does not make the shot deceptive. It makes it incomplete evidence for a production claim.
A useful clip evaluation can still ask about prompt adherence, motion, physics, identity, camera behavior, artifacts, and cost. Those are legitimate model-level questions. They are simply not enough to answer whether a creator can finish a story.
A complete film exposes coordination
The complete-film test reveals whether the production can preserve commitments across departments.
- Does the spoken story match the visual sequence?
- Does the sequence develop rather than repeat?
- Do recurring people and places remain recognizable?
- Does each shot have an editorial purpose?
- Does the score support the arc without masking speech?
- Are captions accurate and synchronized?
- Does the ending pay off the beginning?
- What factual, rights, and disclosure work remains?
These questions shift attention from raw generation to production architecture. A stronger model can improve many shots, but the studio still needs to decide which shots belong, what they mean, and when they should appear.
The benchmark needs production context
The public film should include enough information to interpret it honestly: full runtime, aspect ratio, authorship, production date, relevant settings, intervention, source or reconstruction disclosure, and whether external editing changed the export.
Internal first-party work should be labeled as internal. Customer work should not be implied unless a real customer granted permission. A first cut should not be called unedited unless that has been verified. A selected run should not be described as typical without a reproducible sample.
This context does not weaken proof. It makes the proof usable.
Accepted output is the right denominator
Production economics should also use the complete result. Cost per generated second ignores retries, rejected takes, correction time, and work that never reaches publication.
Measure instead:
- time to first acceptable cut;
- human correction time;
- settled provider and platform cost;
- percentage of runs accepted;
- percentage of accepted films published;
- whether the creator starts a second project.
These measures can reveal that a more expensive generation route creates a cheaper accepted film, or that a fast first cut creates too much downstream correction.
Onira's public standard
Onira should be judged by the films in its complete film library, not by the best frame on the homepage. Each film needs a visible boundary between what it demonstrates and what it does not prove.
The AI film review guide explains how to inspect a sequence before release. The current capabilities page states the production limits that a showcase should never silently override.
As visual models improve, remarkable clips will become more common. The scarce evidence will be a coherent, reviewable film and a production operation willing to disclose how it reached acceptance.