<report>

Runway

Gen-4.5

v-benchmark v2 by Megaton benchmark
Evaluated · August 11, 2026Leaderboard rank #10 of 11Last updated · August 11, 2026

60.53

/ 100

Categories

C01

Prompt AdherenceWhether every explicit, observable instruction in the prompt is fulfilled.

This Video

100.0

This Video · Assessment

This video fulfills its explicit, observable instructions with near-complete consistency.

This Category

76.0

60 videos were rated for this category

This Category · Assessment

Most prompt requirements are fulfilled, though complex combinations or secondary details recur as limitations.

Models that scored similarly on this category

C02

Scene ConsistencyWhether established subjects, objects, spatial relationships, environment, and lighting remain coherent over time.

This Video

49.0

This Video · Assessment

This video maintains subjects, objects, spatial relationships, environment, and lighting over time only partly reliably, with frequent important failures.

This Category

78.1

60 videos were rated for this category

This Category · Assessment

Scenes remain stable overall, though bounded identity, lighting, or relationship drift recurs.

Models that scored similarly on this category

C03

PhysicsWhether the central motion, force, material, and reaction behave coherently in the requested world and style.

This Video

50.0

This Video · Assessment

The intended physical event is recognizable, but repeated important defects leave it only partly convincing.

This Category

38.8

17 videos were rated for this category

This Category · Assessment

Central physical events occur, but their behavior is often clearly implausible.

Models that scored similarly on this category

C04

Human FidelityWhether faces, eyes, skin, bodies, hands, motion, and human presence remain anatomically and perceptually convincing.

This Video

90.0

This Video · Assessment

Highly convincing, with one very small localized defect.

This Category

67.4

27 videos were rated for this category

This Category · Assessment

People remain believable in most cases, though uncanny or anatomical defects recur under inspection.

Models that scored similarly on this category

C05

2D Animation Craft & ArtistryThe quality and artistic authorship of intentionally 2D animation within its requested conventions.

This Video

40.0

This Video · Assessment

The requested 2D style is present, but its animation is consistently poorly executed.

This Category

47.5

12 videos were rated for this category

This Category · Assessment

Coherent 2D craft appears only in some cases; line, timing, pose, or medium-authenticity failures recur frequently.

Models that scored similarly on this category

C06

3D Animation Craft & ArtistryThe quality, coherence, and artistic authorship of intentionally 3D animation.

This Video

50.0

This Video · Assessment

The intended 3D animation is recognizable, but repeated technical or expressive defects leave it only partly convincing.

This Category

44.0

5 videos were rated for this category

This Category · Assessment

Convincing 3D craft appears only in some cases; articulation, contact, rendering, or staging failures recur frequently.

Models that scored similarly on this category

C07

Cinematography Craft & ArtistryShot design, framing, camera movement, lighting, focus, visual hierarchy, and intentional filmmaking authorship.

This Video

60.0

This Video · Assessment

Coherent and competent but synthetic, mechanical, or visually underdeveloped.

This Category

70.0

7 videos were rated for this category

This Category · Assessment

Shot design is technically strong overall, though recurring choices are more conventional or less expressive.

Models that scored similarly on this category

C08

Taste & Art DirectionThe strength, specificity, coherence, and artistic authorship of the result as a finished creative choice.

This Video

50.0

This Video · Assessment

Several successful individual choices are present, but repeated inconsistencies leave the overall art direction only partly resolved.

This Category

49.7

60 videos were rated for this category

This Category · Assessment

Strong art direction appears only in some cases; weak hierarchy, cliché, clutter, or stylistic indecision recurs frequently.

Models that scored similarly on this category

C09

Animal & Creature FidelityWhether real animals and designed creatures preserve convincing anatomy, identity, motion, behavior, and interaction.

This Video

30.0

This Video · Assessment

Severe anatomical, surface, gait, or behavioral failures.

This Category

61.4

7 videos were rated for this category

This Category · Assessment

Animals and creatures remain believable in most cases, though synthetic anatomy, motion, or behavior recurs.

Models that scored similarly on this category

C10

Object & Product FidelityWhether requested objects have correct identity, structure, materials, details, motion, and interactions.

This Video

100.0

This Video · Assessment

This video preserves the requested objects’ identity, structure, materials, details, motion, and interactions with near-complete consistency.

This Category

74.4

8 videos were rated for this category

This Category · Assessment

Objects remain correct and stable overall, though recurring secondary details or interactions are imperfect.

C11

Causal & Semantic CoherenceWhether events, relationships, transformations, and cause-and-effect remain semantically coherent, including surreal premises.

This Video

90.0

This Video · Assessment

Highly coherent, with one small localized ambiguity.

This Category

72.7

11 videos were rated for this category

This Category · Assessment

Events remain clear overall, though recurring logical irregularities are visible but bounded.

Models that scored similarly on this category

C12

Text FidelityWhether requested text content, typography, placement, attachment, legibility, and temporal stability are correct.

This Video

61.1

This Video · Assessment

This video preserves requested text content, typography, placement, attachment, legibility, and temporal stability in a generally coherent way, though visible failures recur.

This Category

47.2

7 videos were rated for this category

This Category · Assessment

Only some text is rendered reliably; spelling, legibility, placement, or temporal failures are frequent.

Models that scored similarly on this category

C13

Character Performance & ActingWhether character intention, emotion, timing, reactions, eyelines, gesture, and performance read convincingly.

This Video

80.0

This Video · Assessment

Professional, clear, and convincing, but more conventional or less nuanced.

This Category

63.0

21 videos were rated for this category

This Category · Assessment

Acting is generally believable, but synthetic timing, expression, attention, or specificity recurs.

Models that scored similarly on this category

Differences between other models

CategoryGen-4.5Kling 3 StandardSeedance 2.0 MiniVeo 3.1LTX 2.3 22B
C01Prompt Adherence76.082.687.779.573.0
C03Physics38.857.650.645.340.0
C02Scene Consistency78.182.578.080.064.2
C04Human Fidelity67.479.664.865.950.7
C052D Animation Craft & Artistry47.544.561.747.533.3
C063D Animation Craft & Artistry44.066.062.049.042.5
C11Causal & Semantic Coherence72.766.470.965.546.4
C08Taste & Art Direction49.763.360.751.942.0
C07Cinematography Craft & Artistry70.075.764.362.958.6
C09Animal & Creature Fidelity61.471.482.967.144.3
C10Object & Product Fidelity74.489.988.495.648.3
C12Text Fidelity47.230.363.841.711.6
C13Character Performance & Acting63.059.063.062.041.0

Leaderboard

Methodology

The Megaton Index is the published 0–100 weighted summary for v-benchmark v2. This public report shows the model's Index and category scores; the full calibration evidence, decision records, and scoring implementation are reserved for the full report.

Read the full methodology →

Changelog

Videos generated by
Runway API on August 11, 2026
Evaluated
August 11, 2026
Benchmark
v-benchmark v2 by Megaton
Publication
1.0.0