Compare capabilities

What each rating means here

Strong

Reliably solves complex multi-step problems — handles logic puzzles, mathematical proofs, and extended chain-of-thought reasoning with high accuracy.

Moderate

Handles straightforward reasoning tasks well but makes errors on longer inference chains or adversarial logic problems.

Weak

Frequently fails on problems requiring more than one or two reasoning steps; prone to confident-sounding but incorrect answers.

What each rating means here

Strong

Writes correct, idiomatic code for complex tasks and debugs reliably across major languages; handles algorithmic and architectural decisions.

Moderate

Solid at common patterns and languages; struggles with complex algorithms, obscure libraries, or large codebase context.

Weak

Produces working code only for simple, well-trodden patterns; frequent bugs and hallucinated APIs on anything non-trivial.

What each rating means here

Strong

Reliably selects and calls the correct tool with well-formed parameters; handles multi-turn tool loops and chained dependent calls gracefully.

Moderate

Gets basic tool calls right but struggles with ambiguous tool selection, malformed prior outputs, or calls requiring context from earlier turns.

Weak

Inconsistent parameter formatting; prone to hallucinating tool names or arguments, or selecting the wrong tool.

What each rating means here

Strong

Follows complex multi-constraint instructions precisely — respects format, length limits, persona, and negative instructions consistently.

Moderate

Handles simple instructions well but drifts on multi-constraint prompts or instructions that conflict with the model's trained defaults.

Weak

Often ignores or partially follows instructions; defaults to its own style regardless of stated format or constraint requirements.

What each rating means here

Strong

Reliably attends to information throughout a long context — accurately recalls and synthesises content from early in a large document or conversation.

Moderate

Handles mid-length contexts well; recency bias emerges as context grows — information near the start of a long prompt is sometimes lost.

Weak

Loses track of earlier content in long contexts; practical reliable length is significantly shorter than the advertised token ceiling.

Variable

Recall quality depends on content type and its position in the context — performance varies across providers and benchmark methodologies.

What each rating means here

Strong

High-quality outputs across many major languages; reliable at translation and cross-lingual reasoning with consistent grammar and factual accuracy.

Moderate

Good at widely-spoken languages (Spanish, French, German, Chinese) but quality degrades noticeably for lower-resource languages.

Weak

Primarily English-optimised; outputs in other languages may be fluent but are factually unreliable or grammatically inconsistent.

What each rating means here

Strong

High throughput — fast first-token latency and generation speed well-suited to real-time, interactive, and high-volume applications.

Moderate

Adequate for most use cases; may introduce noticeable latency in latency-sensitive or streaming applications.

Weak

Slow generation; adds significant per-token latency and raises cost at scale.

Variable

Speed varies with generation length, prompt complexity, and server load — check provider latency benchmarks for your specific use case.

What each rating means here

Strong

Smooth, physically plausible motion with natural acceleration, fluid transitions, and minimal warping or temporal artifacts.

Moderate

Motion is mostly convincing but shows subtle jitter, unnatural acceleration, or occasional warping on complex or fast-moving scenes.

Weak

Obvious motion artifacts — jitter, warping, or frame-to-frame inconsistency undermine the realism of the clip.

What each rating means here

Strong

Subjects and backgrounds remain stable throughout the clip — no identity drift, face morphing, or background flicker across frames.

Moderate

Generally stable but shows gradual drift or minor flickering on fine details, particularly in longer or complex clips.

Weak

Noticeable identity drift or background inconsistency; subjects may morph or lose visual detail mid-clip.

What each rating means here

Strong

Closely follows the text description — correct subject, action, style, and camera direction with high fidelity throughout the clip.

Moderate

Captures the main subject and action but may miss stylistic details, camera instructions, or specific secondary elements.

Weak

Captures the general mood or subject but frequently ignores specific actions, style direction, or compositional instructions.

Variable

Adherence varies with prompt complexity — reliable for simple descriptions, inconsistent for compound or highly specific instructions.

What each rating means here

Strong

Generates synchronised, contextually appropriate audio — ambient sound, foley, or music — that matches the on-screen action naturally.

Moderate

Produces audio alongside video but synchronisation or contextual fit is imperfect; works best for simple scenes.

Weak

No native audio support, or generated audio is clearly mismatched with the visual content.

What each rating means here

Strong

Produces large, high-quality native output at 1080p or above across multiple aspect ratios before any upscaling is needed.

Moderate

Solid at standard sizes; native quality degrades at higher resolutions — upscaling is needed for HD or large-format delivery.

Weak

Limited to lower native resolutions; quality degrades quickly as output dimensions increase.

Variable

Usable resolution depends on the chosen endpoint, plan, or quality setting — check provider specifications for your target output size.

What each rating means here

Strong

Fast generation — produces clips quickly relative to their length, keeping cost-per-second of output low.

Moderate

Typical generation time; fine for batch or async workflows but noticeable latency in interactive or real-time use.

Weak

Slow to generate, raising both latency and cost-per-second of output significantly relative to clip length.

Variable

Speed scales with clip length and resolution — fast for short clips at standard quality, much slower at maximum length or resolution.

What each rating means here

Strong

Generates clips of 10 seconds or longer in a single pass with consistent quality throughout.

Moderate

Manages 5–10 seconds reliably; quality or coherence may degrade toward the end of longer clips.

Weak

Limited to short clips (under 5 seconds); stitching multiple clips is required for longer sequences.

Variable

Maximum duration depends on the chosen resolution or quality setting — higher settings reduce the achievable clip length.