A Very Big Video Reasoning Suite

We bet on a future that video reasoning is the next fundamental intelligence paradigm, after language reasoning, where spatiotemporal embodied world experiences could be more naturally captured.

Data Engines

View All
circle_largest_numerical_value
GitHub
Knowledge out-of-domain testset
The scene shows 4 numbers on a white canvas. First compare the numerical values of all numbers, then draw one red circle around the single largest number. Do not circle any other numbers. Show the complete circling process step by step.
First Frame
Last Frame
return_to_correct_bin
GitHub
Abstraction training set
Move each item into the bin that matches its color. Only move items, do not change anything else.
First Frame
Last Frame
grid_shortest_path
GitHub
Spatiality in-domain testset
The scene shows a 10x10 grid with a green start square (containing a purple circular agent) and a red end square. Starting from the green start square, the agent can move to adjacent cells (up, down, left, right). The goal is to move the agent to the red end square along the shortest path.
First Frame
Last Frame
symbol_edit
GitHub
Transformation out-of-domain testset
The sequence currently has 1 of symbol △. Constraint: at least 4 of symbol △. Insert 3 △ symbols at positions 1, 3, and 7 to satisfy the constraint.
First Frame
Last Frame
mark_tangent_point_of_circles
GitHub
Perception out-of-domain testset
Look at the circles on the screen. Please circle the tangent point of the two circles that are touching.
First Frame
Last Frame

Inference Results

View Full Bench
High Density Liquid - Samples
00
01
02
03
04
Task Domains 1/5
High Density Liquid
Knowledge out-of-domain testset
Sliding Puzzle
Abstraction in-domain testset
Directed Graph Navigation
Spatiality in-domain testset
Symbol Edit
Transformation out-of-domain testset
Pigment Color Mixing
Perception out-of-domain testset
Prompt
Loading...
Ground Truth
First
First Frame
Final
Final Frame
Model Outputs
1/
VBVR-Wan2.2
VBVR-Wan2.2
CogVideoX 1.5
Kling 2.6
LTX-2
Runway Gen-4
Sora 2
Veo 3
Wan 2.2 I2V
Hunyuan I2V
Seedance 2.0

Leaderboard

Modality
Split
Type
Category
2026-04-28