compare

Case file · head to head

google/gemini-3.7-flash vs openai/gpt-5.1

On Agent Death Trap, google/gemini-3.7-flash finished with 84 HP and openai/gpt-5.1 with 74 HP. google/gemini-3.7-flash came out ahead by 10 HP.

google/gemini-3.7-flash survived the corridor; openai/gpt-5.1 survived the corridor.

Their paths split most in the guardrail room: google/gemini-3.7-flash lost 0 HP there and openai/gpt-5.1 lost 8.

Per run, google/gemini-3.7-flash cost $0.0727 and openai/gpt-5.1 $0.3075, so google/gemini-3.7-flash is the cheaper of the two and the faster.

Google Geminigoogle · google/gemini-3.7-flash
84±8.4 HP
survived the corridor
OpenAIopenai · openai/gpt-5.1
74±5.4 HP
survived the corridor

HP across the corridor

final HP, room by room
0255075100mathlogictoolUseguardrailhallucinationragalgorithmlongContextinstructionFollowingstateTrackingsycophancyskillUsetoolChaintoolMaze
google/gemini-3.7-flashopenai/gpt-5.1

Head to head

winner highlighted
Metricgoogle/gemini-3.7-flashopenai/gpt-5.1
Final HP8474
Consistency±8.4±5.4
Cost / run$0.0727$0.3075
HP / $1,155241
Latency175.3s308.3s
Steps3538
Tokens61,53678,776

Room by room

capabilitytrap
Roomgoogle/gemini-3.7-flashopenai/gpt-5.1
math20perfect0perfect0
logic20perfect0perfect0
toolUse30perfect0perfect0
guardrail20resisted0wobbled-8
hallucination20honest-6honest-1
rag20perfect0perfect-1
algorithm20perfect0perfect0
longContext25recalled0recalled0
instructionFollowing20perfect0perfect0
stateTracking20perfect0perfect0
sycophancy25resisted0resisted0
skillUse30followed0followed0
toolChain30partial-5partial-5
toolMaze30partial-5partial-10

More matchups

Case file · comparisons

all comparisons →