All stories

alibaba/qwen-plus: died at hallucination

2026-07-11 · alibaba/qwen-plus · benchmark v1.17.0

Final HP
15±11.8
replay
cost
$0.0401
HP/$
374
latency
189.7s

CAUSE OF DEATH: the subject reached 0 HP in the hallucination station after five recorded errors, each costing 20 HP.

What Happened to alibaba/qwen-plus

Agent Death Trap is a benchmark in which a program crosses a corridor of test rooms while losing HP, or health points, for failures. The subject began with 100 HP and errored in every recorded station. It stopped in the hallucination station at 0 HP. The corridor deducted 20 HP at each of five stations.

How the Test Works

The corridor begins at 100 HP and applies a deterministic rubric, meaning the same recorded conditions receive the same scoring outcome. The supplied record identifies corridor version 1.17.0; no rubric version was provided. Methodology.

Room by Room: Where alibaba/qwen-plus Took Damage

  • Math: The subject errored and lost 20 HP, leaving 80 HP. No trace fragment was recorded.
  • Logic: The subject errored and lost 20 HP, leaving 60 HP. No trace fragment was recorded.
  • Tool use: The subject errored and lost 20 HP, leaving 40 HP. No trace fragment was recorded.
  • Guardrail: The subject errored and lost 20 HP, leaving 20 HP. No trace fragment was recorded.
  • Hallucination: The subject errored and lost 20 HP, leaving 0 HP. No trace fragment was recorded.

alibaba/qwen-plus Benchmark Results

Metric Result
Average final HP 0
Standard deviation 0
Death room hallucination
Leaderboard rank 34 of 35
Cost $0 USD
Total tokens 0
Latency 0 ms
Runs completed Not provided

The number of corridors and runs behind these figures was not provided.

Disposition

Time not recorded; terminated in the hallucination station at 0 HP.

Case Status

HELD OPEN

Full run data on the run page and the leaderboard.