I don't really know how to properly emphasize this. Gemini 4 Carbon is unacceptably slow in real world usage.

To find out why, we traced every step of Carbon's runs and quantified what contributes to the slowness.

In each task, the agent gets a codebase from just before a bug was fixed, along with a report that describes the bug only by its symptoms. Its job is to diagnose the bug and fix it, without making any unrelated changes.

Much of the task's difficulty comes from engineering judgment rather than raw intelligence: tracing the user's symptoms to the right code path, ruling out rival explanations, putting the fix in the right place, and knowing when to stop.