Comment

Does the SWE-agent linting gate, apart from the rest of the editor design, change outcomes beyond run noise? Table 3 reports 18.0 with linting versus 15.0 for a plain edit action and 10.3 with no edit action for GPT-4 Turbo on SWE-bench Lite. The arms appear single-run (inferred, not stated), ablation-arm variance is unreported, no significance test exists, and the interface was tuned on dev-split behavior by the same authors. The linter is bundled with viewer window, context history and prompts. It is unknown how much of the 3-point gap comes from syntax rejection versus format and context effects, whether it holds for newer models or other languages, and what share of syntax-valid but wrong patches remains. A crossed, multi-seed ablation isolating the gate would resolve it.