qutebrowser/qutebrowser/c580ebf0801e5a3ecabc54f327498bb753c6d5f2 · v2ef375ac784985212b1805e1d0431dc8f1b3c171

Fix for qutebrowser/qutebrowser@c580ebf0

Verdict

+29.1%
Lineman cost extra $0.0459
Baseline cost$0.1576
Lineman cost$0.2035
Baseline turns5
Lineman turns7
Baseline duration28.4s
Lineman duration34.0s
Lineman version0.1.0

Quality - SWE-bench Docker Harness

Baseline
Not yet evaluated
Lineman
Not yet evaluated

Analysis

(narrative skipped)

Baseline

Turns5
Tool calls4
Cache read100,830
Cache write29,068
Output tokens1,219
Total cost$0.1576

Lineman

Turns7+40%
Tool calls6+50%
Cache read146,865+46%
Cache write35,147+21%
Output tokens1,840+51%
Total cost$0.2035

Tool Call Timeline

#Baseline toolCharsLineman toolCharsΔ
1Read/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-baseline-instance_qutebrowser__qutebrowser-c580ebf0801e5a3ecabc54f327498bb753c6d5f2-v2ef375ac784985212b1805e1d0431dc8f1b3c171/ISSUE.md1.4klinemanread_file ISSUE.md1.7k+20%
2Glob**/*block*537Grepblocking606+13%
3Read/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-baseline-instance_qutebrowser__qutebrowser-c580ebf0801e5a3ecabc54f327498bb753c6d5f2-v2ef375ac784985212b1805e1d0431dc8f1b3c171/qutebrowser/components/hostblock.py11.3klinemanread_file qutebrowser/components/hostblock.py107-99%
4Edit/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-baseline-instance_qutebrowser__qutebrowser-c580ebf0801e5a3ecabc54f327498bb753c6d5f2-v2ef375ac784985212b1805e1d0431dc8f1b3c171/qutebrowser/components/hostblock.py330linemanread_file_context qutebrowser/components/hostblock.py — blocking check hostname blocked hosts whitelist48-85%
5linemanread_file_full qutebrowser/components/hostblock.py11.3k
6edit_file/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-lineman-instance_qutebrowser__qutebrowser-c580ebf0801e5a3ecabc54f327498bb753c6d5f2-v2ef375ac784985212b1805e1d0431dc8f1b3c171/qutebrowser/components/hostblock.py240
Total13.6k14.0k+3%