qutebrowser/qutebrowser/f91ace96223cac8161c16dd061907e138fe85111 · v059c6fdc75567943479b23ebca7c07b5e9a7f34c

Fix for qutebrowser/qutebrowser@f91ace96

Verdict

+12.8%
Lineman cost extra $0.0703
Baseline cost$0.5492
Lineman cost$0.6195
Baseline turns27
Lineman turns32
Baseline duration2m 14s
Lineman duration3m 58s
Lineman version0.1.0

Quality - SWE-bench Docker Harness

Baseline
Not yet evaluated
Lineman
Not yet evaluated

Analysis

(narrative skipped)

Baseline

Turns27
Tool calls26
Cache read877,925
Cache write43,481
Output tokens8,180
Total cost$0.5492

Lineman

Turns32+19%
Tool calls31+19%
Cache read1,150,786+31%
Cache write34,470-21%
Output tokens9,659+18%
Total cost$0.6195

Tool Call Timeline

#Baseline toolCharsLineman toolCharsΔ
1Read/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-baseline-instance_qutebrowser__qutebrowser-f91ace96223cac8161c16dd061907e138fe85111-v059c6fdc75567943479b23ebca7c07b5e9a7f34c/ISSUE.md671linemanread_file /private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-lineman-instance_qutebrowser__qutebrowser-f91ace96223cac8161c16dd061907e138fe85111-v059c6fdc75567943479b23ebca7c07b5e9a7f34c/ISSUE.md1.2k+72%
2Glob**/*.py3.8klinemanread_file /private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-lineman-instance_qutebrowser__qutebrowser-f91ace96223cac8161c16dd061907e138fe85111-v059c6fdc75567943479b23ebca7c07b5e9a7f34c/qutebrowser/misc/qtlog.py251-93%
3Grephide_qt_warning118Glob**/qtlog.py26-78%
4Grephide_qt_warning777Glob**/test_*log*.py125-84%
5Glob**/qtlog.py26linemanread_file /private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-lineman-instance_qutebrowser__qutebrowser-f91ace96223cac8161c16dd061907e138fe85111-v059c6fdc75567943479b23ebca7c07b5e9a7f34c/qutebrowser/utils/qtlog.py48+85%
31edit_file/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-lineman-instance_qutebrowser__qutebrowser-f91ace96223cac8161c16dd061907e138fe85111-v059c6fdc75567943479b23ebca7c07b5e9a7f34c/scripts/dev/run_vulture.py231
Total32.3k38.1k+18%