NodeBB/NodeBB/51d8f3b195bddb13a13ddc0de110722774d9bb1b · vf2cf3cbd463b7ad942381f1c6d077626485a1e9e

Fix for NodeBB/NodeBB@51d8f3b1

Verdict

17.5%
Lineman saved $0.0734
Baseline cost$0.4201
Lineman cost$0.3467
Baseline turns21
Lineman turns21
Baseline duration1m 45s
Lineman duration1m 13s
Lineman version0.1.0

Quality - SWE-bench Docker Harness

Baseline
Not yet evaluated
Lineman
Not yet evaluated

Analysis

(narrative skipped)

Baseline

Turns21
Tool calls20
Cache read614,464
Cache write39,848
Output tokens5,754
Total cost$0.4201

Lineman

Turns210%
Tool calls200%
Cache read481,577-22%
Cache write37,000-7%
Output tokens4,196-27%
Total cost$0.3467

Tool Call Timeline

#Baseline toolCharsLineman toolCharsΔ
1Read/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-baseline-instance_NodeBB__NodeBB-51d8f3b195bddb13a13ddc0de110722774d9bb1b-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e/ISSUE.md977linemanread_file ISSUE.md1.3k+30%
2Bashls /private/var/folders/04/qmf7f1qx7nj2_2mczkd4mst313Globsrc/routes/**/*.js535+71%
3Bashfind /private/var/folders/04/qmf7f1qx7nj2_2mczkd4m403linemanread_file_context src/routes/index.js — well-known webfinger change-password route48-88%
4Bashls /private/var/folders/04/qmf7f1qx7nj2_2mczkd4mst105linemanread_file_context src/routes/user.js — well-known change-password webfinger48-54%
5Grepwell-known|webfinger|change-password59Grepwell-known|webfinger|change-password78+32%
20Edit/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-baseline-instance_NodeBB__NodeBB-51d8f3b195bddb13a13ddc0de110722774d9bb1b-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e/src/routes/user.js303edit_file/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-lineman-instance_NodeBB__NodeBB-51d8f3b195bddb13a13ddc0de110722774d9bb1b-vf2cf3cbd463b7ad942381f1c6d077626485a1e9e/src/routes/index.js214-29%
Total26.5k23.4k-12%