gravitational/teleport/3fa6904377c006497169945428e8197158667910 · v626ec2a48416b10a88641359a169d99e935ff037

Fix for gravitational/teleport@3fa69043

Verdict

29.3%
Lineman saved $0.1420
Baseline cost$0.4847
Lineman cost$0.3426
Baseline turns25
Lineman turns20
Baseline duration1m 40s
Lineman duration1m 9s
Lineman version0.1.0

Quality - SWE-bench Docker Harness

Baseline
Not yet evaluated
Lineman
Not yet evaluated

Analysis

(narrative skipped)

Baseline

Turns25
Tool calls24
Cache read752,908
Cache write44,088
Output tokens6,225
Total cost$0.4847

Lineman

Turns20-20%
Tool calls19-21%
Cache read521,223-31%
Cache write40,101-9%
Output tokens2,388-62%
Total cost$0.3426

Tool Call Timeline

#Baseline toolCharsLineman toolCharsΔ
1Read/private/var/folders/04/qmf7f1qx7nj2_2mczkd4msth0000gn/T/bench-baseline-instance_gravitational__teleport-3fa6904377c006497169945428e8197158667910-v626ec2a48416b10a88641359a169d99e935ff037/ISSUE.md2.2klinemanread_file ISSUE.md2.4k+14%
2Glob**/forwarder.go27linemanread_file lib/kube/proxy/forwarder.go48+78%
3Grepupload|StreamingSessionsDir|sessionUploader|NewStreamer1.3kGlob**/forwarder.go27-98%
4GrepNewUploader\|newUploader\|sessionUploader\|InitUploader\|initUploader\|UploaderConfig\|uploaderConfig16linemanread_file_context lib/kube/proxy/forwarder.go — session uploader initialization, upload directory creation, NewUploader, DataDir, log upload48+200%
5GrepNewUploader\|sessionUploader\|filesessions.NewUploader16Bashwc -l lib/kube/proxy/forwarder.go48+200%
24GrepSharedDirMode585
Total34.7k23.0k-34%