Instance Detail

Total Cost

$0.2680

Cache Hit Rate

81.8%

~57% cost saving from caching

Tokens

248,860

245,162 prompt · 3,698 completion

Wall Time

131s

17 LLM calls

Stitch Tool Usage

All Tool Calls (55 total)

This runAvg

read_code

13avg 6.5

semantic_search

8avg 4

run_command

7avg 7

grep

6avg 9.5

complete_question

5avg 2.5

read_file

4avg 5

write_todos

4avg 4

edit_file

2avg 2

search_commits

2avg 1

task

1avg 1

interaction_graph

1avg 0.5

plan_investigation

1avg 5

get_entity_metadata

1avg 0.5

0avg 1

glob

0avg 2

Run Information

Eval Run: ablation-full-django
File Recall: 100%
Phase Compliant: Yes
Bug Complexity: medium

All Runs (2)

Run	Status	Cost	Wall Time	LLM Calls
ablation-full-django		$0.268	131s	17
ablation-no-kg-django		—	119s	24

Total Cost

$0.2680

Cache Hit Rate

81.8%

~57% cost saving from caching

Tokens

248,860

245,162 prompt · 3,698 completion

Wall Time

131s

17 LLM calls

Stitch Tool Usage

All Tool Calls (55 total)

This runAvg

read_code

13avg 6.5

semantic_search

8avg 4

run_command

7avg 7

grep

6avg 9.5

complete_question

5avg 2.5

read_file

4avg 5

write_todos

4avg 4

edit_file

2avg 2

search_commits

2avg 1

task

1avg 1

interaction_graph

1avg 0.5

plan_investigation

1avg 5

get_entity_metadata

1avg 0.5

0avg 1

glob

0avg 2

Run Information

Eval Run: ablation-full-django
File Recall: 100%
Phase Compliant: Yes
Bug Complexity: medium

All Runs (2)

Run	Status	Cost	Wall Time	LLM Calls
ablation-full-django		$0.268	131s	17
ablation-no-kg-django		—	119s	24