Instance Detail

Total Cost

$0.2262

Cache Hit Rate

77.3%

~54% cost saving from caching

Tokens

230,022

227,840 prompt · 2,182 completion

Wall Time

124s

16 LLM calls

Stitch Tool Usage

All Tool Calls (54 total)

This runAvg

read_code

16avg 8

run_command

7avg 8

read_file

6avg 6.5

grep

4avg 8

semantic_search

4avg 2

complete_question

4avg 3

write_todos

3avg 3.5

search_commits

2avg 1

get_entity_history

2avg 1

1avg 1.5

glob

1avg 2

task

1avg 1

edit_file

1avg 1.5

interaction_graph

1avg 0.5

plan_investigation

1avg 1.5

Run Information

Eval Run: ablation-full-django
File Recall: 100%
Phase Compliant: Yes
Bug Complexity: simple

All Runs (2)

Run	Status	Cost	Wall Time	LLM Calls
ablation-full-django		$0.226	124s	16
ablation-no-kg-django		$0.180	110s	26

Total Cost

$0.2262

Cache Hit Rate

77.3%

~54% cost saving from caching

Tokens

230,022

227,840 prompt · 2,182 completion

Wall Time

124s

16 LLM calls

Stitch Tool Usage

All Tool Calls (54 total)

This runAvg

read_code

16avg 8

run_command

7avg 8

read_file

6avg 6.5

grep

4avg 8

semantic_search

4avg 2

complete_question

4avg 3

write_todos

3avg 3.5

search_commits

2avg 1

get_entity_history

2avg 1

1avg 1.5

glob

1avg 2

task

1avg 1

edit_file

1avg 1.5

interaction_graph

1avg 0.5

plan_investigation

1avg 1.5

Run Information

Eval Run: ablation-full-django
File Recall: 100%
Phase Compliant: Yes
Bug Complexity: simple

All Runs (2)

Run	Status	Cost	Wall Time	LLM Calls
ablation-full-django		$0.226	124s	16
ablation-no-kg-django		$0.180	110s	26