Instance Detail

Total Cost

$0.3070

Cache Hit Rate

76.6%

~54% cost saving from caching

Tokens

225,197

222,484 prompt · 2,713 completion

Wall Time

102s

15 LLM calls

Stitch Tool Usage

All Tool Calls (40 total)

This runAvg

run_command

7avg 5

grep

6avg 7.5

read_code

5avg 2.5

complete_question

4avg 2

edit_file

3avg 2.5

read_file

3avg 6.5

write_todos

3avg 3.5

search_commits

2avg 1

semantic_search

2avg 1

task

1avg 1

interaction_graph

1avg 0.5

get_entity_history

1avg 0.5

plan_investigation

1avg 8.5

get_entity_metadata

1avg 0.5

0avg 0.5

glob

0avg 1.5

Run Information

Eval Run: ablation-full-django
File Recall: 100%
Phase Compliant: Yes
Bug Complexity: simple

All Runs (2)

Run	Status	Cost	Wall Time	LLM Calls
ablation-full-django		$0.307	102s	15
ablation-no-kg-django		$0.173	148s	20

Total Cost

$0.3070

Cache Hit Rate

76.6%

~54% cost saving from caching

Tokens

225,197

222,484 prompt · 2,713 completion

Wall Time

102s

15 LLM calls

Stitch Tool Usage

All Tool Calls (40 total)

This runAvg

run_command

7avg 5

grep

6avg 7.5

read_code

5avg 2.5

complete_question

4avg 2

edit_file

3avg 2.5

read_file

3avg 6.5

write_todos

3avg 3.5

search_commits

2avg 1

semantic_search

2avg 1

task

1avg 1

interaction_graph

1avg 0.5

get_entity_history

1avg 0.5

plan_investigation

1avg 8.5

get_entity_metadata

1avg 0.5

0avg 0.5

glob

0avg 1.5

Run Information

Eval Run: ablation-full-django
File Recall: 100%
Phase Compliant: Yes
Bug Complexity: simple

All Runs (2)

Run	Status	Cost	Wall Time	LLM Calls
ablation-full-django		$0.307	102s	15
ablation-no-kg-django		$0.173	148s	20