Instance Detail

Total Cost

$0.1486

Cache Hit Rate

76.6%

~54% cost saving from caching

Tokens

222,650

219,996 prompt · 2,654 completion

Wall Time

217s

15 LLM calls

Stitch Tool Usage

All Tool Calls (27 total)

This runAvg

read_code

12avg 6

semantic_search

4avg 2

complete_question

4avg 3.5

search_commits

3avg 1.5

interaction_graph

1avg 0.5

get_entity_history

1avg 0.5

plan_investigation

1avg 2

get_entity_metadata

1avg 0.5

glob

0avg 1.5

grep

0avg 4.5

task

0avg 0.5

edit_file

0avg 0.5

read_file

0avg 1.5

run_command

0avg 3.5

write_todos

0avg 1.5

Run Information

Eval Run: ablation-full-django
File Recall: 100%
Phase Compliant: Yes
Bug Complexity: complex

All Runs (2)

Run	Status	Cost	Wall Time	LLM Calls
ablation-full-django		$0.149	217s	15
ablation-no-kg-django		$0.223	115s	16

Total Cost

$0.1486

Cache Hit Rate

76.6%

~54% cost saving from caching

Tokens

222,650

219,996 prompt · 2,654 completion

Wall Time

217s

15 LLM calls

Stitch Tool Usage

All Tool Calls (27 total)

This runAvg

read_code

12avg 6

semantic_search

4avg 2

complete_question

4avg 3.5

search_commits

3avg 1.5

interaction_graph

1avg 0.5

get_entity_history

1avg 0.5

plan_investigation

1avg 2

get_entity_metadata

1avg 0.5

glob

0avg 1.5

grep

0avg 4.5

task

0avg 0.5

edit_file

0avg 0.5

read_file

0avg 1.5

run_command

0avg 3.5

write_todos

0avg 1.5

Run Information

Eval Run: ablation-full-django
File Recall: 100%
Phase Compliant: Yes
Bug Complexity: complex

All Runs (2)

Run	Status	Cost	Wall Time	LLM Calls
ablation-full-django		$0.149	217s	15
ablation-no-kg-django		$0.223	115s	16