Curated lists / Harness
Benchmark harness: Echosaw vs Evidence Copilot
Everything behind the head-to-head: the seven questions asked word for word, each product’s verbatim answers for the street-camera clip and the NASA speech clip, the ground truth and how it was established frame by frame, the browser scripts used to ask and capture, every screenshot, and the run times and Echosaw revisions. results/2026-11-12/ is the original run of both products; results/2026-11-13-rerun/ is Echosaw re-run on its current release with the same uploads, each question in its own empty chat, the run the comparison uses; results/2026-11-12-final/ and results/2026-11-12-rerun/ are earlier Echosaw re-runs kept for the record. results/2026-11-13-0ad3d4aa/ (2026-11-13, release 0ad3d4aa) is a later Echosaw re-ask of street-clip questions Q2 to Q5 only, raw answers and screenshots (screenshots/2026-11-13-0ad3d4aa/), not scored. The two video files are not included (see ground-truth/ground-truth.json for where they live). No sign-in tokens, cookies, or passwords are included.
Used by: Echosaw vs Evidence Copilot
- README.md6,353 B
- ground-truth/crops/bin.jpg54,936 B
- ground-truth/crops/bin2.jpg39,299 B
- ground-truth/crops/full_2.jpg284,817 B
- ground-truth/crops/l_18.5.jpg106,856 B
- ground-truth/crops/l_42.7.jpg108,052 B
- ground-truth/crops/p_10.7.jpg124,871 B
- ground-truth/crops/p_11.0.jpg125,376 B
- ground-truth/crops/r_10.5.jpg167,097 B
- ground-truth/crops/r_10.jpg179,293 B
- ground-truth/crops/r_18.5.jpg171,758 B
- ground-truth/crops/r_2.jpg181,140 B
- ground-truth/crops/r_42.5.jpg175,381 B
- ground-truth/crops/r_92.3.jpg175,744 B
- ground-truth/ground-truth.json3,882 B
- ground-truth/nasa_contact_sheet.jpg239,081 B
- questions.json845 B
- results/2026-11-12/answers.md43,819 B
- results/2026-11-12/echosaw-gamma-nasa-network.txt5,265 B
- results/2026-11-12/echosaw-gamma-network.txt385,971 B
- results/2026-11-12/echosaw-nasa-rerun-network.jsonl10,575 B
- results/2026-11-12/echosaw.json48,019 B
- results/2026-11-12/evidence-copilot.json12,711 B
- results/2026-11-12/results.json2,760 B
- results/2026-11-12/runs.json4,425 B
- results/2026-11-12-final/echosaw.json32,017 B
- results/2026-11-12-final/results.json6,691 B
- results/2026-11-12-final/runs.json5,461 B
- results/2026-11-12-rerun/chat-threads-before-deletion.json49,643 B
- results/2026-11-12-rerun/echosaw.json31,961 B
- results/2026-11-12-rerun/results.json6,256 B
- results/2026-11-12-rerun/runs.json5,623 B
- results/2026-11-13-0ad3d4aa/echosaw.json10,765 B
- results/2026-11-13-0ad3d4aa/runs.json3,237 B
- results/2026-11-13-rerun/chat-threads-cleared.json52,312 B
- results/2026-11-13-rerun/echosaw.json23,362 B
- results/2026-11-13-rerun/results.json5,658 B
- results/2026-11-13-rerun/runs.json5,380 B
- screenshots/2026-11-12/ec_auto_generated_reports.jpg137,871 B
- screenshots/2026-11-12/ec_auto_generated_timeline.jpg98,533 B
- screenshots/2026-11-12/ec_midway_original_failed.jpg116,064 B
- screenshots/2026-11-12/ec_midway_q1.jpg200,686 B
- screenshots/2026-11-12/ec_midway_q2.jpg229,517 B
- screenshots/2026-11-12/ec_midway_q3.jpg205,177 B
- screenshots/2026-11-12/ec_midway_q4.jpg205,897 B
- screenshots/2026-11-12/ec_midway_q4_part2.jpg205,229 B
- screenshots/2026-11-12/ec_midway_q5.jpg207,816 B
- screenshots/2026-11-12/ec_midway_q5_frames.jpg188,878 B
- screenshots/2026-11-12/ec_midway_q5_part2.jpg196,130 B
- screenshots/2026-11-12/ec_midway_q6.jpg209,119 B
- screenshots/2026-11-12/ec_midway_q6_part2.jpg232,269 B
- screenshots/2026-11-12/ec_nasa_q7.jpg188,906 B
- screenshots/2026-11-12/ec_nasa_q7_part2.jpg194,916 B
- screenshots/2026-11-12/ec_nasa_q7_part3.jpg185,132 B
- screenshots/2026-11-12/ec_nasa_transcript.jpg141,813 B
- screenshots/2026-11-12/es_dashboard_new_tab_404.jpg12,821 B
- screenshots/2026-11-12/es_midway_outputs.jpg189,517 B
- screenshots/2026-11-12/es_midway_q1.jpg233,223 B
- screenshots/2026-11-12/es_midway_q1_history.jpg238,551 B
- screenshots/2026-11-12/es_midway_q1_history_part2.jpg232,682 B
- screenshots/2026-11-12/es_midway_q1_pending.jpg192,061 B
- screenshots/2026-11-12/es_midway_q2.jpg239,104 B
- screenshots/2026-11-12/es_midway_q2_history.jpg235,873 B
- screenshots/2026-11-12/es_midway_q2_history_part2.jpg233,610 B
- screenshots/2026-11-12/es_midway_q2_part2.jpg235,761 B
- screenshots/2026-11-12/es_midway_q3.jpg237,453 B
- screenshots/2026-11-12/es_midway_q3_history.jpg239,729 B
- screenshots/2026-11-12/es_midway_q3_history_part2.jpg235,388 B
- screenshots/2026-11-12/es_midway_q3_part2.jpg235,479 B
- screenshots/2026-11-12/es_midway_q4.jpg230,261 B
- screenshots/2026-11-12/es_midway_q4_part2.jpg235,486 B
- screenshots/2026-11-12/es_midway_q4_part3.jpg240,014 B
- screenshots/2026-11-12/es_midway_q4_pending.jpg235,388 B
- screenshots/2026-11-12/es_midway_q4_retry.jpg245,552 B
- screenshots/2026-11-12/es_midway_q4_retry_part2.jpg250,657 B
- screenshots/2026-11-12/es_midway_q4_retry_part3.jpg248,992 B
- screenshots/2026-11-12/es_midway_q4_retry_part4.jpg243,496 B
- screenshots/2026-11-12/es_midway_q4_retry_part5.jpg243,157 B
- screenshots/2026-11-12/es_midway_q4_retry_part6.jpg232,625 B
- screenshots/2026-11-12/es_midway_q5.jpg235,741 B
- screenshots/2026-11-12/es_midway_q5_history.jpg230,938 B
- screenshots/2026-11-12/es_midway_q5_history_part2.jpg229,700 B
- screenshots/2026-11-12/es_midway_q5_part2.jpg235,114 B
- screenshots/2026-11-12/es_midway_q5_pending.jpg230,224 B
- screenshots/2026-11-12/es_midway_q6.jpg221,656 B
- screenshots/2026-11-12/es_midway_q6_live.jpg222,328 B
- screenshots/2026-11-12/es_midway_summary.jpg192,051 B
- screenshots/2026-11-12/es_nasa2_processing.jpg108,464 B
- screenshots/2026-11-12/es_nasa2_q7.jpg174,100 B
- screenshots/2026-11-12/es_nasa2_q7_entered.jpg171,189 B
- screenshots/2026-11-12/es_nasa2_q7_pending.jpg184,194 B
- screenshots/2026-11-12/es_nasa2_q7_question_answer.jpg174,100 B
- screenshots/2026-11-12/es_nasa2_ready.jpg108,592 B
- screenshots/2026-11-12/es_nasa2_reupload_confirmation.jpg91,672 B
- screenshots/2026-11-12/es_nasa2_selected.jpg111,417 B
- screenshots/2026-11-12/es_nasa2_transcript.jpg168,828 B
- screenshots/2026-11-12/es_nasa2_transcript_part2.jpg167,842 B
- screenshots/2026-11-12/es_nasa2_transcript_part3.jpg169,137 B
- screenshots/2026-11-12/es_nasa2_transcript_seek.jpg170,359 B
- screenshots/2026-11-12/es_nasa2_upload_accepted.jpg107,606 B
- screenshots/2026-11-12/es_nasa_forbidden.jpg20,911 B
- screenshots/2026-11-12/es_nasa_outputs.jpg159,199 B
- screenshots/2026-11-12/es_nasa_q7.jpg189,822 B
- screenshots/2026-11-12/es_nasa_summary.jpg174,367 B
- screenshots/2026-11-12-final/es_midway_q1.jpg262,236 B
- screenshots/2026-11-12-final/es_midway_q1_entered.jpg103,747 B
- screenshots/2026-11-12-final/es_midway_q1_full.jpg423,313 B
- screenshots/2026-11-12-final/es_midway_q2.jpg256,551 B
- screenshots/2026-11-12-final/es_midway_q2_entered.jpg263,234 B
- screenshots/2026-11-12-final/es_midway_q2_full.jpg422,414 B
- screenshots/2026-11-12-final/es_midway_q3-q6_full.jpg415,700 B
- screenshots/2026-11-12-final/es_midway_q3.jpg255,742 B
- screenshots/2026-11-12-final/es_midway_q3_entered.jpg257,932 B
- screenshots/2026-11-12-final/es_midway_q3_full.jpg413,430 B
- screenshots/2026-11-12-final/es_midway_q4.jpg256,531 B
- screenshots/2026-11-12-final/es_midway_q4_entered.jpg256,960 B
- screenshots/2026-11-12-final/es_midway_q5.jpg259,818 B
- screenshots/2026-11-12-final/es_midway_q5_entered.jpg257,594 B
- screenshots/2026-11-12-final/es_midway_q5_full.jpg415,724 B
- screenshots/2026-11-12-final/es_midway_q6.jpg233,356 B
- screenshots/2026-11-12-final/es_midway_q6_entered.jpg260,515 B
- screenshots/2026-11-12-final/es_nasa_q7.jpg222,579 B
- screenshots/2026-11-12-final/es_nasa_q7_entered.jpg168,305 B
- screenshots/2026-11-12-final/es_nasa_q7_full.jpg233,133 B
- screenshots/2026-11-12-final/midway_history_menu.jpg107,994 B
- screenshots/2026-11-12-final/midway_new_chat.jpg100,875 B
- screenshots/2026-11-12-final/nasa_history_menu.jpg178,476 B
- screenshots/2026-11-12-rerun/es_midway_q1.jpg260,164 B
- screenshots/2026-11-12-rerun/es_midway_q1_entered.jpg196,587 B
- screenshots/2026-11-12-rerun/es_midway_q1_full.jpg430,113 B
- screenshots/2026-11-12-rerun/es_midway_q2.jpg245,973 B
- screenshots/2026-11-12-rerun/es_midway_q2_entered.jpg261,176 B
- screenshots/2026-11-12-rerun/es_midway_q2_full.jpg444,400 B
- screenshots/2026-11-12-rerun/es_midway_q3-q6_full.jpg435,461 B
- screenshots/2026-11-12-rerun/es_midway_q3.jpg259,692 B
- screenshots/2026-11-12-rerun/es_midway_q3_entered.jpg247,322 B
- screenshots/2026-11-12-rerun/es_midway_q3_full.jpg440,234 B
- screenshots/2026-11-12-rerun/es_midway_q4.jpg262,032 B
- screenshots/2026-11-12-rerun/es_midway_q4_entered.jpg260,890 B
- screenshots/2026-11-12-rerun/es_midway_q4_full.jpg435,483 B
- screenshots/2026-11-12-rerun/es_midway_q5.jpg259,603 B
- screenshots/2026-11-12-rerun/es_midway_q5_entered.jpg263,070 B
- screenshots/2026-11-12-rerun/es_midway_q6.jpg233,614 B
- screenshots/2026-11-12-rerun/es_midway_q6_entered.jpg260,336 B
- screenshots/2026-11-12-rerun/es_nasa_q7.jpg222,130 B
- screenshots/2026-11-12-rerun/es_nasa_q7_entered.jpg168,305 B
- screenshots/2026-11-12-rerun/es_nasa_q7_full.jpg214,296 B
- screenshots/2026-11-12-rerun/midway_history_menu.jpg233,326 B
- screenshots/2026-11-12-rerun/midway_report.jpg233,013 B
- screenshots/2026-11-12-rerun/nasa_history_menu.jpg202,678 B
- screenshots/2026-11-13-0ad3d4aa/es_midway_q2.jpg257,529 B
- screenshots/2026-11-13-0ad3d4aa/es_midway_q2_entered.jpg212,196 B
- screenshots/2026-11-13-0ad3d4aa/es_midway_q3.jpg235,103 B
- screenshots/2026-11-13-0ad3d4aa/es_midway_q3_entered.jpg212,459 B
- screenshots/2026-11-13-0ad3d4aa/es_midway_q4.jpg242,143 B
- screenshots/2026-11-13-0ad3d4aa/es_midway_q4_entered.jpg212,366 B
- screenshots/2026-11-13-0ad3d4aa/es_midway_q5.jpg240,043 B
- screenshots/2026-11-13-0ad3d4aa/es_midway_q5_entered.jpg212,113 B
- screenshots/2026-11-13-0ad3d4aa/midway_q2_new_chat.jpg209,099 B
- screenshots/2026-11-13-0ad3d4aa/midway_q3_new_chat.jpg209,099 B
- screenshots/2026-11-13-0ad3d4aa/midway_q4_new_chat.jpg209,099 B
- screenshots/2026-11-13-0ad3d4aa/midway_q5_new_chat.jpg209,099 B
- screenshots/2026-11-13-rerun/es_midway_q1.jpg264,255 B
- screenshots/2026-11-13-rerun/es_midway_q1_entered.jpg212,084 B
- screenshots/2026-11-13-rerun/es_midway_q2.jpg264,505 B
- screenshots/2026-11-13-rerun/es_midway_q2_entered.jpg212,196 B
- screenshots/2026-11-13-rerun/es_midway_q3.jpg245,309 B
- screenshots/2026-11-13-rerun/es_midway_q3_entered.jpg212,459 B
- screenshots/2026-11-13-rerun/es_midway_q4.jpg249,745 B
- screenshots/2026-11-13-rerun/es_midway_q4_entered.jpg212,366 B
- screenshots/2026-11-13-rerun/es_midway_q5.jpg245,772 B
- screenshots/2026-11-13-rerun/es_midway_q5_entered.jpg212,113 B
- screenshots/2026-11-13-rerun/es_midway_q6.jpg246,450 B
- screenshots/2026-11-13-rerun/es_midway_q6_entered.jpg211,837 B
- screenshots/2026-11-13-rerun/es_nasa_q7.jpg239,361 B
- screenshots/2026-11-13-rerun/es_nasa_q7_entered.jpg182,763 B
- screenshots/2026-11-13-rerun/es_nasa_q7_full.jpg231,342 B
- screenshots/2026-11-13-rerun/midway_q1_new_chat.jpg209,099 B
- screenshots/2026-11-13-rerun/midway_q2_new_chat.jpg209,099 B
- screenshots/2026-11-13-rerun/midway_q3_new_chat.jpg209,099 B
- screenshots/2026-11-13-rerun/midway_q4_new_chat.jpg209,099 B
- screenshots/2026-11-13-rerun/midway_q5_new_chat.jpg209,099 B
- screenshots/2026-11-13-rerun/midway_q6_new_chat.jpg209,099 B
- screenshots/2026-11-13-rerun/nasa_q7_new_chat.jpg179,726 B
- scripts/ask.py2,814 B
- scripts/ask_r3.py2,805 B
- scripts/capture_answer.py1,585 B
- scripts/capture_pages.py2,229 B
- scripts/cdp.py1,335 B
- scripts/clear_thread_new_chat.py1,408 B
- scripts/clicktext.py593 B
- scripts/shot.py714 B
- scripts/tallq.py480 B
- scripts/ui.py961 B
- scripts/watch_nasa2.py1,557 B
- scripts/watch_network.py1,697 B
- scripts/watch_report.py1,019 B