Add file logging for errors. Add exponential backoff retry to web search. On failed web search, do not crash pipeline, return placeholder text to loanguage model

2026-02-24 13:05:35 +00:00
parent 3d0cacd24e
commit 8317fd85df
5 changed files with 62 additions and 14 deletions
@@ -12,6 +12,7 @@ Final Dissertation Submission Repository
 ├── run.sh                          # Bash script to run project elements from one place
 ├── data/                           # Holder from project data
 |   ├── blocked.jsonl               # Web search results blocked by the Iffy list
+|   ├── error.log                   # Log file containing critical exceptions
 |   ├── claims.json                 # Retreived claims from dbkf fetcher
 |   ├── dev-eng.csv
 |   ├── train-eng.csv               # Normalized disinformation claims in CSV format from CLAN