Commit Graph

18 Commits

Author SHA1 Message Date
William Jeynes f09e36e740 Add initial version of ROBERTA classifier, add ability for multi pi charts 2026-03-11 22:02:31 +00:00
William Jeynes ef6330ec07 Add re-ranker mode to support re-ranking experiments, hopefully we can reduce the loss 2026-03-06 17:27:09 +00:00
William Jeynes f14d112017 Add difference between auto scoring system and our own labels 2026-03-03 15:58:39 +00:00
William Jeynes 6ae551a93f Ensure date is passed to pipeline. Fix woring 2026-03-02 14:58:26 +00:00
William Jeynes c94812ed80 Prepare for mass data collection. Reduce concurrency as to not overwhelm scraper on long sessions. Remode duplicates from fetch script. Removing naming wierdness on scorer frontend. 2026-02-27 14:41:10 +00:00
William Jeynes 201176e71c Refactor scorer for future maintainabiliy 2026-02-26 10:25:49 +00:00
William Jeynes 6c3aa7343d Update how scoring works with two passes of the data for timesaving. Add section on edge case handling to rules. 2026-02-26 10:09:36 +00:00
William Jeynes 3d0cacd24e Redo rules a little bit. Update fetch to retreive only from some sources. Add statistics to display, fix rules display 2026-02-23 21:56:27 +00:00
William Jeynes cca3c42f5b Fix longstnading bug in wrapper. Add handling to allow for duplicate events to be handelled. Remove analysis script (will replace with more indepth work in main frontend) 2026-02-22 23:12:14 +00:00
William Jeynes d1ab938c0b Add filtering from known disinformation sources 2026-02-22 15:14:58 +00:00
William Jeynes 5efce05821 Update REAME to include description of data files 2026-02-19 11:43:25 +00:00
William Jeynes 78a49e2843 Start writing cleaned jsonl output. Re-add sentence to trigger prompt. Fix recursion limit 2026-02-19 11:36:31 +00:00
William Jeynes b70b75bf28 Update readme. add human score calculation changes 2026-02-18 21:05:01 +00:00
William Jeynes dee9973c2a More work on scorer 2026-02-18 20:44:14 +00:00
William Jeynes a2cb93b44e Start refining scorer. Filter data passed to trigger event agent 2026-02-18 15:03:13 +00:00
William Jeynes 3f14b61cd4 Move all data to own folder. Add run shell script. Experiment (unsuccessfully so far) with example retreival 2026-02-16 22:42:13 +00:00
William Jeynes 90894b2c10 Add some preliminary analysis 2026-02-16 14:42:47 +00:00
William Jeynes 6d478fe7ec Add multi claim runner. Add dbkf fetcher for automated testing. Add visualisation tool plus human score enterer. 2026-02-13 15:15:01 +00:00