Commit Graph

30 Commits

Author SHA1 Message Date
William Jeynes b37799b3d2 Improve response extraction 2026-04-02 21:02:26 +01:00
William Jeynes 10f2644408 Use a slightly smaller model. Reduce concurreny. Be more clear in the prompts 2026-04-02 20:10:57 +01:00
William Jeynes 7e586fe17d Allow for configurable ranking server url. Delete old ragas call 2026-04-02 13:48:15 +01:00
William Jeynes 7e37a22058 Switch to actual instruction model. For debug, log entire object. 2026-04-02 13:18:02 +01:00
William Jeynes 2ed47980ef Add better error handling to LLM output response 2026-03-31 19:26:56 +01:00
William Jeynes 01b04dd73e use a model we know has tool calling capabilities 2026-03-31 18:26:55 +01:00
William Jeynes 36c30a427d update deps. Install ollama for lang chain. Update model to deepseek 2026-03-31 16:08:28 +01:00
William Jeynes f8d4155b7c Add more robust parsing of LLM JSON output 2026-03-27 11:09:59 +00:00
William Jeynes a7f5978f64 Update documentation. Stop storing context. Decide on final claims source 2026-03-25 14:24:55 +00:00
William Jeynes 8f939d54c4 Implement ensemble into final model structure 2026-03-24 19:07:24 +00:00
William Jeynes 624d45bc53 Re-allow multithreading on service. Add results table 2026-03-24 18:29:40 +00:00
William Jeynes 80bc151379 add majority voting 2026-03-24 16:50:41 +00:00
William Jeynes 5ce64290ce Make an ensemble model to combine scores together (very high accuracy) 2026-03-24 15:50:41 +00:00
William Jeynes c69730df6b Refine scoring to allow for better iteration on frontend. Update generate_adversarial.py 2026-03-22 16:04:38 +00:00
William Jeynes f4e84af272 Make the model less overfitting. Make it harder for an event to be classed as "perfect" 2026-03-18 01:05:24 +00:00
William Jeynes 0a7bb114d2 Add removing of duplicates from pipeline. Add to sort step. Move score logic to robertaMetrics node. 2026-03-13 14:51:14 +00:00
William Jeynes 8311556855 Add ROBERTA classifier ranking PoC, with 77pc off the bat 2026-03-13 11:24:51 +00:00
William Jeynes a2cb93b44e Start refining scorer. Filter data passed to trigger event agent 2026-02-18 15:03:13 +00:00
William Jeynes 3f14b61cd4 Move all data to own folder. Add run shell script. Experiment (unsuccessfully so far) with example retreival 2026-02-16 22:42:13 +00:00
William Jeynes 7fe63d6a98 Refactor calculating score. Add sort node for vanity 2026-02-12 23:46:00 +00:00
William Jeynes b06c08daab Add relation model. Add calculate score initial version 2026-02-12 23:26:59 +00:00
William Jeynes c89f73e138 Implement RAGAS metrics 2026-02-12 22:52:22 +00:00
William Jeynes 6dd6bf7eaf implement verification model 2026-02-12 22:32:24 +00:00
William Jeynes bef856d53a Refactor example retreiving, add option for dynamic data. Add hybrid reranking to tooling. Add parsing and loop infrastructure for trigger event processing 2026-02-12 14:33:12 +00:00
William Jeynes cd2c8621e8 FEAT: implement temp version of main tooling feedback loop 2026-02-09 20:25:36 +00:00
William Jeynes 02eac0f553 Allow multiple source CSV files for normalisation. Implement real model node. Add normalizarion prompt. Implement normalization setup. Start on RAG retreival functions 2026-02-09 16:32:40 +00:00
William Jeynes 8eaa7bfbff Add initial code for retreival ranking for normalisation 2026-01-29 21:53:38 +00:00
William Jeynes a1373da891 create final nodes 2026-01-28 22:03:21 +00:00
William Jeynes c6416622e4 start adding dummy nodes 2026-01-28 21:26:34 +00:00
William Jeynes a3201d17a2 add initial testing 2026-01-27 22:57:49 +00:00