Janagaraj Sangamanarayanan·Sep 23Jev vs Laya: What 350 Support Tickets Taught Me About Evaluating AI Decision ModelsA step-by-step account of comparing two typed-decision models on support-ticket triage, and how refining the scoring rule, the question…
Rockfish Data Team·Sep 9Generating synthetic data that actually holds upReal use cases need data with real structure — timing, sequence, referential integrity. Here’s how to generate it by putting the right…
Micheal Lanham·Sep 6Hand the Agent a Gauge, Not an OpinionTips 91 to 100 of 100. The finale. Replace a judgement with something that can be run, and put the judging somewhere the worker cannot…
Micheal Lanham·Sep 1The Answer Was at Rank 11Tips 59 to 64 of 100. A collection and the means of finding things inside it are two separate pieces of engineering.
Micheal Lanham·Aug 27Your Eval Says 97 Percent. Your Users Say Otherwise.Tips 25 to 32 of 100. A judge is not an instrument you bought. It is a model with opinions, and several of them point the same way as the…