InGoogle Cloud - CommunitybyAbdul Salam·2d agoWhy Your Enterprise AI Agent Passed the Demo and Stalled in UAT: A Field Guide to Golden DatasetsModels and agent frameworks depreciate every quarter. Your ground-truth contract is the only asset that compounds.
Onur Özkır·Oct 21“Has Quality Declined?”:Separating a drop in acceptance rate from a genuine model regression, and making a defensible production decision with limited human…
Namshima Iordye·Aug 20Improving Retrieval Quality in a Production Healthcare RAG System Through Embedding Evaluation and…Chapter five
harshal bansal·Aug 14A Practical Guide to EvaluationsYou build a RAG chatbot. You throw ten prompts at it. The answers look reasonable. You ship it.A response icon1A response icon1
Ahmet Ozel·Aug 10Evaluating RAG: From Golden Datasets to LLM-as-JudgeA Retrieval-Augmented Generation system can produce a fluent answer while failing in several independent ways. It may retrieve the wrong…
Manish Sharma·Jul 16AI Evals for Agentic SystemsQuality, safety, and reliability are critical to the success of enterprise agentic systems. If AI systems are not reliable, it cannot be…
Piyush Shyamlal·Jun 30When the Agent Stops Behaving: A Diagnostic Framework for Voice AI UpdatesThe Problem
Shaip·Feb 24, 2025Golden Datasets: The Foundation of Reliable AI SystemsThe golden datasets in AI refer to the purest and highest quality datasets that you can get to train your AI system. Being the highest…