PinnedInTowards Data EngineeringbyLsyuan·Jun 18How We Automated SQL Alert Creation for 1000+ Databricks Tables3–5 sets (or more) of SQL alert queries are needed to write for each Databricks table we are managing, and we have 1000+ tables in our…
Lsyuan·Jul 4AI Killed Coding. What Now for Computer Science Students?Anyone can generate code now. Not everyone can understand, scale, and own it.
Lsyuan·Jun 25Passing the Databricks GenAI Engineer Exam and What Changed My ThinkingMost preparation material for the Databricks Certified Generative AI Engineer Associate exam focuses on what to study: services, concepts…
InTowards AIbyLsyuan·Jun 10Your AI Agent Isn’t Broken. Your Retrieval Is.Unreliable AI agents are one of the most frustrating problems to debug — the agent ignores its tools, drifts off topic, or returns…
InTowards Data EngineeringbyLsyuan·Jun 1Data Quality Monitoring for 1000 Databricks Tables — Done in 1 DayAt some point, every data team hits the same wall: the data lake is growing fast, the pipelines are multiplying, and nobody actually knows…A response icon1A response icon1