Saravanan Babu·Oct 26Should GPU temperature influence how we scale vLLM pods?When a B200 GPU heats up, the important question is not simply“What is its temperature?”
BruceWayne·Sep 22Three Layers Below the Model: What Shipping FP8 Collectives Taught Us About Quantizers, Allocators…I had a simple-sounding problem. Multi-modal VLA training stack runs on 8× GPU— 96 GB of GDDR7 each, 503.8 bf16 TFLOPS each, and no NVLink…
sivakumar·Sep 10Configuring AMD Instinct GPU SR-IOV to Virtualize GPUThis guide explains how to configure AMD GPU virtualization using SR-IOV on Cisco UCS C-Series GPU servers. The configuration creates GPU…
MatrixOrigin·Jul 21MatrixOne Git4Data Deep Dive (Part 8) · AI Training in Practice — From Data Arriving to Model…This series is seven parts in, and they did two things. The first four built Git4Data’s coordinate system: why data at scale needs…
Aikeyfounder·Jun 29Buying More Than You Need, Banned When You Share — How Key Pooling Solves the Claude Subscription…Claude’s top-tier plan gives you 20x the quota of Pro. You’ll never use it all alone. But share it with teammates and the ban hammer drops…
Arthur.Zhang·Jun 16A local E2B-compatible gateway written in Go.Let me start with what this project actually is: e2b-local is a local, E2B-compatible API gateway. Your app still talks to the E2B SDK. You…
Sudi Navile·May 10The AI Control Surface — Part 1 #AISafetyFramework #AIInfra #AgentRisk #AIBRFA Seven part mini-series that provides a Framework - AI Infrastructure Blast Radius Framework to identify root cause and implement…
InBetter MLbyJaideep Ray·Apr 5Scaling LLM Distillation: Why Your Network is the Bottleneck (and How to Fix It)Knowledge Distillation (KD) for Large Language Models (LLMs) often hits a scaling wall that has nothing to do with model architecture and…
Will Youzhi Zou·Feb 25Analyzing the ray code in the experience replay algorithmIn this post, we study the code in https://github.com/YeWR/EfficientZero?tab=readme-ov-file and analyze how to build a distributed trainer…
InKAIRIbyAngshuman Bhattacharya·Feb 20Beyond the Code: Why the AI Impact Summit in New Delhi is a “Quiet Revolution” for 1.4Checking out from New Delhi after three intense days of engaging interactions, I find myself penning these thoughts at the airport lounge…
