Saravanan Babu·Oct 26Should GPU temperature influence how we scale vLLM pods?When a B200 GPU heats up, the important question is not simply“What is its temperature?”
BruceWayne·Sep 22Three Layers Below the Model: What Shipping FP8 Collectives Taught Us About Quantizers, Allocators…I had a simple-sounding problem. Multi-modal VLA training stack runs on 8× GPU— 96 GB of GDDR7 each, 503.8 bf16 TFLOPS each, and no NVLink…
sivakumar·Sep 10Configuring AMD Instinct GPU SR-IOV to Virtualize GPUThis guide explains how to configure AMD GPU virtualization using SR-IOV on Cisco UCS C-Series GPU servers. The configuration creates GPU…
MatrixOrigin·Jul 21MatrixOne Git4Data Deep Dive (Part 8) · AI Training in Practice — From Data Arriving to Model…This series is seven parts in, and they did two things. The first four built Git4Data’s coordinate system: why data at scale needs…
Aikeyfounder·Jun 29Buying More Than You Need, Banned When You Share — How Key Pooling Solves the Claude Subscription…Claude’s top-tier plan gives you 20x the quota of Pro. You’ll never use it all alone. But share it with teammates and the ban hammer drops…