Agcshubham·Oct 25The CUDA Deep Dive: A Complete MapEverything you need to find your way through this series, from your first kernel to distributed training and production inference.
Aman Banik·Oct 10Beyond Core Counts: How CUDA Cores, Tensor Cores, and SMs Shape GPU PerformanceFrom neural networks to custom CUDA kernels, explore CUDA Cores, Tensor Cores, SMs, and what really determines GPU performance.
Rohit Jindal·Oct 10CUDA Questions— Part 1The goal of this blog is straightforward: to discuss some of the most common and fundamental questions related to the CUDA, and how…
Subrata Goswami·Oct 3LLM Assisted Kernel Development in CuTe DSL, Gluon, Helion and Triton .Humans still have edge in crafting the most performant kernels. This edge is likely to erode within a year or so. Also, in the same spirit…
Rohit Jindal·Oct 3CUDA Matrix Multiplication — Part 4In the previous blog, we introduced shared memory and used it to optimize our matrix multiplication kernel by reducing redundant accesses…