Abhinav Dobhal·5h agoNVIDIA Now Ships Its Own Rust for CUDA. Here’s What’s in the BoxNVIDIA/cuda-rust puts a host runtime and two kernel models, Tile and SIMT, in one Apache-2.0 repo. I read the READMEs, release notes and…
John Ciliberti·21h agoBeyond the Baseline: Performance Engineering a High-Performance Rust Compression EngineBuilding a compression library that works correctly is one challenge. Making it fast is another.
InMLWorksbyMayur Jain·22h agoAn Easy Introduction To CUDACUDA C++ is just one of the ways you can create massively parallel applications with CUDA. It lets you use the powerful C++ programming…
Dmitriy Nesterenko·3d agoStandard CUDA optimization after flattening an insurance modelOnce an insurance object model has a numeric representation, we can apply standard CUDA techniques to its calculation: shared-memory…
Agcshubham·4d agoThe Map PatternCUDA Deep Dive · Part 2: Parallel Patterns · P-01 This post is one of a series. See the Series Map for the full plan and where this post…
InLevel Up Codingbyamankarki·5d agoMy GPU fix was 13% faster on one card and 81% slower on anotherA vLLM int8 GEMM change, a reviewer with a smaller Ada GPU, and the one idea that explained it: wavesA response icon1A response icon1
Ekansh Jain·6d agoHow I Got a 27B Model Running at 96K Context and 38 TPS on an 8GB Laptop GPURunning a 27B model on an 8GB GPU sounds like a memory problem. And initially, it is. The weights alone would take roughly 54GB in FP16…
CodingInAVan·6d agoNVIDIA or AMD? Try the Same GPU Optimization on BothCan the same code change make a program faster on both NVIDIA and AMD GPUs?
Inazhar labsbyazhar·Oct 28Choosing the right abstraction for a real AI kernel (CUDA vs Triton vs CUTLASS vs HIP)A common question is: should I learn CUDA or Triton? The better question is: what level of control does this problem actually need? GPU…
