Dilip Kumar Narayanaswamy·Oct 12Building a Portable AI Assistant on a USB Drive with Llamafile and Qwen3–4BThis article demonstrates how to create a fully portable AI assistant that runs directly from a USB drive without installation. Using…
Xero·Oct 10Fine-Tuning Meta’s NLLB-200 (1.3B)How I fine-tuned a 1.3-billion-parameter machine translation model on a single Google Colab T4 GPU and improved its SacreBLEU score from…
I E·Oct 2LLM quantization explained: what rounding the weights saves and what it costs (AI Shorts #5)Quantization makes a model smaller by rounding its weights, but this rounding costs some quality.A response icon1
InOpen IntelligencebyDr. Fadi Shaar·Oct 2How to Make Giant AI Models Smaller Without Breaking ThemInside Tencent’s AngelSlim toolkit for quantization, speculative decoding, sparse attention, token pruning, caching, and distillation
