Machine Learning

Large Language Models

Artificial Intelligence

Llm Quantization

Model Quantization

Explore recommended reads, summarized by AI

Quantization Methods and Performance

Exploration of techniques for reducing model size and their effects on accuracy and speed.

LLM Quantization Implementation

Quantization Techniques and Trade-offs

Popular this week

Angelo Genovese

Deploying a Deep Learning Model on the STM32N6 Nucleo Board: From PyTorch to Edge AI Inference

Dilip Kumar Narayanaswamy

Building a Portable AI Assistant on a USB Drive with Llamafile and Qwen3–4B

Oleksandr Iegorov

Quantizing an 8B Function-Calling Model So It Actually Fits on My RTX 3060

utkarsh kulshrestha

INT4 and INT8 Quantization: From Digital Communication to Deep Learning

Nsharma

The Math behind QUANTIZATION — Why shrinking a model doesn’t break it.

Latest stories

Gokul Krishna

Why I Check Exact Replay When Debugging INT8 Models

Dilip Kumar Narayanaswamy

Building a Portable AI Assistant on a USB Drive with Llamafile and Qwen3–4B

Rajneekantrawat

Quantization: What and Why?

Nikhil Gupta

What Is Model Quantization, and Why Does It Exist?

MLEngineerByFluke

LLM Quantization, Part 1: Understanding Post-Training Quantization (PTQ)

See more stories

Who to follow

Popular this week

Angelo Genovese

Deploying a Deep Learning Model on the STM32N6 Nucleo Board: From PyTorch to Edge AI Inference

Dilip Kumar Narayanaswamy

Building a Portable AI Assistant on a USB Drive with Llamafile and Qwen3–4B

Oleksandr Iegorov

Quantizing an 8B Function-Calling Model So It Actually Fits on My RTX 3060

utkarsh kulshrestha

INT4 and INT8 Quantization: From Digital Communication to Deep Learning

Nsharma

The Math behind QUANTIZATION — Why shrinking a model doesn’t break it.

Latest stories

Gokul Krishna

Why I Check Exact Replay When Debugging INT8 Models

Dilip Kumar Narayanaswamy

Building a Portable AI Assistant on a USB Drive with Llamafile and Qwen3–4B

Rajneekantrawat

Quantization: What and Why?

Nikhil Gupta

What Is Model Quantization, and Why Does It Exist?

MLEngineerByFluke

LLM Quantization, Part 1: Understanding Post-Training Quantization (PTQ)

See more stories

Who to follow