Login
Integer Quantization: Deep Dive
(hello-fri-end.github.io) by matt_d | view | 1 comments
NanoQuant: Efficient Sub-1-Bit Quantization of Large Language Models
(arxiv.org) by chrsw | view | 0 comments
Quantization for Neural Networks
(leimao.github.io) by eigenBasis | view | 0 comments
Ask HN: Does treating Inflation as a "Quantization Snap" resolve slow-roll?
by aplowe | view | 0 comments
Show HN: Fast NF4 dequantization Triton kernel (1.41x faster than bitsandbytes
(github.com) by Griffith-7 | view | 0 comments
Scaling Law for Quantization-Aware Training
(arxiv.org) by JumpCrisscross | view | 0 comments
Negative squaring – pre-tilted 3-bit quantization beat naive 4-bit
(github.com) by faDOOM | view | 0 comments
Asymmetric Quantization: Near-Lossless Retrieval with 97% Storage Reduction
(mixedbread.com) by breadislove | view | 0 comments
LLM Quantization Project Part 1: What Even Is an LLM?
(lttlabs.com) by LabsLucas | view | 1 comments
Mlx-optiq: per-layer mixed-precision LLM quantization for Apple Silicon
(mlx-optiq.com) by codelion | view | 0 comments
GGUF vs. GPTQ vs. AWQ: The Plain-English Guide to LLM Quantization
(vettedconsumer.com) by ermantrout | view | 0 comments
GGUF vs. GPTQ vs. AWQ: The Plain-English Guide to LLM Quantization
(vettedconsumer.com) by ermantrout | view | 0 comments
KVarN: Native vLLM KV-cache quantization back end by Huawei
(github.com) by theanonymousone | view | 0 comments
Spikes in LLMs Are Bias Vectors: Spike-Free Quantization
(arxiv.org) by sbulaev | view | 0 comments
Show HN: Glq LLM quantization using E8 lattice
(github.com) by acd | view | 0 comments
Emergent Quantization from a Dynamic Vacuum
(journals.aps.org) by bookofjoe | view | 0 comments
3.125-Bit LLM quantization bypassing tensor cores
(blog.djellalmohamedaniss.workers.dev) by dmaniss | view | 0 comments
Evaluation of Various MLX Quantizations
(github.com) by d-_-b | view | 1 comments
Scalar and Binary Quantization for Pgvector Vector Search and Storage (2024)
(jkatz05.com) by eigenBasis | view | 0 comments
Emergent Quantization from a Dynamic Vacuum
(journals.aps.org) by davedx | view | 0 comments
Quantization for Modern AI Systems (70-page free eBook)
(pawankjha.substack.com) by pawanjha25 | view | 0 comments
Advanced Quantization Algorithm for LLMs
(github.com) by lastdong | view | 0 comments
LLM Quantization
(huggingface.co) by Anon84 | view | 0 comments
A DuckDB extension for vector search indexes with pluggable quantization
(github.com) by CheeseWang | view | 0 comments
The Quantization Robustness of Diffusion Language Models in Coding Benchmarks
(arxiv.org) by matt_d | view | 0 comments
SAW-INT4: System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving
(arxiv.org) by matt_d | view | 0 comments
A guide to model quantization in fine-tuning (and how to pick the right GGUF)
(siquick.com) by siquick | view | 0 comments
Quantization, LoRA, and the 8% Problem Benchmarking Local LLMs for Production AI
(walsenburgtech.com) by cowartc | view | 0 comments
RAG 40x faster using binary quantization (2024)
(lightning.ai) by teleforce | view | 0 comments
KYB Engine at 3 Quantization Levels: Accuracy Held. Cost Dropped 6x
(walsenburgtech.com) by cowartc | view | 0 comments
Show HN: TurboQuant-WASM – Google's vector quantization in the browser
(github.com) by teamchong | view | 0 comments
Mixed Precision Quantization on mlx comes with TurboQuant implementation
(twitter.com) by jsilence | view | 1 comments
Salomi, a research repo on extreme low-bit transformer quantization
(github.com) by Edward9055 | view | 0 comments
Fujitsu One Compression (LLM Quantization)
(FujitsuResearch.github.io) by measurablefunc | view | 0 comments
Zero-Bit Quantization for Neural Network Weight Encoding (ZBQ/1.0)
(medium.com) by AdnanMasood | view | 0 comments
RaBitQ Binary Quantization 101
(elastic.co) by tamnd | view | 0 comments
TurboQuant: KV Cache Quantization to 3.5 Bits with Zero Accuracy Loss- ICLR 2026
(darshanfofadiya.com) by DARSHANFOFADIYA | view | 0 comments
TurboQuant: Online Vector Quantization with Near-Optimal Distortion Rate
(openreview.net) by tamnd | view | 0 comments
Quantization from the Ground Up
(ngrok.com) by samwho | view | 0 comments
FlashHead: Up to 40% Faster Multimodal Reasoning on Top of Quantization
(huggingface.co) by Embedl-Wilhelm | view | 1 comments
Show HN: Qwodel – An open-source unified pipeline for LLM quantization
by kinderasteroid | view | 0 comments
Emergent Quantization from a Dynamic Vacuum
(journals.aps.org) by Rover222 | view | 1 comments
Power-of-Two Quantization for Efficient FPGA-Based GRU Architectures
(mdpi.com) by PaulHoule | view | 0 comments
Ask HN: Does treating Inflation as a "Quantization Snap" resolve slow-roll?
by aplowe | view | 0 comments
9x MobileNet V2 size reduction with Quantization aware training
(github.com) by gauravvij137 | view | 1 comments
Quantization-Aware Distillation
(ternarysearch.blogspot.com) by paladin314159 | view | 0 comments
Quantization-Aware Distillation for NVFP4 Inference Accuracy Recovery [pdf]
(research.nvidia.com) by gmays | view | 0 comments
LLM Quantization and NVFP4
(ternarysearch.blogspot.com) by paladin314159 | view | 0 comments
Nvidia: Quantization-Aware Distillation for NVFP4 Inference Accuracy Recovery [pdf]
(research.nvidia.com) by tosh | view | 0 comments
Removing branches from the hot path: A 60% speed-up for Product Quantization
(twitter.com) by bobvanluijt | view | 0 comments