Miguel Carreira NevesSep 19, 202310 minWhat are Quantized LLMs?Quantization is a technique used to compact LLMs. What methods exist and how to quickly start using them?