GPU

What is Quantization?

The process of reducing the precision of model weights and activations (e.g., from FP32 to INT8) to improve performance and reduce memory usage.

Related GPU terms