Expand description
Calibration pipeline for quantization.
Provides infrastructure for loading calibration datasets, collecting activation histograms, and computing optimal quantization parameters using various calibration methods (MinMax, Percentile, KL-divergence).
Structs§
- Calibration
Dataset - A set of calibration samples loaded from binary files.
- Calibration
Result - Results from running the calibration pipeline on a module.
- Histogram
Collector - Histogram collector that aggregates activation values across calibration samples.
- Tensor
Histogram - Histogram of activation values for a single tensor.
Enums§
- Calibration
Error - Errors that can occur during calibration.
- Calibration
Method - Calibration method for determining quantization parameters.
Functions§
- calibrate
- Compute quantization parameters for a histogram using the specified method.
- calibrate_
kl_ divergence - Compute quantization parameters using KL-divergence (entropy) calibration.
- calibrate_
minmax - Compute quantization parameters using MinMax calibration.
- calibrate_
percentile - Compute quantization parameters using Percentile calibration.
- per_
channel_ quantize - Compute per-channel quantization parameters for a weight tensor.
- run_
calibration - Run the full calibration pipeline on a calibration dataset.