vox-quantize API Reference (generated)
vox-quantize
Section titled “vox-quantize”Crate: vox-quantize · Version: 0.6.0 · Target: Library (lib.rs)
Data-free k-quant PTQ engine: SafeTensors -> Candle GGML quantized SafeTensors (GPU-first, CPU fallback).
Crate Overview
Section titled “Crate Overview”Data-free k-quant post-training quantization engine.
SafeTensors model in -> quantized SafeTensors-canonical artifact out.
Device-selectable: GPU when available (cuda/metal feature), CPU fallback.
The engine sits behind the engine feature (off by default), so CORE
builds that depend on this crate pull no Candle.
Features
Section titled “Features”| Feature | Default / Enables |
|---|---|
cuda | engine, candle-core/cuda |
default | — |
engine | dep:candle-core |
metal | engine, candle-core/metal |
Public API Surface
Section titled “Public API Surface”Modules
Section titled “Modules”| Module | Description |
|---|---|
device | — |
engine | — |
error | — |
policy | — |
read | — |
recombine | — |
verify | — |
write | — |