ltx23_quantize_nf4

Packages

chatterbox
- chatterbox Reference
cornfab
- cornfab Reference
diffuseR
earshot
- run_app
fyi
- fyi Reference
llamaR
- llamaR Reference
rapt
- rapt Reference
rformat
- rformat Reference
saber
- saber Reference
stt.api
tinypkgr
- tinypkgr Reference
tinyrox
- tinyrox Reference
tts.api
- tts.api Reference
whisper

Quantize an LTX-2.3 checkpoint to NF4 shards

Description

Same streaming layout and cast policy as ltx23_quantize_fp8, but cast-set weights are stored as NF4 (<key> packed uint8 + <key>_absmax float32 blocks + the original shape recovered from the model config at load time). Non-cast tensors are copied through unchanged. The manifest carries format = "nf4".

Usage

ltx23_quantize_nf4(checkpoint_path,
                   output_dir = file.path(tools::R_user_dir("diffuseR", "data"), "ltx2.3-nf4"),
                   shard_bytes = 4e+09, force = FALSE, verbose = TRUE)

Arguments

checkpoint_path: Source .safetensors (bf16 single file).
output_dir: Output directory for shards + manifest.
shard_bytes: Numeric. Approximate shard size.
force: Logical. Re-quantize even if a valid manifest exists.
verbose: Logical.

Value

Invisibly, the manifest list.