ltx23_load_transformer_fp8

Packages

chatterbox
- chatterbox Reference
cornfab
- cornfab Reference
diffuseR
earshot
- run_app
fyi
- fyi Reference
llamaR
- llamaR Reference
rapt
- rapt Reference
rformat
- rformat Reference
saber
- saber Reference
stt.api
tinypkgr
- tinypkgr Reference
tinyrox
- tinyrox Reference
tts.api
- tts.api Reference
whisper

Load the LTX-2.3 transformer with FP8 weights

Description

Builds the transformer, swaps the official cast-set linears for ltx23_fp8_linear, loads fp8 weights CPU-side (optionally pinned) and everything else as bfloat16 on device. Sets options(diffuseR.block_gc = TRUE) so the transformer runs per-block garbage collection over the dequantized temporaries.

Usage

ltx23_load_transformer_fp8(ckpt, device = "cuda", pin = TRUE, verbose = TRUE,
                           ...)

Arguments

ckpt: An fp8 ltx23_checkpoint (ltx23_open_fp8_checkpoint).
device: Character. Device for the resident (non-fp8) weights.
pin: Logical. Pin the fp8 host memory for faster transfers.
verbose: Logical.
...: Passed to ltx23_transformer (tiny test configs).

Value

The loaded ltx23_transformer.