Get an LTX-2.3 memory profile
Description
Selects transformer precision, component placement, and attention
chunking for the available VRAM. Measured on an RTX 5060 Ti (16 GB):
fp8 streaming peaks ~11.6 GB (without phase offloading) at
512x320x49; NF4 keeps the whole 22B transformer resident (~12.5 GB)
and removes the ~21 GB/step PCIe weight streaming. The NF4 profile
renders 1280x704x121 with audio in ~23 min at a 15.7 GB peak
(tiled VAE decode, in-place feed-forward GELU, and the default
diffuseR.attn_budget of 1.5e8 all required at that size).
Usage
ltx23_memory_profile(vram_gb = NULL)
Arguments
vram_gb: Numeric or NULL (auto-detect free VRAM).
Details
- precision “nf4”: Weights resident on the GPU; fastest steps; about 9 percent weight round-trip error.
- precision “fp8”: Weights CPU-resident, streamed per linear; near-bf16 quality; each step pays the PCIe transfer.
Value
Named list with device/dtype placement, attn_chunk,
pin_weights, and resolution caps.