ltx23_set_attn_chunk

Set the attention query-chunk size across a transformer

Description

R torch has no fused attention, so the [B, H, S, S] matrix materializes; chunking queries bounds the peak. NULL disables chunking.

Usage

ltx23_set_attn_chunk(transformer, chunk)

Arguments

  • transformer: An ltx23_transformer.
  • chunk: Integer or NULL.

Value

Invisibly, the transformer.