ltx23_rotary_pos_embed_1d

1D rotary embeddings for the text connectors

Description

1D rotary embeddings for the text connectors

Usage

ltx23_rotary_pos_embed_1d(dim, base_seq_len = 4096L, theta = 10000,
                          double_precision = TRUE, rope_type = "split",
                          num_attention_heads = 32L)

Arguments

  • dim: Integer. Rotary dimension (connector inner dim).
  • base_seq_len: Integer. Base sequence length for normalization.
  • theta: Numeric. RoPE theta.
  • double_precision: Logical. Compute base frequencies in float64.
  • rope_type: “split” (LTX-2.3) or “interleaved”.
  • num_attention_heads: Integer. For the split per-head layout.