flux_ada_layer_norm_continuous

FLUX continuous adaLN (final norm)

Description

Scale/shift conditioning of the final norm. Note the chunk order: scale first, then shift (the reverse of adaLN-Zero). Reference: diffusers AdaLayerNormContinuous as used by FLUX norm_out (elementwise_affine = FALSE, eps = 1e-6).

Usage

flux_ada_layer_norm_continuous(dim, cond_dim = dim, bias = TRUE)

Arguments

  • dim: Integer. Model dimension.
  • cond_dim: Integer. Conditioning embedding dimension.
  • bias: Logical. Bias on the projection (TRUE for FLUX.1, FALSE for FLUX.2).