flux_ada_layer_norm_zero

FLUX adaLN-Zero modulation (double-stream)

Description

Projects the conditioning embedding to six modulation vectors and returns the msa-modulated input plus the remaining parameters. Reference: diffusers AdaLayerNormZero.

Usage

flux_ada_layer_norm_zero(dim)

Arguments

  • dim: Integer. Model dimension.

Value

Module whose forward(x, emb) returns list(x_norm, gate_msa, shift_mlp, scale_mlp, gate_mlp).