ltx23_ada_layer_norm_single

Adaptive layer norm single (adaLN-single)

Description

Embeds a timestep/sigma and projects it to a configurable number of modulation parameter vectors.

Usage

ltx23_ada_layer_norm_single(embedding_dim, num_mod_params = 6L)

Arguments

  • embedding_dim: Integer. Model dimension.
  • num_mod_params: Integer. Number of modulation parameter vectors.

Value

Module whose forward returns list(mod_params [N, num_mod_params * dim], embedded_timestep [N, dim]).