ltx23_snake_beta

SnakeBeta activation

Description

x + (1 / (beta + eps)) * sin(x * alpha)^2 with per-channel log-scale alpha/beta parameters.

Usage

ltx23_snake_beta(channels, eps = 1e-09)

Arguments

  • channels: Integer.
  • eps: Numeric.