ltx23_fp8_linear

FP8 linear layer

Description

Weight lives as float8_e4m3fn plus a float32 scale in plain module fields (so $to(device) moves only the bias); the forward pass ships 1 byte/param to the input’s device, upcasts, rescales, and runs nnf_linear.

Usage

ltx23_fp8_linear(out_features, in_features, bias = TRUE)

Arguments

  • bias: Logical.
  • out_features,in_features: Integers.