ltx23_nf4_linear

NF4 linear layer

Description

Packed weights and per-block scales are registered as buffers, so they move with the module (uint8 packs are untouched by dtype conversions). The forward pass dequantizes on the weight’s device.

Usage

ltx23_nf4_linear(out_features, in_features, bias = TRUE)

Arguments

  • bias: Logical.
  • out_features,in_features: Integers.