decode_tokens

Decode token IDs to text

Description

Decode token IDs to text

Usage

1decode_tokens(tokenizer, ids)

Arguments

  • tokenizer: Tokenizer object
  • ids: Integer vector or tensor of token IDs

Value

Decoded text string