Skip to content
ontologydriven
Sign out

Dictionary

Words, grammatical forms and meanings linked to the ontology.

byte pair encoding en · NOUN

Meanings

  1. (countable, uncountable) A lossless data compression algorithm that iteratively replaces the most frequent pair of adjacent bytes in a sequence with a new byte not already present in the data.
  2. (countable, qualifier:natural language processing, uncountable) A subword tokenization method that iteratively merges the most frequent pairs of adjacent characters in a corpus to form longer and more meaningful tokens, typically until a predefined vocabulary size is reached.

Forms

SpellingFeaturesLabelsSource
byte pair encodings Number=Plur lexicographic
byte-pair encoding alternative lexicographic