tokenizer en · NOUN
Etymology
From tokenize + -er.
Meanings
- A system that parses an input stream into its component tokens.
Forms
| Spelling | Features | Labels | Source |
|---|---|---|---|
| tokenizers | Number=Plur | lexicographic |
Dictionary
Words, grammatical forms and meanings linked to the ontology.