Tokenise

Translation of "tokenise" into Russian

Verb

Chiefly British spelling of 'tokenize'.

Употребляется в лингвистике, компьютерной обработке текста и в финтехе/блокчейне.

The software tokenises the sentence before parsing it.

Программа токенизирует предложение перед его разбором.

Verb

To divide text or data into discrete tokens for processing, especially in linguistics or computing.

The software tokenises the sentence before parsing it.

To convert or represent something in the form of tokens or small units.

The platform tokenises real-world assets for trading.