Function tokenize

  • tokenize(content: string, highlightRules: HighlightRules): TokenizeResult

  • Parses provided content according to provided highlighting rules and return tokens. Tokens either have the className set according to Ace themes or have no className if they are just pure text tokens. Result is a list of list of tokens, where each line from the provided content is a separate list of tokens.

    Parameters

    • content: string

      to tokenize

    • highlightRules: HighlightRules

      defining the language grammar

    Returns TokenizeResult

    tokenization result containing a list of token for each of the lines from content

Settings

Member Visibility