Kinds of token in a SqlTokens stream.
Word
SELECT
Name
@p
#temp
QuotedIdentifier
"…"
[…]
`…`
String
'…'
N'…'
E'…'
$tag$…$tag$
q'[…]'
Number
Operator
=
<
+
*
:
Punctuation
(
)
,
;
.
Whitespace
Comment
TemplateExpression
{{ … }}
{{query:"…"}}
TemplateBlock
{% … %}
TemplateComment
{# … #}
Unknown
Consumers must treat any kind they do not recognise as opaque: kinds may be added.
Kinds of token in a SqlTokens stream.
Word: a bare keyword or identifier (SELECT,Name,@p,#temp).QuotedIdentifier:"…",[…]or`…`, by the dialect's quoting forms.String: a string literal in any of the dialect's forms ('…',N'…',E'…',$tag$…$tag$,q'[…]').Number: a numeric literal.Operator: any other single character (=,<,+,*,:, …).Punctuation:(,),,,;and..WhitespaceandComment: text that carries no meaning to the database.TemplateExpression: a{{ … }}tag, including a composition{{query:"…"}}.TemplateBlock: a{% … %}tag.TemplateComment: a{# … #}tag.Unknown: text the lexer could not read, such as a template opener with no closer.Consumers must treat any kind they do not recognise as opaque: kinds may be added.