1 USING: accessors parser words words.symbol
2 sequences namespaces kernel assocs
6 ! Based on org.gjt.sp.jedit.syntax.Token
11 "COMMENT1" "COMMENT2" "COMMENT3" "COMMENT4" "DIGIT"
12 "FUNCTION" "INVALID" "KEYWORD1" "KEYWORD2" "KEYWORD3"
13 "KEYWORD4" "LABEL" "LITERAL1" "LITERAL2" "LITERAL3"
14 "LITERAL4" "MARKUP" "OPERATOR" "END" "NULL"
16 dup create-in dup define-symbol
17 ] H{ } map>assoc tokens set-global
20 : string>token ( string -- id ) tokens get at ;