1 ! Copyright (C) 2014 John Benediktsson
2 ! See http://factorcode.org/license.txt for BSD license
4 USING: io.encodings.ascii io.files kernel lexer math ;
8 : lexer-benchmark ( -- )
9 10,000 "vocab:math/math.factor" ascii file-lines [
10 <lexer> [ parse-token ] curry loop