Skip to content

taylorchu/toki

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

11 Commits
 
 
 
 
 
 
 
 

Repository files navigation

toki

Regexp tokenizer/scanner in Go.

The scanner takes in a list of token definitions and string input. it is general and easy to use.

token definition

a token is a pair of constant and regexp string.

About

general tokenizer/scanner in Go

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages