Compiler Token
[Regular Expression](https://texonom.com/regular-expression-5827ff6abf584808b6e1c02b7fa5e25f) [Finite Automaton](https://texonom.com/finite-automaton-6ccd60d415e74d07a615b9714ce83510) 


### Minimum unit that container meaning
Compiler Symbol Table
- normal state: copy a character to a token buffer
- accept state: return a token & go back to intial state
- “error” state: report an error & stop
### Compiler Token Notion
|Title|
|:-:|
|[Token Type](https://texonom.com/token-type-9e9f31b90fec4cbaab22c5e599f1e52d)|
|[Token Attribute](https://texonom.com/token-attribute-dafcc1ba43984b15a777e4fafb850b87)|
|[Token Record](https://texonom.com/token-record-5e041f1a7e574101b2d7b032cfb79077)|
|[Token Specification](https://texonom.com/token-specification-d3ed33fb12e64b3790404c79a760f294)|




> [Tokens and Delimiters](http://ibcomp.fis.edu/Reading/JavaTutor/Notes/chap49D/ch49D_13.html)






