In compilers design considering that to start building a compiler you need a tokenizer and lexer parsers, but what goes into a fully mature lexer parser?Meaning that if I was to look to build a lexer from scratch for learning purposes, what are design and implementation decisions would go into building a fully matured lexer? Including what should the lexer be capable of (in a more complex scenario)? I understand fundamentally how they work and in both theory, but when developing one, what are other forms of capabilities should they have, and what are ways I can expand my own implementations of the lexers?
In compilers design considering that to start building a compiler you need a tokenizer and lexer parsers, but what goes into a fully mature lexer parser?Meaning that if I was to look to build a lexer from scratch for learning purposes, what are design and implementation decisions would go into building a fully matured lexer? Including what should the lexer be capable of (in a more complex scenario)? I understand fundamentally how they work and in both theory, but when developing one, what are other forms of capabilities should they have, and what are ways I can expand my own implementations of the lexers?
Programming Logic & Design Comprehensive
9th Edition
ISBN:9781337669405
Author:FARRELL
Publisher:FARRELL
Chapter2: Elements Of High-quality Programs
Section: Chapter Questions
Problem 9RQ
Related questions
Question
In compilers design considering that to start building a compiler you need a tokenizer and lexer parsers, but what goes into a fully mature lexer parser?
Meaning that if I was to look to build a lexer from scratch for learning purposes, what are design and implementation decisions would go into building a fully matured lexer? Including what should the lexer be capable of (in a more complex scenario)?
I understand fundamentally how they work and in both theory, but when developing one, what are other forms of capabilities should they have, and what are ways I can expand my own implementations of the lexers?
Expert Solution

This question has been solved!
Explore an expertly crafted, step-by-step solution for a thorough understanding of key concepts.
This is a popular solution!
Trending now
This is a popular solution!
Step by step
Solved in 2 steps

Knowledge Booster
Learn more about
Need a deep-dive on the concept behind this application? Look no further. Learn more about this topic, computer-science and related others by exploring similar questions and additional content below.Recommended textbooks for you
Programming Logic & Design Comprehensive
Computer Science
ISBN:
9781337669405
Author:
FARRELL
Publisher:
Cengage

Principles of Information Systems (MindTap Course…
Computer Science
ISBN:
9781285867168
Author:
Ralph Stair, George Reynolds
Publisher:
Cengage Learning

C++ Programming: From Problem Analysis to Program…
Computer Science
ISBN:
9781337102087
Author:
D. S. Malik
Publisher:
Cengage Learning
Programming Logic & Design Comprehensive
Computer Science
ISBN:
9781337669405
Author:
FARRELL
Publisher:
Cengage

Principles of Information Systems (MindTap Course…
Computer Science
ISBN:
9781285867168
Author:
Ralph Stair, George Reynolds
Publisher:
Cengage Learning

C++ Programming: From Problem Analysis to Program…
Computer Science
ISBN:
9781337102087
Author:
D. S. Malik
Publisher:
Cengage Learning

C++ for Engineers and Scientists
Computer Science
ISBN:
9781133187844
Author:
Bronson, Gary J.
Publisher:
Course Technology Ptr

Systems Architecture
Computer Science
ISBN:
9781305080195
Author:
Stephen D. Burd
Publisher:
Cengage Learning