Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Replace PLY's lex with Plex? #45

Closed
GoogleCodeExporter opened this issue Mar 16, 2015 · 4 comments
Closed

Replace PLY's lex with Plex? #45

GoogleCodeExporter opened this issue Mar 16, 2015 · 4 comments
Labels
auto-migrated Component-CTM Priority-Medium Type-Defect

Comments

@GoogleCodeExporter
Copy link 

Maybe it's worth to try Plex instead of the scanners generated by Ply since
Plex uses a DFA and seems to operate on a subset of a document while Ply
enforces that a document is read completely.

http://code.google.com/p/python-plex/

Original issue reported on code.google.com by lars.he...@gmail.com on 14 Dec 2009 at 10:58
@GoogleCodeExporter
Copy link
Author 

Seems not to be worth to introduce another dependency. If reading the whole 
file is
an issue we may provide a handwritten lexer

Original comment by lars.he...@gmail.com on 25 Dec 2009 at 2:31

  • Changed state: WontFix

@GoogleCodeExporter
Copy link
Author 

Using a handwritten lexer or Plex may make sense since the CTM lexer needs more 
than 20min tokenize 5MB CTM source files (just tokenizing!). Regular 
expressions do not work well with long strings.

Original comment by lars.he...@gmail.com on 6 Jan 2011 at 11:45

  • Changed state: Accepted
  • Removed labels: Component-LTM, Component-Tolog

@GoogleCodeExporter
Copy link
Author

Original comment by lars.he...@gmail.com on 6 Jan 2011 at 11:46

  • Added labels: Type-Defect, Priority-Medium
  • Removed labels: Type-Task, Priority-Low

@GoogleCodeExporter
Copy link
Author 

The long delay was caused by an ill-formed grammar. The current CTM lexer 
(based on PLY) is much faster than the lexer which was responsible for this 
issue.

Original comment by lars.he...@gmail.com on 5 Apr 2011 at 10:53

  • Changed state: Fixed

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
auto-migrated Component-CTM Priority-Medium Type-Defect
Projects
None yet
Milestone
No milestone
Development

No branches or pull requests
1 participant
@GoogleCodeExporter