ruby_parser version 3.21.0 has been released!
* home: <https://github.com/seattlerb/ruby_parser>
* bugs: <https://github.com/seattlerb/ruby_parser/issues>
* rdoc: <http://docs.seattlerb.org/ruby_parser>
ruby_parser (RP) is a ruby parser written in pure ruby (utilizing
racc--which does by default use a C extension). It outputs
s-expressions which can be manipulated and converted back to ruby via
the ruby2ruby gem.
As an example:
def conditional1 arg1
return 1 if arg1 == 0
return 0
end
becomes:
s(:defn, :conditional1, s(:args, :arg1),
s(:if,
s(:call, s(:lvar, :arg1), :==, s(:lit, 0)),
s(:return, s(:lit, 1)),
nil),
s(:return, s(:lit, 0)))
Tested against 801,039 files from the latest of all rubygems (as of 2013-05):
* 1.8 parser is at 99.9739% accuracy, 3.651 sigma
* 1.9 parser is at 99.9940% accuracy, 4.013 sigma
* 2.0 parser is at 99.9939% accuracy, 4.008 sigma
* 2.6 parser is at 99.9972% accuracy, 4.191 sigma
* 3.0 parser has a 100% parse rate.
* Tested against 2,672,412 unique ruby files across 167k gems.
* As do all the others now, basically.
Changes:
### 3.21.0 / 2024-01-15
* 18 minor enhancements:
* (internal) Added simple RubyLexer#comment.
* (internal) Removed RubyLexer#comments and #ignore_body_comments.
* (internal) Removed RubyParser#comments.
* (internal) Renamed files from lib/ruby##_parser.* to lib/ruby_parser##.*
* (internal) Renamed lib/ruby3_parser.yy to lib/ruby_parser3.yy
* (internal) Renamed lib/ruby_parser.yy to lib/ruby_parser2.yy
* Added tentative 3.2 support. (torrocus)
* Made `rake compare` a multitask (28s -> 10s!!).
* Made `rake compare` depend on `generate` (from clean: 28s -> 18s).
* No longer package versioned .y files.
* Overhaul of parser/lexer comment processing.
* Parser productions for k_class/k_module/k_def carry their comment with them.
* Restructured build tasks to utilize Hoe's .yy support! 8.5s -> 1.2s!!!
* RubyParser new_(class|module|defn|defs) handle comment processing via sexp.
* RubyParser new_(class|module|defn|defs) handle normalizing production sexps.
* RubyParser#next_token clears out lexer's comment when applicable.
* Simplified parser productions for defn_head, defs_head. No more normalizing.
* Updated `rake compare` steps for lrama in ruby 3.3+.
* 6 bug fixes:
* Cleaned out cruft from `rake compare` code.
* Fixed compare/normalize.rb for lrama differences.
* Made `parser` task depend on `isolate` task to pick up racc generator.
* Made racc a runtime dependency (was dev only) now that ruby 3.3 doesn't ship with the racc runtime. (wildmaples)
* Updated README.rdoc updating instructions to match current filenames.
* Updated compare versions and added 3.3.
···
______________________________________________
ruby-talk mailing list -- ruby-talk@ml.ruby-lang.org
To unsubscribe send an email to ruby-talk-leave@ml.ruby-lang.org
ruby-talk info -- Info | ruby-talk@ml.ruby-lang.org - ml.ruby-lang.org