Scraping

If you don't mean those, what do you mean?

You can always simply fetch the raw page source and run regexps on it.
Is that more what you mean?

···

On Nov 17, 8:03 am, venkat <ven...@nospam.com> wrote:

Is there a library/framework for scraping (web)?

I have a few scrapers written but would like to see if there are any
libraries available. I don't mean Mechanize and Hpricot or any other
parsers for (X)HTML.

Phrogz wrote:

Is there a library/framework for scraping (web)?

Yeah.

I wrote a little article on this about a year ago, and I almost fell off the chair when it was referenced in 'Learning Ruby' from O'Reilly.
It describes different web scraping possibilities in Ruby:

http://www.rubyrailways.com/data-extraction-for-web-20-screen-scraping-in-rubyrails

Since then I wrote a web scraping framework, scRUBYt! - based on the gem download stats (nearly 8000) it's very popular. It's also very actively developed and ... well enough self-advertisement, please read the rubyrailways article and decide it for yourself :slight_smile:

Cheers,
Peter

···

On Nov 17, 8:03 am, venkat <ven...@nospam.com> wrote:

___
http://www.rubyrailways.com
http://scrubyt.org

You might also like scrAPI
http://rubyforge.org/projects/scrapi/

-Daniel Brumbaugh Keeney