Ruby Web Crawling

8.7

4.5

Mechanize

7.4

0.0

anemone

6.9

0.0

Upton

5.8

1.5

Wombat

5.6

5.1

FastImage

5.1

4.4

MetaInspector

Know what errors lurk in your code? Automatically know what’s broken and why with Rollbar. Rollbar instantly detects when code breaks and provides the source code and state to help you defeat impactful errors. LibHunt users get 100,000 errors monitored for free.

» Learn more from our partner.

10 Web Crawling gems and projects

Mechanize

8.7 4.5 L4 Ruby

Mechanize is a ruby library that makes automated web interaction easy.
anemone

7.4 0.0 L5 Ruby

Ruby library and CLI for crawling websites.
Upton

6.9 0.0 L5 Ruby

A batteries-included framework for easy web-scraping.
Wombat

5.8 1.5 L5 Ruby

Web scraper with an elegant DSL that parses structured data from web pages.
FastImage

5.6 5.1 L5 Ruby

FastImage finds the size or type of an image given its uri by fetching as little as needed
MetaInspector

5.1 4.4 L5 Ruby

Ruby gem for web scraping purposes.
pismo

5.0 0.0 L5 Ruby

Extracts machine-readable metadata and content from Web pages
LinkThumbnailer

3.7 3.6 L5 Ruby

Ruby gem that generates thumbnail images and videos from a given URL. Much like popular social website with link preview.
Screencap

2.4 0.0 JavaScript

A gem to screencap webpages in ruby. Uses Phantom.js under the hood.
Supplejack API

0.5 9.0 Ruby

Supplejack API Mountable Engine

* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest. Visit our partner's website for more details.

Popular Comparisons

Add another 'Web Crawling' Gem