Ruby Web Crawling

8.9

4.1

Mechanize

7.5

0.0

anemone

7.0

1.8

Upton

6.2

1.8

Wombat

5.9

4.5

FastImage

5.5

4.9

MetaInspector

13 Web Crawling gems and projects

Mechanize

8.9 4.1 L4 Ruby

Mechanize is a ruby library that makes automated web interaction easy.
anemone

7.5 0.0 L5 Ruby

Ruby library and CLI for crawling websites.
Upton

7.0 1.8 L5 Ruby

A batteries-included framework for easy web-scraping.
Wombat

6.2 1.8 L5 Ruby

Web scraper with an elegant DSL that parses structured data from web pages.
FastImage

5.9 4.5 L5 Ruby

FastImage finds the size or type of an image given its uri by fetching as little as needed
MetaInspector

5.5 4.9 L5 Ruby

Ruby gem for web scraping purposes.
pismo

5.2 0.0 L5 Ruby

Extracts machine-readable metadata and content from Web pages
LinkThumbnailer

4.2 3.3 L5 Ruby

Ruby gem that generates thumbnail images and videos from a given URL. Much like popular social website with link preview.
Screencap

2.8 0.0 JavaScript

A gem to screencap webpages in ruby. Uses Phantom.js under the hood.
instabot.rb

1.7 4.9 Ruby

An instagram bot works without instagram api, only needs your username and password. written in ruby
The Hawker Ruby gem

1.0 0.7 Ruby

Get the profile information from Github, Twitter or Instagram without the API
Supplejack API

0.7 8.8 Ruby

Supplejack API Mountable Engine
Kimurai

0.6 2.2 Ruby

Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with Javascript rendered websites

* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest. Visit our partner's website for more details.

Popular Comparisons

Add another 'Web Crawling' Gem