10

8

6

4

2


8.8

3.8
Mechanize

7.5
0.0
anemone

7.1
1.2
Upton

6.1

3.8
Wombat

5.9

4.0
FastImage

5.5

3.0
MetaInspector

12 Web Crawling gems and projects

  • Mechanize

    8.8 3.8 L4 Ruby
    Mechanize is a ruby library that makes automated web interaction easy.

  • anemone

    7.5 0.0 L5 Ruby
    Ruby library and CLI for crawling websites.

  • Upton

    7.1 1.2 L5 Ruby
    A batteries-included framework for easy web-scraping.

  • Wombat

    6.1 3.8 L5 Ruby
    Web scraper with an elegant DSL that parses structured data from web pages.

  • FastImage

    5.9 4.0 L5 Ruby
    FastImage finds the size or type of an image given its uri by fetching as little as needed

  • MetaInspector

    5.5 3.0 L5 Ruby
    Ruby gem for web scraping purposes.

  • pismo

    5.2 0.0 L5 Ruby
    Extracts machine-readable metadata and content from Web pages

  • LinkThumbnailer

    4.1 4.6 L5 Ruby
    Ruby gem that generates thumbnail images and videos from a given URL. Much like popular social website with link preview.

  • Screencap

    2.8 0.0 JavaScript
    A gem to screencap webpages in ruby. Uses Phantom.js under the hood.

  • instabot.rb

    1.4 8.5 Ruby
    An instagram bot works without instagram api, only needs your username and password. written in ruby

  • Supplejack API

    0.7 9.3 Ruby
    Supplejack API Mountable Engine

  • The Hawker Ruby gem

    0.6 1.4 Ruby
    Get the profile information from Github, Twitter or Instagram without the API

Popular Comparisons

Add another 'Web Crawling' Gem