Selected Tags

Click on a tag to remove it

Web Crawling gems

Showing projects tagged as Projects and Web Crawling

  • Upton

    7.1 0.0 L5 HTML
    A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)

  • Wombat

    6.6 2.2 L5 Ruby
    Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.

  • Vessel

    4.6 5.6 Ruby
    Fast high-level web crawling Ruby framework

  • Screencap

    3.3 0.0 JavaScript
    A gem to screencap webpages in ruby. Uses Phantom.js under the hood.

  • 🕷 Tanakai

    3.0 6.1 Ruby
    Tanakai is a modern web scraping framework written in Ruby. A fork of Kimurai.

  • instabot.rb

    2.8 0.0 Ruby
    An instagram bot works without instagram api, only needs your username and password. written in ruby