Spidr alternatives and similar gems

Based on the "Web Crawling" category.
Alternatively, view spidr alternatives based on common mentions on social networks and blogs.

• Mechanize

  8.9 3.2 L4 Spidr VS Mechanize

  Mechanize is a ruby library that makes automated web interaction easy.
  

• anemone

  7.6 0.0 L5 Spidr VS anemone

  Anemone web-spider framework

Access the most powerful time series database as a service

Ingest, store, & analyze all types of time series data in a fully-managed, purpose-built database. Keep data forever with low-cost storage and superior data compression.

Promo www.influxdata.com



• Upton

  7.2 0.0 L5 Spidr VS Upton

  A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
  

• Wombat

  6.6 6.0 L5 Spidr VS Wombat

  Lightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.

• FastImage

  6.5 0.0 L5 Spidr VS FastImage

  FastImage finds the size or type of an image given its uri by fetching as little as needed

• MetaInspector

  6.2 3.7 L5 Spidr VS MetaInspector

  Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...
  

• pismo

  5.6 0.0 L5 Spidr VS pismo

  Extracts machine-readable metadata and content from Web pages

• LinkThumbnailer

  4.9 0.0 L5 Spidr VS LinkThumbnailer

  Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.

• Vessel

  3.9 1.7 Spidr VS Vessel

  Fast high-level web crawling Ruby framework
  

• Screencap

  3.2 0.0 Spidr VS Screencap

  A gem to screencap webpages in ruby. Uses Phantom.js under the hood.

• instabot.rb

  2.8 0.0 Spidr VS instabot.rb

  An instagram bot works without instagram api, only needs your username and password. written in ruby

• The Hawker Ruby gem

  1.9 0.0 Spidr VS The Hawker Ruby gem

  The Hawker gem is a web scraper which allows you to pull the basic information for given social media profile URL

• Supplejack API

  1.3 6.4 Spidr VS Supplejack API

  Supplejack API Mountable Engine
  

• Google Search Results in Ruby

  1.3 0.0 Spidr VS Google Search Results in Ruby

  Google Search Results via SERP API Ruby Gem
  

• Kimurai

  0.6 2.1 Spidr VS Kimurai

  Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with Javascript rendered websites

* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.

Do you think we are missing an alternative of Spidr or a related project?

Clean code begins in your IDE with SonarLint sponsored www.sonarlint.org

Popular Comparisons

• Spidr
  vs
  Mechanize
• Wombat
  vs
  Mechanize
• Mechanize
  vs
  anemone
• Mechanize
  vs
  Kimurai
• Mechanize
  vs
  MetaInspector

SaaSHub - Software Alternatives and Reviews sponsored www.saashub.com