15 Web Crawling gems and projects
8.9 7.7 L4 RubyMechanize is a ruby library that makes automated web interaction easy.
7.6 0.0 L5 RubyAnemone web-spider framework
7.2 0.0 L5 HTMLA batteries-included framework for easy web-scraping. Just add CSS! (Or do more.)
6.5 0.6 L5 RubyLightweight Ruby web crawler/scraper with an elegant DSL which extracts structured data from pages.
6.4 4.8 L5 RubyFastImage finds the size or type of an image given its uri by fetching as little as needed
6.1 3.3 L5 RubyRuby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images...
5.6 0.0 L5 RubyExtracts machine-readable metadata and content from Web pages
4.8 0.1 L5 RubyRuby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.
3.3 4.9 RubyFast high-level web crawling Ruby framework
2.6 0.0 RubyAn instagram bot works without instagram api, only needs your username and password. written in ruby
1.7 0.0 RubyThe Hawker gem is a web scraper which allows you to pull the basic information for given social media profile URL
1.3 0.0 RubySupplejack API Mountable Engine
1.1 4.1 RubyGoogle Search Results via SERP API Ruby Gem
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest. Visit our partner's website for more details.