Selected Tags

Click on a tag to remove it

More Tags

Click on a tag to add it and filter down

Web Content Scrapers gems

Showing projects tagged as Web Crawling and Web Content Scrapers

  • anemone

    7.5 0.0 L5 Ruby
    Ruby library and CLI for crawling websites.
  • LinkThumbnailer

    4.7 0.6 L5 Ruby
    Ruby gem that generates thumbnail images and videos from a given URL. Much like popular social website with link preview.
  • The Hawker Ruby gem

    1.5 0.0 Ruby
    Get the profile information from Github, Twitter or Instagram without the API
  • Kimurai

    0.6 2.1 Ruby
    Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with Javascript rendered websites
  • html2rss

    0.6 7.7 Ruby
    Generate RSS 2.0 feeds from websites with minimal effort.