Selected Tags

Click on a tag to remove it

More Tags

Click on a tag to add it and filter down

Web Crawling gems

Showing projects tagged as Interaction, Web Content Scrapers, and Web Crawling

  • anemone

    7.6 0.0 L5 Ruby
    Anemone web-spider framework
  • LinkThumbnailer

    4.9 0.0 L5 Ruby
    Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview.
  • Kimurai

    0.6 2.1 Ruby
    Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with Javascript rendered websites