Wombat alternatives and similar gems
Based on the "Web Crawling" category.
Alternatively, view Wombat alternatives based on common mentions on social networks and blogs.
-
Mechanize
Mechanize is a ruby library that makes automated web interaction easy. -
Upton
A batteries-included framework for easy web-scraping. Just add CSS! (Or do more.) -
FastImage
FastImage finds the size or type of an image given its uri by fetching as little as needed -
MetaInspector
Ruby gem for web scraping purposes. It scrapes a given URL, and returns you its title, meta description, meta keywords, links, images... -
Spidr
A versatile Ruby web spidering library that can spider a site, multiple domains, certain links or infinitely. Spidr is designed to be fast and easy to use. -
LinkThumbnailer
Ruby gem that fetches images and metadata from a given URL. Much like popular social website with link preview. -
Screencap
A gem to screencap webpages in ruby. Uses Phantom.js under the hood. -
đź•· Tanakai
Tanakai is a modern web scraping framework written in Ruby. A fork of Kimurai. -
instabot.rb
An instagram bot works without instagram api, only needs your username and password. written in ruby -
The Hawker Ruby gem
The Hawker gem is a web scraper which allows you to pull the basic information for given social media profile URL -
Google Search Results in Ruby
Google Search Results via SERP API Ruby Gem -
Kimurai
Kimurai is a modern web scraping framework written in Ruby which works out of box with Headless Chromium/Firefox, PhantomJS, or simple HTTP requests and allows to scrape and interact with Javascript rendered websites
PopRuby: Clothing and Accessories for Ruby Developers
* Code Quality Rankings and insights are calculated and provided by Lumnify.
They vary from L1 to L5 with "L5" being the highest.
Do you think we are missing an alternative of Wombat or a related project?
Popular Comparisons
README
Wombat
Web scraper with an elegant DSL that parses structured data from web pages.
Usage:
gem install wombat
Scraping a page:
The simplest way to use Wombat is by calling Wombat.crawl
and passing it a block:
require 'wombat'
Wombat.crawl do
base_url "https://www.github.com"
path "/"
headline xpath: "//h1"
subheading css: "p.alt-lead"
what_is({ css: ".one-fourth h4" }, :list)
links do
explore xpath: '/html/body/header/div/div/nav[1]/a[4]' do |e|
e.gsub(/Explore/, "Love")
end
features css: '.nav-item-opensource'
business css: '.nav-item-business'
end
end
The code above is gonna return the following hash:
{
"headline"=>"How people build software",
"subheading"=>"Millions of developers use GitHub to build personal projects, support their businesses, and work together on open source technologies.",
"what_is"=>[
"For everything you build",
"A better way to work",
"Millions of projects",
"One platform, from start to finish"
],
"links"=>{
"explore"=>"Love",
"features"=>"Open source",
"business"=>"Business"
}
}
This is just a sneak peek of what Wombat can do. For the complete documentation, please check the links below:
Wiki
API Documentation
Changelog
Contributing to Wombat
- Check out the latest master to make sure the feature hasn't been implemented or the bug hasn't been fixed yet
- Check out the issue tracker to make sure someone already hasn't requested it and/or contributed it
- Fork the project
- Start a feature/bugfix branch
- Commit and push until you are happy with your contribution
- Make sure to add tests for it. This is important so I don't break it in a future version unintentionally.
- Please try not to mess with the Rakefile, version, or history. If you want to have your own version, or is otherwise necessary, that is fine, but please isolate to its own commit so I can cherry-pick around it.
Contributors
- Felipe Lima (@felipecsl)
- List of all contributors
Copyright
Copyright (c) 2019 Felipe Lima. See LICENSE.txt for further details.
License
*Note that all licence references and agreements mentioned in the Wombat README section above
are relevant to that project's source code only.