Popularity
1.4
Growing
Activity
0.0
Stable
67
3
10

Description

The Hawker gem is a web scraper which allows you to pull the basic information for given social media profile URL. No structure knowledge or API access required

Monthly Downloads: 35
Programming language: Ruby
License: MIT License

The Hawker Ruby gem alternatives and similar gems

Based on the "Web Crawling" category

Do you think we are missing an alternative of The Hawker Ruby gem or a related project?

Add another 'Web Crawling' Gem

README

The Hawker Ruby gem

The Hawker gem is a web scraper which allows you to pull the basic information for given social media profile URL. No structure knowledge or API access required. Keep in mind that it's always better to use the API if possible.

Installation

gem install hawker

What social media providers are supported?

Currently, the gem supports Github, Twitter and Instagram. If you need the support for another social media provider, please feel free to open new issue or push your own code and prepare pull request.

Usage examples

The gem has built in matching mechanism so you can pass any link and it will automatically use the proper driver.

GitHub

You can request the profile information using this code:

profile = Hawker.get("https://github.com/rubyhero")
profile.username # => "rubyhero"

Following attributes are available:

  • name - The name of the requested user
  • username - The username of the requested user - it's also visible in the URL
  • company - The company name of the requested user if available
  • location - The location of the requested user if available
  • website - The website URL of the requested user
  • repositories - The count of the requested user repositories
  • stars - The number of stars that the requested user gave
  • followers - The number of people that are following the requested user
  • following - The number of people followed by the requested user

Twitter

You can request the profile information using this code:

profile = Hawker.get("https://twitter.com/pdabrowski_k1")
profile.name # => "Paweł Dąbrowski"

Following attributes are available:

  • name - The name of the requested user
  • bio - The biography note of the requested user
  • location - The location of the requested user if available
  • website - The website URL of the requested user
  • joined - The account creation date for the requested user
  • tweets - The number of messages tweeted by the requested user
  • followers - The number of people that are following the requested user
  • following - The number of people followed by the requested user
  • likes - The number of likes that the requested user gave
  • lists - The number of lists created by the requested user

Instagram

You can request the profile information using this code:

profile = Hawker.get("https://www.instagram.com/someprofile")
profile.full_name # => "Full name"

Following attributes are available:

  • biography - The biography note of the requested user
  • followers - The number of people that are following the requested user
  • following - The number of people followed by the requested user
  • full_name - The full name of the requested user
  • external_url - The URL from the biography note of the requested user
  • profile_pic_url - The URL of the requested profile picture
  • username - The username of the requested user

Supported Ruby Versions

This gem was tested on the 2.5.0 version. If it's not working with older versions please add a new issue.

Copyright (c) 2018 Paweł Dąbrowski. See [LICENSE][] for details.


*Note that all licence references and agreements mentioned in the The Hawker Ruby gem README section above are relevant to that project's source code only.