🕷 Tanakai changelog

Changelog History

• v1.5.1 Changes

  🆕 New

  • Add response_type to in_parallel

• v1.5.0 Changes

  🆕 New

  • 🚀 First release as Tanakai
  • ➕ Add support to Apparition
  • ➕ Add support to Cuprite

• v1.4.0 Changes

  🆕 New

  • ➕ Add encoding config option (see All available config options)
  • Validate url before processing a request (Base#request_to)

  🛠 Fixes

  • 🛠 Fix console command bug (see issue 21)

• v1.3.2 Changes

  🛠 Fixes

  • 💎 In the project template, set Ruby version as >= 2.5 (before was hard-coded to 2.5.1)
  • ✂ Remove .ruby-version file (was hard-coded to 2.5.1) from the project template

• v1.3.1 Changes

  🛠 Fixes

  • 🛠 Fixed bug in Base#save_to

• v1.3.0 Changes

  💥 Breaking changes 1.3.0

  • ✂ Remove persistence database feature (because it's slow and makes things complicated)

  🆕 New

  • ➕ Add --include and --exclude options to CLI#runner
  • ➕ Add Base #create_browser method to easily create additional browser instances
  • Add Capybara::Session #scroll_to_bottom
  • Add skip_on_failure feature to retry_request_errors config option
  • ➕ Add info about add_event method to the README

  🛠 Fixes and improvements

  • 👌 Improve Runner
  • 🛠 Fix time helper in schedule.rb
  • ➕ Add proxy validation to browser builders
  • 👍 Allow to pass different arguments to the Base.parse method

• v1.2.0 Changes

  🆕 New

  • ➕ Add possibility to add array of values to the storage (Base::Storage#add)
  • Add exception_on_fail option to Base.crawl!
  • Add possibility to pass request hash to the start_urls (You can use array of hashes as well, like: @start_urls = [{ url: "https://example.com/cat?id=1", data: { category: "First Category" } }])
  • Implement skip_request_errors config feature. Added Handle request errors chapter to the README.
  • ➕ Add option to choose response type for Session#current_response (:html default, or :json)
  • ➕ Add option to provide custom chrome and chromedriver paths

  👌 Improvements

  • 🔨 Refactor Runner

  🛠 Fixes

  • 🛠 Fix Base#Saver (automatically create file if it doesn't exists in case of persistence database)
  • 🔀 Do not deep merge config's headers: option

• v1.1.0 Changes

  💥 Breaking changes 1.1.0

  💻 browser config option depricated. Now all sub-options inside browser should be placed right into @config hash, without browser parent key. Example:

• v1.0.1 Changes

  • ➕ Add missing logger method to pipeline
  • 🛠 Fix set_proxy in Mechanize and Poltergeist builders