Merge pull request #21 from thoop/patch-1

Added googlebot, bingbot, yandex to list of user agents being checked

Merge pull request #20 from StyleT/feature/gzip-fix

Work with gzip requests fixed

Merge pull request #19 from thoop/master

changing deprecated herokuapp address to correct service.prerender.io

Tag v3.0.0

Add support for token

Update version

Merge pull request #8 from zf-fr/xml

Add xml to ignored extension

Merge pull request #5 from zf-fr/twitter-bot

Add Twitterbot

Merge pull request #1 from thoop/patch-1

Adding facebook crawler user agent and more extensions to ignore

Assert that referer take into account blacklist