$ java ... SimpleRobotRulesParser http://www.robotstxt.org/robots.txt '*' http://www.robotstxt.org/norobots-rfc.txt
Checking URLs:
allowed         http://www.robotstxt.org/norobots-rfc.txt

SimpleRobotRulesParser <robots.txt> [[<agentname>] <URL>...]

Parse a robots.txt file
  <robots.txt>  URL pointing to robots.txt file.
                To read a local file use a file:// URL
                (parsed as http://example.com/robots.txt)
  <agentname>   user agent name to check for exclusion rules.
                If not defined check with '*'
  <URL>         check URL whether allowed or forbidden.
                If no URL is given show robots.txt rules