Changes between Version 2 and Version 3 of RobotsTxt


Ignore:
Timestamp:
2015-10-26T20:33:59+01:00 (9 years ago)
Author:
Morris Swertz
Comment:

--

Legend:

Unmodified
Added
Removed
Modified

  • RobotsTxt

    v2 v3  
    88Disallow: /timeline
    99Disallow: /svn
     10
     11User-Agent: MJ12bot
     12Crawl-Delay:  20