Here is a sample of a the Robots.txt for WordPress that you may see on numerous sites..
# 1. A robot may not injure a web server or, through inaction, allow a web
# server to come to harm.
# 2. A robot must obey orders given it by web servers except where such
# orders would conflict with the First Law.
# 3. A robot must protect its own existence as long as such protection does
# not conflict with the First or Second Law.
#
User-agent: *
Disallow:
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-login.php
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /comments
Please keep in mind that identifying the location of the actual /wp-admin page will make it a candidate during the Global WordPress Attack.
Stephan Pringle
Latest posts by Stephan Pringle (see all)
- ADFS/CAS Time out - Thursday, September 19, 2024