Robots.txt for WordPress

Best practices for configuring robots.txt on a WordPress website.

Standard WordPress Configuration

WordPress generates a virtual robots.txt by default. However, if you create a physical file, use these base rules:

User-agent: *
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php