User-agent: * Disallow: /set/ Disallow: /page/ Disallow: /home/ Disallow: /feeds/ Disallow: /rss/ Disallow: /api/ Disallow: /backend/ Disallow: /dashboard/ Disallow: /internal/ Disallow: /login/ Disallow: /auth/ Disallow: /wp-login/ Disallow: /wp-admin/ Disallow: /admin/