Sitemap: https://www.prent.com/sitemap.aspx User-agent: * Disallow: /activity-feed/* # Do not index user profiles Disallow: /admin/ Disallow: /login User-agent: msnbot Disallow: /activity-feed/* # Do not index user profiles Disallow: /admin/ Disallow: /login User-agent: Slurp Disallow: /activity-feed/* # Do not index user profiles Disallow: /admin/ Disallow: /login User-agent: Googlebot Disallow: /activity-feed/* # Do not index user profiles Disallow: /admin/ Disallow: /login User-agent: Bingbot Disallow: /activity-feed/* # Do not index user profiles Disallow: /admin/ Disallow: /login User-agent: Baiduspider Disallow: /activity-feed/* # Do not index user profiles Disallow: /admin/ Disallow: /login User-agent: Yandex Disallow: /activity-feed/* # Do not index user profiles Disallow: /admin/ Disallow: /login