# robots.txt file for http://sourceforge.net and https://sourceforge.net # please contact staff@sourceforge.net with questions or concerns User-agent: Mediapartners-Google* Disallow: User-agent: Googlebot Disallow: Crawl-delay: 1 User-agent: Slurp Disallow: Crawl-delay: 1 User-agent: * Disallow: /forum Disallow: /pm Disallow: /search Disallow: /softwaremap Disallow: /top Disallow: /tracker Disallow: /users Crawl-delay: 10 User-agent: msnbot Disallow: /forum Disallow: /pm Disallow: /search Disallow: /softwaremap Disallow: /top Disallow: /tracker Disallow: /users Crawl-delay: 2 User-agent: Teoma Disallow: /forum Disallow: /pm Disallow: /search Disallow: /softwaremap Disallow: /top Disallow: /tracker Disallow: /users Crawl-delay: 2