User-agent: * Disallow: /ad_loader/ Disallow: /ddtabmenufiles/ Disallow: /downloaded files from archeived seoseo/ Disallow: /fonts/ Disallow: /cp/ Disallow: /images/ Disallow: /media/ Disallow: /rating_system/ Disallow: /Templates/ Disallow: /dynamicdrive/ Disallow: /source/ Disallow: /sphider-1.3.4/ # This will prevent robots from entering the dev, homepage and test areas