# rover is a bad dog User-agent: rover Disallow: / #The block of code addressed to all spiders (User-agent: *) is not the last one. #We advise you to move it at the bottom of the robots.txt file, to reduce interpretation problems with some old robots. # Disallow for all User-agent: * Disallow: /include/ Disallow: /control/ Disallow: /phpThumb/ Disallow: /pagination/ Disallow: /xajax/ Disallow: /tablemgr/ Disallow: /control/includes/