#robots text file to control the access to #files and directories which need not be indexed # # #Specify all spiders # User-agent:* # # # Disallow:/images Disallow:/admin Disallow:/resources Allow:/pics Allow:/techs # END OF FILE