I am having difficulty with Search engine crawlers which are currently retrieving results which display not only legitimate pages, but also directories such as this:
I am seeing this as an index of pages and files. this is not what i want but i have tried using robots.txt and i have been told that i can use my htaccess file will do the correct job.
can anyone please show me how to do this / post links for assistance
any and all help would be very much appreciated