_
_ _ 07.04.2009
 
_ Navigation: _
Main Page Technology Downloads Security Entertainment Videos
Search Site: Advanced
_
 
Login Login
 
Register Register
   
_ News Item

Keep Web Pages From Search Engine Bots

Oct 17 2008 04:49:37
Source: Wired News: Technology
vote bad  vote good
0
Forget asking search engines to take down the site for you. There's an easier way.



Robots.txt is a file you can store on the root level of your web server to protect your personal files from showing up on search results.

It allows you control over where bots are allowed to crawl your site.  .

» full story @ source-link: Wired News: Technology
Related Articles:
» INSIDE WASHINGTON: Archives' many missing items
» Ruling favors Antiguan receiver in Stanford case
» HK lawmakers discuss Disney expansion plan
» GM Europe: Talks on selling Opel near completion
_ Comments
Add Comment
You must be registered and logged in to add comments!

Register
Login
_ Sponsors

_ Sponsors