INTELLIGENT WORK FORUMS
FOR COMPUTER PROFESSIONALS

Log In

Come Join Us!

Are you a
Computer / IT professional?
Join Tek-Tips Forums!
  • Talk With Other Members
  • Be Notified Of Responses
    To Your Posts
  • Keyword Search
  • One-Click Access To Your
    Favorite Forums
  • Automated Signatures
    On Your Posts
  • Best Of All, It's Free!

*Tek-Tips's functionality depends on members receiving e-mail. By joining you are opting in to receive e-mail.

Posting Guidelines

Promoting, selling, recruiting, coursework and thesis posting is forbidden.

Jobs

Robots

Other tricks to throw off the bots by tanderso
Posted: 11 Dec 00

You can do some other things to throw off the robots.

  • The first would be to encapsulate your page in a frameset.  Many robots do not follow links in a frameset.  
  • You could also do a meta-refresh or javascript refresh from a doorway page to your real content, which causes many robots to be unable to find your page.  
  • Another thing you could do is start with a blank page with just a layer and some javascript code which inserts your content into the layer.  Robots cannot index the results of client-side scripting.
  • Or you could implement a CGI script which detects the browser and compares it to a custom list of robots or robot-like heuristics and return a special robots page if there is a match or the user page if not.

Back to HTML, XHTML & CSS FAQ Index
Back to HTML, XHTML & CSS Forum

My Archive

Resources

Close Box

Join Tek-Tips® Today!

Join your peers on the Internet's largest technical computer professional community.
It's easy to join and it's free.

Here's Why Members Love Tek-Tips Forums:

Register now while it's still free!

Already a member? Close this window and log in.

Join Us             Close