Hi guys,
After a bit of research on this topic, most (If not all) engines index the url and ignore the default index document extension.
I have found quite a few ways round this but when it comes down to it, there is not really any point of doing this anyway. After all, when a url is called, only the first DirectoryIndex (If apache) found in the list is called. This means that nobody would ever see the other documents. In each directory, you can only have one default document, after that is called, the others are not default docs.
However, in a subdirectory, the default documents seem to sometimes be indexed separately from the actual directory.
and
are indexed as separate pages on some.
If you really wanted to have multiple pages with the same content and the spiders to index them all, you could fool the spider.
1) If index.shtml is stripped from any top level url, you could alter the default documents to use mynewdefault.shtml etc. That file is called as a default document but the spider would also index it separately.
2) You could simply have page1.html page2.html rather than index.html and index.htm.
Hope this helps
Hope this helps Wullie
The pessimist complains about the wind. The optimist expects it to change.
The leader adjusts the sails. - John Maxwell