Printer Friendly Version
Email this thread to a friend
|
Featured Web Site Template |
|
Reflects user activity within the last 5 minutes
|
|
| Member |
Message |
moverworldwide
Joined: Mar 01, 2006
# Posts: 35
|
Posted: 2006-Aug-21 14:08
I was told SE see non www version of urls as duplicate. I am using a windows hosting and have no access to create an .htaccess file on server.
I was thinking of creating a robots.txt file with all urls in it without www like
http: // mydomain.com
http: // mydomain/subdirectory.htm
http: // mydomain/subdirectory1/city.htm
Anyone has experience with this? will it stop SE from indexing those links without www and thus my duplication problem could be solved??
[ Message was edited by: bhartzer 08/21/2006 01:18 pm ]
|
 |
dudibob
Joined: Oct 13, 2005
# Posts: 1472
|
Posted: 2006-Aug-21 14:49
I think that may solve it, but you can defo do it on a windows server, I don't have a clue how but it's possible 
|
|
g1smd
Staff
Joined: Jul 28, 2002
# Posts: 10465
|
Posted: 2006-Aug-21 20:18
The URLs in robots.txt always start with a / and are always assumed to be for the currently accessed domain.
You cannot specify the domain name in the robots file itself.
You will serve two identical robots files, one at domain.com/robots.txt and the other at www.domain.com/robots.txt.
Both will allow and deny exactly the same files on the two alternatve domains.
The robots file cannot help you at all here.
The 301 redirect is the only way to fix this. You need ISAPI_rewrite to be installed.
|
|
You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
- You have not yet logged in, or registered properly as a member
- You are a member, but no longer have posting rights.
- This is a private forum, for which you do not have permissions.
If you are a recent member, it's possible that you simply have not yet confirmed your account. Please
check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions
contained within.
If you cannot find this message, click here to Re-Send it.
|
If you are still experiencing problem, please read the
Login Assistance
Article for some advice on what may be causing your login not to work properly.
|
Switch to Advanced Editor and ...
Create a New Topic
or Reply to this Thread
|
|
Inbox
