|
More Virtual Promote ...
Gazette
·
Webmaster & SEO Tools
·
Scumware.com
·
Free Website Templates
|
SEF
Search Engine Forums
Helping to make the Web - Since 1998
|
|
|
|
|
|
| |
|
Forum Index ·
Search Engine Forums ·
Building, Hosting & Maintaining Your Website ·
SEO Tools & Software Utilities ·
Spidering URL for ALL page titles and decriptions
|
| |
|
Remove from hotlist
|
|
Printer Friendly Version
Email this thread to a friend
|
|
Moderator(s): Prowler
|
|
|
| Member |
Message |
rjjj111
Joined: Sep 25, 2002
# Posts: 112
|
Posted: 11/28/2007 07:51 am
I need a free tool to spider my main URL and bring back all the page titles and decriptions, for all pages connected to that domain. I want it to spider all of my pages for the website.
Any help?
|
 |
g1smd
Moderator
Joined: Jul 28, 2002
# Posts: 9970
|
Posted: 11/28/2007 03:51 pm
Try Xenu LinkSleuth.
Look in the "sitemap" section of the report that it produces.
|
|
kpress
Joined: Dec 11, 2007
# Posts: 17
|
Posted: 12/13/2007 12:34 pm
Produce a sitemap (there are tons of free sites that offer sitemaps out there). You can also add a search engine tool to your site which will also spider all of your pages (FreeFind or Jrank).
|
|
kpress
Joined: Dec 11, 2007
# Posts: 17
|
Posted: 12/13/2007 12:34 pm
Produce a sitemap (there are tons of free sites that offer sitemaps out there). You can also add a search engine tool to your site which will also spider all of your pages (FreeFind or Jrank).
|
|
michelrobinson
Joined: Dec 13, 2007
# Posts: 7
|
Posted: 12/13/2007 10:01 pm
Sitemap will help to spider all pages of site.
|
|
hipresurface
Joined: Nov 29, 2007
# Posts: 9
|
Posted: 12/17/2007 05:41 pm
Google it Like Generate Sitemap Online.
Create the Sitemap.xml file into your root folder.
Create the account in Google.
Login with Google account.
Go to Webmaster Tools in Google under my account.. Then you can able to upload new sitemap.xml file and able to know all the features of Google.
Thanks
Let me know if you have any clarifications.
|
|
mj1256
Joined: Jun 05, 2006
# Posts: 663
|
Posted: 12/17/2007 07:52 pm
or better yet, put the link to your sitemap in your robots.txt file and google, yahoo and msn will all use the same one and you don't need to submit it anywhere.
|
|
|
| |
|
Forum Index ·
Search Engine Forums ·
Building, Hosting & Maintaining Your Website ·
SEO Tools & Software Utilities ·
Spidering URL for ALL page titles and decriptions
|
Who's Online?
There are 346 guests and 1 members in the forums right now.
Reflects user activity within the last 5 minutes
|
|
|
|
|
You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
- You have not yet logged in, or registered properly as a member
- You are a member, but no longer have posting rights.
- This is a private forum, for which you do not have permissions.
If you are a recent member, it's possible that you simply have not yet confirmed your account. Please
check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions
contained within.
If you cannot find this message, click here to Re-Send it.
|
If you are still experiencing problem, please read the
Login Assistance
Article for some advice on what may be causing your login not to work properly.
|
Switch to Advanced Editor and ...
Create a New Topic
or Reply to this Thread
|
|
|
© 1995 - 2006
·
iWeb, Inc
·
DBA JimWorld Productions
|
