Printer Friendly Version
Email this thread to a friend
|
all the results in 1 page (In: SEO Tools and Software Utilities)
Featured Web Site Template |
|
Reflects user activity within the last 5 minutes
|
|
| Member |
Message |
Mike-Levin.com
Joined: Sep 27, 2000
# Posts: 1988
|
Posted: 2004-Feb-17 18:18
Hello all. I will try to post something every day, that is at least of some interest. I watch what spiders request my robots.txt file. There are not really that many spiders that request it very often. But even the most well behaved spiders end up asking for it at least once per visit. So, it turns out that these requests for the robots.txt file is a way to find Search Engines that serve their own unique results. This can take you to some very interesting places. Each of these search engines serves up its own results, wholly different from the "main" sources (Google, Inktomi, AltaVista, AllTheWeb, Teoma). They might be non-USA engines, but they are still worth seeing if and where you appear in the results.
http://www.baidu.com
http://www.openfind.com.tw
http://www.walhello.com
http://www.voila.com
|
 |
MakeMeTop
Joined: Jul 05, 2000
# Posts: 1714
|
Posted: 2004-Feb-18 10:42
Add on http://www.gigablast.com and http://www.mirago.co.uk
|
|
Webmaster-Toolkit.com
Joined: Jul 18, 2002
# Posts: 1098
|
Posted: 2004-Feb-18 12:33
One new one I've found recently is http://www.geona.com - they've taken DMOZ as their starting blocks (like most) and I find their results pretty good at the moment (not great for some searches though)
|
|
greenleaves
Joined: Mar 21, 2002
# Posts: 720
|
Posted: 2004-Mar-11 17:29
Walhello.com has a "unique database", right  . If they really do have a database of their own, than why do they anounce having the rediculous # of 500 billon web sites in their database. This just discredits them as a serious alternative for webmasters and serchers.
I say this because I was thinking on advertising with them, but I have a policy of never advertising with someone who makes a fool of themselfs by claiming rediculous statements  .
|
|
Mike-Levin.com
Joined: Sep 27, 2000
# Posts: 1988
|
Posted: 2004-Mar-11 19:21
They're claiming pages, not sites. Also, when you put the commas in, it's only 500 million (500,010,000), which is reasonable. I included them on my list, because I see their spider, appie, come around quite often -- in fact, it stopped by only 2 hours ago. That's usually an indication that they're compiling their own data, and the search results there do appear to be unique (although I don't seem to be able to perform searches there at the moment).
|
|
greenleaves
Joined: Mar 21, 2002
# Posts: 720
|
Posted: 2004-Mar-11 20:11
Mike, you are right, exuce me for jumping to a conclution.
Although I still feel their numbers are a little bit exagerated, they may be more to them than strikes the eye. I have been looking into advertising with several non-mainstream engines and have found so much crap that it doesn't take much for my to classify something as junk (you don't have the embaraced smilies anymore, just when they could be real handy).
|
|
Mike-Levin.com
Joined: Sep 27, 2000
# Posts: 1988
|
Posted: 2004-Mar-12 22:16
I don't know how good they would be for advertising, or even whether their own unique database will make them a better site in the long run. My interest is similar to the way Gigablast used to promote itself: search the Web from a different angle. I like searching the Web from angles, to see the similarities and differences from engine to engine.
|
|
nathan enns
Joined: Mar 13, 2004
# Posts: 34
|
Posted: 2004-Mar-13 09:45
If you want you can add FyberSearch to the list. It has a completely unique database. http://www.fybersearch.com
|
|
Mike-Levin.com
Joined: Sep 27, 2000
# Posts: 1988
|
Posted: 2004-Mar-13 15:58
Nathan, how does FyberSpider discover sites?
|
|
nathan enns
Joined: Mar 13, 2004
# Posts: 34
|
Posted: 2004-Mar-13 19:08
It is a robot similer to other search engines, it follows links from one site to another. I obviously dont have the same computer power yet so it cant crawl nearly as fast.
It also cataloges any website that is added manually instantly and many sites are cataloged that way.
|
|
You are not permitted to post messages in this forum or topic, because of one or more of the following reasons:
- You have not yet logged in, or registered properly as a member
- You are a member, but no longer have posting rights.
- This is a private forum, for which you do not have permissions.
If you are a recent member, it's possible that you simply have not yet confirmed your account. Please
check your email for a message entitled 'JimWorld Forums: Confirm Your Account' and follow the instructions
contained within.
If you cannot find this message, click here to Re-Send it.
|
If you are still experiencing problem, please read the
Login Assistance
Article for some advice on what may be causing your login not to work properly.
|
Switch to Advanced Editor and ...
Create a New Topic
or Reply to this Thread
|
|
Inbox
