Internet searching and the INABILITY to find information is a topic we've discussed before... and the typical reasoning goes, so therefore if I can't find it, it MUST NOT BE AVAILABLE!
We're hearing this sentiment so often in recent weeks, it seemed appropriate to revisit the issue again. But let's start by saying right up front... 10% or less, of the "universe of information" is on the Internet.
There are several aspects swirling around this issue as to why information can't be located, some aspects are user-based and others are web-based constraints.
FIRST... not everything, in fact MOST things just AREN'T to be found on the Internet. Yes, you heard us right... its just not there. Well how come, you were under the impression that the Web is this giant repository of information that has sucked up all the data in the world and placed it at your fingertips! WELL, SORRY... NOT TRUE!
In fact by our estimates, only a small fraction of the "universe" of information is in fact, on the Web... as stated, probably less than 10% Why is that?
In the big scheme of things, most information just doesn't makes it's way to the 'Net, OR the originators have deemed it unimportant to place it there... OR more likely, the information has a certain "intrinsic value" and the author isn't going to give it away for free.
Increasingly, holders of information are realizing that their data has a "dollar value" and so why should they give it away, when it can be charged for.
So, large information aggregators go to independent sources, magazines, information holders or creators of raw information and purchase their data. But in turn, the aggregator has to reap a return themselves.
Nexis-Lexis is a good example. They have a significant amount of information available, but its not FREE. In fact, its not even being found by traditional web crawlers that scower the Internet for that information. Why is that you say... again, Nexis-Lexis, being a private, fee-based information aggregator isn't going to let the Internet crawlers into their system.
