Data Collection, Mining and Processing At Scale

One of the clear trends in technology is the collection and use of big data. Information is being created, collected and processed at unprecedented rates. I wanted to highlight a few things I have recently read on the topic.
The fastest growing entity today is information. Information is expanding ten times faster than the growth of any other manufactured or natural product on this planet [66%+ per year for many decades]. We see the expansion of information everywhere. Less visible, harder to track, but exploding the same is the expansion of knowledge. The number of scientific articles published each year has been increasing in a steady rise for more than 50 years. Over the last 150 years the number of patent applications has increased. By this rough metric, knowledge is growing exponentially…

…Yet the paradox of science is that every answer breeds at least two new questions. More answers, more questions. Thus even though our knowledge is expanding exponentially, our questions are expanding exponentially faster. And as mathematicians will tell you, the widening gap between two exponential curves is itself an exponential curve.

-Kevin Kelly, The Expansion of Ignorance

10 Posts From This Blog Discussing Data Mining & Information Filtering:

Reblog this post [with Zemanta]

You might also enjoy:

Thanks for stopping by!

If you’d like to receive occasional updates and new writings from me sign-up below and never miss an update.