Aim

I am a Node on the Edge because I cannot claim to have all the answers or a decade long history of experience but I can help to define questions to be solved. Hopefully their is a potential finite set of questions that allow most requirements be solved and my aim is define these with collaboration of the community.
It would be amazing if these questions developed into some kind of NP Complete space where they all referred to one question such in NP Complete Theory or Monty Pythons Holy Grail but that is/maybe asking too much?

Sunday, 10 January 2016

Node finding the Edge of History: Long History of Big Data

Long History of Big Data 

Big Data is a buzzword to define the Explosion of Data available from Start to now

Here is what catalysized it, proceed it, progress its made and the main events.  

Catalyst

More  sensors  More  data stored  More analysis  More access


1 Information Overload

The explosion of information available

Defined in Future Shock by Alvin Toffler in 1970 
This is both information and data without any explanation of its larger context. The larger context is where the most meaning is. Without processing the information and data this meaning cannot be seen Problem: Not seeing this meaning because of too much information or information overload is a Catalyst.
Solution: It is a Catalyst to finding how to process it to summarise the meaning so can understand more information quicker.      
Causes:
  • A rapid increase in the production rate of new information
  • The ease of duplication and transmission of data across the Internet
  • An increase in the available channels of incoming information (e.g. telephone, e-mail, instant messaging, rss)
  • Large amounts of historical information
  • Contradictions and inaccuracies in available information
  • A low signal-to-noise ratio (informally, the ratio of useful information to false or irrelevant data)
  • lack of a method for comparing and processing different kinds of information

Key Timelines:

1 The information overload from US Census in 1880 took 8 year to complete 
   A key realisation for governments of the task of population management.   

2 The information overload 


References

1 http://www.newworldencyclopedia.org/entry/Information_explosion

No comments:

Post a Comment