Definition

Big Data is defined as extremely large data sets that may be analyzed computationally to reveal patterns, trends, and associations, especially relating to human behavior and interactions.

Key Dates and Intersting Facts

• 1937 - IBM is contracted to create machine to keep track of data for the Social Security Act of 1937
• 1952 - NSA has over 12,000 cryptologist gathering data during the Cold War
• 1965 - United States Goverment begins to creates first data center of tax returns and fingerprints
• 1989 - Tim Berners-Lee invents what will eventually be the World Wide Web
• 1995 - The first super-computer is built, which could compute what 30000 years of manual calculator computations in a second
• 2002 -Digital data storage surpasses non-digital storage for the first time, with 94% of information storage capacity being digital.
• 2005 - Roger Mougalas coins the term "Big Data"
• 2005 Continued - Hadoop is created, data management and analytics platform for storing, managing and processing data
• 2010 - Famous quote by Eric Schmidt there were 5 exabytes of information created by the entire world between the dawn of civilization and 2003. Now that same amount is created every two days."
• 2015Large-scale data breaches – which have increased in size and frequency exponentially over the last decade – show no signs of abating
• 2016Huge increase in data volume emerged as represented by the surge in Data Cloud Services such as Amazon Web Services, Rackspace and Azure, among other providers.

Internet of Things

In the simpliest way, the Internet of Things is everything connected and "talking" to each other. Each of our devices that we have all have their own unique signature or address. With this they gather information and then send it out into the world.

The reason why this is critical is that this means we are receiving and producing an unimaginable amount of data and information. From your toaster to your smart fridge, data is being gathered and sent off into the world.

This is relatabble to DTC because it is a driving point for many new technologies being released. From video games to new ways of interacting with the digital world(VR/AR), IoT is connected.

Emerging Technology

• Data Lakes is a huge data repositories that collect data from different sources and is stored in its natural state.
• Apache Spark is an engine for processing large amounts of data within Hadoop and is 100x faster compared to MapReduce, Hadoop’s standard engine. The interest in this technology is gaining more popularity and continuously growing.
• Artificial Intelligence Big Data has played a role in the advancement of AI through its two subset of disciplines; machine learning and deep learning.