Sep 23, 2015

IoT and Big Data

IoT (Internet of Things) in catching fire recently. There are excitement in Silicon Valley about this topic. Talks and meetups are springing everywhere on IoT. When you visit startup scenes (incubabors, and entrepreneur events), you will meet entrepreneurs who make their next bet on this riding trend.

What is IoT? First, look around the appliances in a household: TVs, stoves, refrigerators,and thermostats can all be connected. When they are Internet connected, they gather information and form a complete view of your need at home. They can then help you to experience home more pleasantly (Think of Nest)

Outside homes,  IoT can be installed everywhere. In a store, sensors on the shelves can monitor customer traffic and inventory in real time. Surveillance cameras on the streets and in public places are captured crime in action. Uber’s taxies send out data on their locations and their passengers. 
Tesla’s cars report their working status.With the coming of connected cars, we are just at the dawn of huge data connection and processing. IoT will be very useful for hospitals where patient monitoring is required. In agriculture fields, sensors help to monitor crops, light and humidity. 

One of the most practical use of IoT is building sensors. Sensors on lightening fixtures control the light on and off by monitoring people. From such sensors, they can also discover building occupancy and provide a report of building utilization. Furthermore, they can provide meeting room occupancy report and dynamically re-allocate meeting rooms when no one shows up. This could be very useful for large companies when meetings rooms are in high demand. 

The most exciting application of IoT would be location tracking of each person’s smart Phone (or watch). Imagine you walk into Starbucks, and your favorite drink will be ready right there waiting for you. This depends on data analysis of your daily consumption, your location (as you walk in), and predictive modeling.

The data generated from IoT devices are much larger than the Internet traffic data. In addition, data need to be processed in real time in order to get response immediately. We are at dawn of big data revolution. From cloud-based data processing, to intelligent algorithms that drive the response from devices, we will see continuing need for data scientists and data engineers. We are living in an exciting age, where data mining plays an central role in the next industrial revolution. 

How would IoT impact the field of data mining? We will see significant