Needle in the Hay Stack

Posts tagged ‘cloud computing’

New kid in the block

The undisputed hottest topic in IT in the recent past has been cloud computing. Then, big data stepped in and arguably stole the show last year. If you thought smartphones and tablets were the ones to look out for in 2013, it might be a wrong statement, as there’s likely to be a new kid on the block: The Internet of Things (IoT). Also known as machine-to-machine (M2M), The Internet of Things is all about sensors that can connect lots of formerly-mundane objects to the Internet and automatically send their data to IT systems for analysis.

“The Internet of Things is the network of physical objects that contain embedded technology to communicate and sense or interact with their internal states or the external environment.” – Gartner

The Internet of Things is a fast growing market where IPv6 will play a central role.  IPv6 will ensure that every known object in this world will have one unique IP. The objects can be everything from health care monitors to traffic lights to thermostats to trains.

The Internet of Things would encode 50 to 100 trillion objects, and be able to follow the movement of those objects. The huge amount of data generated by these devices makes one more technology inevitable: “Big Data”.  Big data will make it possible to effectively use the data generated by the trillions of objects. Big Data in turn requires two more ingredients :“Compute” and “Storage Space,” which is where Cloud computing makes its special appearance. Cloud will play the pivotal role in making the compute and storage required for all this things to work. In a world where the hardware and operating system have become commoditized, the apps are the differentiator and more and more, the apps are a viewport into a cloud service driven by machine learning.

Although it is going to take some time before all of these things materialize and mature,  one thing for sure is it’s already making us feel as if we are living in a science fiction movie… imagine your toaster, car or house talking back to you.

Needle in the Haystack

Big data is all about analyzing millions of data and making meaningful sense out of it. You can compare it to “finding the needles in the haystack”. The trick here is that the hay stack is ever growing (Volume), in fast phase (Velocity). Wikipedia defines “Hay is grass, legumes or other herbaceous plants that have been cut, dried, and stored” (Variety). The needles are useful tool (predictions) that are hidden inside.

While working with our clients in various projects we do witness lot of data being generated and probably stored but never used. Customer interactions, customer requests (ticketing systems), auto-generated system data, logs, etc., these data are mostly captured and archived let to decay and then discarded. Its time we identify the importance of this data.

The sudden interest in Big Data is resultant of the behavioral changes that we have seen in the recent past. Internet which had been a mere static source of information now has become a media for immense information exchange due to increased activity in social network and availability of mobile internet. This is the transformation of internet from an ugly cocoon to a beautiful butterfly… “It’s mobile now”. It’s also important to note how extreme compute and storage which was once at the reach of large enterprises or research establishment is now available to end users, thanks to Cloud computing.

Keep an eye in this space for more about Big Data.