Needle in the Hay Stack

Needle in the Haystack

Big data is all about analyzing millions of data and making meaningful sense out of it. You can compare it to “finding the needles in the haystack”. The trick here is that the hay stack is ever growing (Volume), in fast phase (Velocity). Wikipedia defines “Hay is grass, legumes or other herbaceous plants that have been cut, dried, and stored” (Variety). The needles are useful tool (predictions) that are hidden inside.

While working with our clients in various projects we do witness lot of data being generated and probably stored but never used. Customer interactions, customer requests (ticketing systems), auto-generated system data, logs, etc., these data are mostly captured and archived let to decay and then discarded. Its time we identify the importance of this data.

The sudden interest in Big Data is resultant of the behavioral changes that we have seen in the recent past. Internet which had been a mere static source of information now has become a media for immense information exchange due to increased activity in social network and availability of mobile internet. This is the transformation of internet from an ugly cocoon to a beautiful butterfly… “It’s mobile now”. It’s also important to note how extreme compute and storage which was once at the reach of large enterprises or research establishment is now available to end users, thanks to Cloud computing.

Keep an eye in this space for more about Big Data.


Leave a Reply

Fill in your details below or click an icon to log in: Logo

You are commenting using your account. Log Out /  Change )

Google+ photo

You are commenting using your Google+ account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )


Connecting to %s

%d bloggers like this: