Big Data: moving from an ocean to stream culture will hurt analytics


Share on LinkedIn

So the fabled Mary Meeker powerpoint tome hit the internet at the D11 conference this week and if you have the patience to wade through the stats the messages are pretty clear: it’s a wearable, shareable future for mankind.

But there’s a shift in how people are willing to share now.

Share it. Delete it.

500m photos are shared on average every day. Of those, 150m are shared via Snapchat, a very nifty little semi-social network app that deletes the photo from the server after it’s been viewed by the recipient. Users can dial in just how long that photo is available for after viewing but once it’s gone it’s gone for good.

Snapchat’s success has accelerated to begin to overshadow Instagram as a platform for sharing and I predict that its selling point will become more prevalent across other networks and new tools in the coming years. And this is a definite trend which will continue for the next few years to come. As Gen X makes way for Gen Y, the latter doesn’t want their digital footprint to linger for months and years for organizations to benefit from and services like Snapchat offer a way out of the ocean mentality that Gen X has built its empire on. Gen Y is a stream culture as Toby Beresford, a social strategist and founder of Leaderboarded succinctly put it.

Big Data or Disappearing Data ?

So where does this leave the Big Data promise ?

The premise of Big Data analytics is built on having use of massive amounts of data that is constantly being generated and available for weeks, months, years. Big Data was built for the ocean culture of Gen X. But if the mechanism behind Snapchat take off and proliferate across other networks, organizations may find themselves in a difficult position; they’ll have no ocean from which to trawl data, it’ll have slowed to a trickle. Which means they have to react faster and in real-time to data that could potentially appear and disappear within seconds. And with privacy being an on-going concern for users, having access to that data and being able to store it outside of those parameters could very well breach regulations.

This is obviously a small use case example and there are many others where the ocean mentality fits the model perfectly. But with people already crying that Big Data has hit the infamous Trough of Disillusionment the industry needs to re-examine what it means to harness data, analyse it and act on it.

Because in some cases now, you no longer have months to play Data Scientist, you have seconds.

Republished with author's permission from original post.

Theo Priestley
Theo Priestley is Vice President and Chief Evangelist at Software AG, responsible for enabling the marketing and voice of the industry's leading Business Process, Big Data/ In-Memory/ Complex Event Processing, Integration and Transaction suite of platforms. Theo writes for several technology and business related sites including his own successful blog IT Redux. When he isn't evangelizing he's playing videogames, collecting comics and takes the odd photo now and then. Theo was previously an independent industry analyst and successful enterprise transformation consultant.


Please use comments to add value to the discussion. Maximum one link to an educational blog post or article. We will NOT PUBLISH brief comments like "good post," comments that mainly promote links, or comments with links to companies, products, or services.

Please enter your comment!
Please enter your name here