The annual pilgrimage to the ESOMAR Conference took place last week in Dublin. I heard that there was much discussion, both on and off the stage, about Big Data and the future of market research. Hopefully, the whole profession will get behind one initiative, instead of each individually trying to “solve world peace” on their own!
This week sees the second Swiss BI-Day taking place in Geneva and there will no doubt be similar discussions about Big Data and the future of Business Intelligence.
It appears that Big Data is not just a buzzword or a commodity that has been likened to oil; it has become the centre of a power struggle between different industries. Many professionals seem to be vying for the right to call themselves “THE Big Data experts”.
This got me thinking about the future of data analysis in general and the business usage of Big Data more specifically. There seems to be no stopping the inflow of information into organisations these days, whether gathered through market research, which is proportionally becoming smaller by the day, or from the smartphones, wearables and RFID chips, that get added to every conceivable article, more generally referred to as the IoT (Internet of Things). Who will, and how are we to better manage it all? That is the question that needs answering – soon! (>>Tweet this<<)
Data Science Central published an interesting article earlier this year called “The Awesome Ways Big Data Is Used Today To Change Our World”. Already being a few months old probably makes it a little out-of-date, in this fast changing world we live in, but I think it still makes fascinating reading. It summarises ten ways that data is being used:
- Underst anding and Targeting Customers
- Underst anding and Optimizing Business Processes
- Personal Quantification and Performance Optimization
- Improving Healthcare and Public Health
- Improving Sports Performance
- Improving Science and Research
- Optimizing Machine and Device Performance
- Improving Security and Law Enforcement
- Improving and Optimizing Cities and Countries
- Financial Trading
Many of these are not new in terms of data usage nor business analysis. What is new, is that the data analysis is mostly becoming automated and in real-time. In addition, the first and second items, which were largely the domains of market research and business intelligence, are now moving more into the h ands of IT and the data scientists. Is this a good or bad thing?
Another article posted on Data Informed a few months after the above one, talks about “The 5 Scariest Ways Big Data is Used Today “ and succinctly summarises some of the dynamic uses of data today. The author of both pieces, Bernard Marr, wrote that “This isn’t all the stuff of science fiction or futurism. Because the technology for big data is advancing so rapidly, rules, regulations, and best practices can’t keep up.” He gives five examples of where data analysis raises certain ethical questions:
- Predictive policing. In February 2014, the Chicago Police Department
