Big Data: Unleashing information

Abstract

At present, it is projected that about 4 zettabytes (or 10**21 bytes) of digital data are being generated per year by everything from underground physics experiments to retail transactions to security cameras to global positioning systems. In the U. S., major research programs are being funded to deal with big data in all five sectors (i.e., services, manufacturing, construction, agriculture and mining) of the economy. Big Data is a term applied to data sets whose size is beyond the ability of available tools to undertake their acquisition, access, analytics and/or application in a reasonable amount of time. Whereas Tien (2003) forewarned about the data rich, information poor (DRIP) problems that have been pervasive since the advent of large-scale data collections or warehouses, the DRIP conundrum has been somewhat mitigated by the Big Data approach which has unleashed information in a manner that can support informed — yet, not necessarily defensible or valid — decisions or choices. Thus, by somewhat overcoming data quality issues with data quantity, data access restrictions with on-demand cloud computing, causative analysis with correlative data analytics, and model-driven with evidence-driven applications, appropriate actions can be undertaken with the obtained information. New acquisition, access, analytics and application technologies are being developed to further Big Data as it is being employed to help resolve the 14 grand challenges (identified by the National Academy of Engineering in 2008), underpin the 10 breakthrough technologies (compiled by the Massachusetts Institute of Technology in 2013) and support the Third Industrial Revolution of mass customization.

Keywords

Big data / data acquisition / data access / data analytics / data application / decision informatics / products / processes / adaptive services / digital manufacturing / mass customization / third industrial revolution

References

[1] Ahlquist J, Saagar K M. Comprehending the complete customer. Analytics Magazine, 2013 36-50.

[2] Allen B, Bresnahan J, Childers L, Foster I, Kandaswamy G, Kettimuthu R, Kordas J, Link M, Martin S, Pickett K, Tuecke S. Software as a service for data scientists. Communications of the ACM, 2012, 55(2): 81-88.

[3] Appel K, Haken W O. Solution of the four color map problem. Scientific American, 1977, 237(4): 108-121.

[4] Barbot S, Lapusta N, Avouac J-P. Under the hood of the earthquake machine: toward predictive modeling of the seismic cycle. Science, 2012, 336: 707-710.

[5] Baru, C., Bhandarkar, M., Nambiar, R., Poess, M. & Rabl, T. (March 2013). Benchmarking big data systems and the bigdata top 100 list. Big Data, 60-64

[6] Bizer C, Boncz P, Bodie ML, Erling O D. The meaningful use of big data: four perspectives — four challenges. SIGMOD Record, 2011, 40(4): 56-60.

[7] Black F, Scholes M. The pricing of options and corporate liabilities. Journal of Political Economy, 1973, 81: 637-654.

[8] Carr N. The Shallows: What the Internet Is Doing to Our Brains, 2010, New York, NY: Norton

[9] Chen H, Chiang RHL, Storey VC. Business intelligence and analytics: from big data to big impact. MIS Quarterly, 2012, 36(4): 1165-1188.

[10] Davenport TH, Harris JG. Competing on Analytics: The New Science of Winning, 2007, Cambridge, MA: Harvard Business School Press

[11] Futardo P. A survey of parallel and distributed data warehouses. International Journal of Data Warehousing and Mining, 2009, 5(2): 57-77.

[12] Hattori H, Nakajima Y, Ishida T. Learning from humans: agent modeling with individual human behaviors. IEEE Transactions on Systems, Man and Cybernetics — Part A, 2011, 41(1): 1-9.

[13] Jacobs A. The pathologies of big data. Communications of the ACM, 2009, 52(8): 36-44.

[14] Lavalle S, Lesser E, Shockley R, Hopkins MS, Kruschwitz N. Big data, analytics and the path from insights to value. MIT Sloan Management Review, 2011, 52(2): 21-31.

[15] Luhn HP. A business intelligence system. IBM Journal, 1958, 2(4): 314-350.

[16] Manyika J, Chui M, Bughin J, Brown B, Dobbs R, Roxbury C, Byers AH. Big Data: The Next Frontier for Innovation, Competition, and Productivity, 2011, New York, NY: McKinsey Global Institute

[17] Mayer-Schonberger V, Cukier K. Big Data: A Revolution That Will Transform How We Live, Work and Think, 2013, New York, NY: Houghton Mifflin Harcourt Publishing Company

[18] McAfee A, Brynjolfsson E. Big data: the management revolution. Harvard Business Review, 2012 3-9.

[19] McFadden DL. The new science of pleasure. National Bureasu of Economic Research. Working paper 18687, 2013

[20] Mlodinow L. Subliminal: How Your Unconscious Mind Rules Your Behavior, 2012, New York, NY: Pantheon Books

[21] Rifkin J. The Third Industrial Revolution: How Lateral Power Is Transforming Energy, the Economy, and the World, 2011, New York, NY: Palgrave Macmillan

[22] Samuelson DA. Analytics: key to Obama’s victory. OR/MS Today, 2013 20-24.

[23] Schadt EE, Linderman MD, Sorenson J, Lee L, Nolan GP. Computational solutions to large-scale data management and analysis. Nature Reviews, 2010, 11: 647-657.

[24] Segall P. Understanding earthquakes. Science, 2012, 336: 676-710.

[25] Shostack A. The evolution of information security. The Next Wave, 2012, 19(2): 6-11.

[26] Siegel E. Predictive Analytics: The Power to Predict Who Will Click, Buy, Lie, or Die, 2013, New York, NY: John Wiley & Sons

[27] Silver N. Huckabay G, Kahrl C, Pease D. Introducing PECOTA. Baseball Prospectus 2003, 2003, Dulles, VA: Brassey’s Publishers 507-514.

[28] Silver N. The Signal and the Noise: Why So Many Predictions Fail — But Some Don’t, 2012, New York, NY: The Penguin Press

[29] Stern A, Lindner NH 8 M. Topological quantum computation — from basic concepts to first experiments. Science, 2013, 339: 1179-1184.

[30] Swart ER. The philosophical implications of the four-color problem. American Mathematical Monthly, 1980, 87(9): 697-702.

[31] Taleb NN. The Black Swan: Second Edition, 2010, New York, NY: Random House, Inc.

[32] Tien JM. Toward a decision informatics paradigm: a real-time information based approach to decision making. IEEE Transactions on Systems, Man and Cybernetics, Part C, Special Issue, 2003, 33(1): 102-113.

[33] Tien JM. On integration and adaptation in complex service systems. Journal of Systems Science and Systems Engineering, 2008, 17(2): 1-31.

[34] Tien JM. Manufacturing and services: from mass production to mass customization. Journal of Systems Science and Systems Engineering, 2011, 20(2): 129-154.

[35] Tien JM. The next industrial revolution: integrated services and goods. Journal of Systems Science and Systems Engineering, 2012, 21(3): 257-296.

[36] Tien JM, Berg D. Systems engineering in the growing service economy. IEEE Transactions on Systems, Man, and Cybernetics, 1995, 25(5): 321-326.

[37] Tien JM, Berg D. A case for service systems engineering. International Journal of Systems Engineering, 2003, 12(1): 13-39.

[38] Tien JM, Krishnamurthy A, Yasar A. Towards real time management of supply and demand chains. Journal of Systems Science and Systems Engineering, 2004, 13(3): 257-278.

[39] Tien JM, McClure JA. Towards an operations-oriented approach to information systems design in public organizations. Public Administration Review, Special Issue on Public Managemnt Information Systems, 1986, 27(7): 553-562.

[40] Turing AM. Computing machinery and intelligence. Mind, 1950, 59: 433-460.

[41] van Hattum P, Hoijtink H. Data fusion: an application in marketing. Database Marketing & Customer Strategy Management, 2008, 15(4): 267-284.

[42] Wilson R. Four Colors Suffice, 2002, London, England: Penguin Books.

[43] Zikopoulos PC, Eaton C, DeRoos D, Deutsch T, Lapis G. Understanding Big Data: Analytics for Enterprise Class Hadoop and Streaming Data, 2012, New York, NY: The McGraw-Hill Companies