Challenges to Engineering Management in the Big Data Era

Abstract

This paper presents a review of the challenges to engineering management in the Big Data Era as well as the Big Data applications. First, it outlines the definitions of big data, data science and intelligent knowledge and the history of big data. Second, the paper reviews the academic activities about big data in China. Then, it elaborates a number of challenging big data problems, including transforming semi-structured and non-structured data into “structured format” and explores the relationship of data heterogeneity, knowledge heterogeneity and decision heterogeneity. Furthermore, the paper reports various real-life applications of big data, such as financial and petroleum engineering and internet business.

Keywords

big data / data science / intelligent knowledge / engineering management / real-life applications

References

[1] Blei, D.M. (2012). Probabilistic topic models. Communications of the ACM, 55, 77–84

[2] Cheng, S., Dai, R., Xu, W., & Shi, Y. (2006). Research on data mining and knowledge management and its applications in China’s economic development: significance and trend. International Journal of Information Technology & Decision Making, 5, 585–596

[3] Filip, F.G., & Herrera-Viedma, E. (2014). Big data in the European Union. The Bridge, 44, 33–37

[4] Gantz, J., & Reinsel, D. (2012). Big data, bigger digital shadows, and biggest growth in the far east. An ICD report.

[5] Gomes, L.F.A.M. (2014). Snapshot of big data trends in Latin America. The Bridge, 44, 46–49

[6] He, J., Liu, X., Huang, G., Blumenstein, M., & Leung, C. (2014). Current and future development of big data in Commonwealth countries. The Bridge, 44, 38–45

[7] Laney, D. (2012). The importance of “big data”: A definition. (Report, no number). (No location): Gartner Co

[8] Laudon, K.C., & Laudon, J.P. (2012). Management information systems. Upper Saddle River, NJ: Pearson Education, Inc

[9] Lee, J., Shi, Y., Wang, F., Lee, H., & Kim, H. (2015). Advertisement clicking prediction by using multiple criteria mathematical programming. World Wide Web Journal, (forthcoming)

[10] Li, J., Zhang, Y., Wu, D., & Zhang, W. (2014). Impacts of big data in the Chinese financial industry. The Bridge, 44, 20–26

[11] NSF. (2012). Core techniques and technologies for advancing big data science & engineering (BIGDATA). National Science Foundation. Retrieved from

[12] Olson, D., & Shi, Y. (2007). Introduction to Business Data Mining. Boston: McGraw-Hill

[13] Ouyang, Z.B., & Shi, Y. (2011). A fuzzy clustering algorithm for petroleum data. In WI-IAT '11 proceedings of the 2011 IEEE/WIC/ACM International Conferences on Web Intelligence and Intelligent Agent Technology, Volume 03, 233–236

[14] Price, R. (1783). Observations on reversionary payments: on schemes for providing annuities for widows, and for persons in old age: on the method of calculating the values of assurances on lives: and on the national debt (Vols. 1–2). (4th ed.). London: T Cadell

[15] Shi, Y. (2014a). A global view of big data. The Bridge, 44, 4–5

[16] Shi, Y. (2014b). Big data: History, current status, and challenges going forward. The Bridge, 44, 6–11

[17] Shi, Y., Tain, Y., Kou, G., Peng, Y., & Li, J. (2011). Optimization based Data Mining: Theory and Applications. New York: Springer

[18] Shi, Y., Xu, W., & Chen, Z. (2005). Chinese Academy of Sciences symposium on data mining and knowledge management (CASDMKM 2004), LNAI 3327. New York: Springer-Verlag

[19] Shi, Y., Zhang, L., Tain, Y., & Li, X. (2015). Intelligent Knowledge: A Study beyond Data Mining. New York: Springer

[20] Tien, J. (2014). Overview of big data: A US perspective. The Bridge, 44, 12–19

[21] Tsumoto, S. (2014). Big data education and research in Japan. The Bridge, 44, 27–32

[22] Villanova University. (2014). What is big data? Retrieved from

[23] Watson, B. (1964). Chuang Tzu: Basic Writings. New York: Columbia University Press

[24] Xu, Z., & Shi, Y. (2015). Exploring big data analysis: Fundamental scientific problems. Annals of Data Science, (forthcoming)

[25] Zhang, L., Li, J., Shi, Y., & Liu, X. (2009). Foundations of intelligent knowledge management. Journal of Human Systems Management, 28, 145–161

RIGHTS & PERMISSIONS

Higher Education Press and Springer-Verlag Berlin Heidelberg