Robust Framework for Ship Operational Data Analysis Toward Improved Data Usability

Abstract

The increasing availability of ship operational data from onboard sensors presents both opportunities and challenges for performance analysis and monitoring. This study proposes a robust ship operational data analysis (SODA) framework to enhance data usability through streamlined processing and analytical procedures. A key component of the framework is a novel metric to quantitatively evaluate the quality of the processed data, which offers a sophisticated tool to compare the performance of different ship operational data analysis strategies, thus is useful for the establishment of optimal data filtering and correction methods. The so-called information entropy weighted data quality index is formulated based on first principles, which systematically evaluates the processed data quality from three aspects: information richness, degree of data scattering, and the correlation between ship speed and engine power. Various filtering strategies and weather influence correction techniques adopted by ISO 15016 to enhance the reliability and consistency of performance metrics derived from the data are systematically investigated. Real-world operational data from a container ship are employed to validate the proposed framework, demonstrating notable improvements in data quality and consistency. The SODA framework can also facilitate the identification of long-term performance trends, highlighting its potential for supporting proactive maintenance planning. Results show that stricter filtering criteria are effective in reducing data scatter and uncertainty, but inevitably suffer from more severe loss of data richness. Milder filtering combined with weather influence corrections allows for more comprehensive trend analysis over extended periods. Overall, the proposed SODA framework provides a practical and robust solution for enhancing ship performance monitoring, enabling data-driven decision-making in maritime operations.

Keywords

Ship operational data / Analysis framework / Data quality index / Data filtering / Weather influence correction

References

[1] Aldous L, Smith T, Bucknall R, Thompson P. Uncertainty analysis in ship performance monitoring. Ocean Engineering, 2015, 110: 29-38 Part B)

[2] Bialystocki N, Konovessis D. On the estimation of ship’s fuel consumption and speed curve: A statistical approach. Journal of Ocean Engineering and Science, 2016, 1(2): 157-166

[3] Coraddu A, Oneto L, Baldi F, Cipollini F, Atlar M, Savio S. Data-driven ship digital twin for estimating the speed loss caused by the marine fouling. Ocean Engineering, 2019, 186: 106063

[4] Dalheim ØØ, Steen S. Preparation of in-service measurement data for ship operation and performance analysis. Ocean Engineering, 2020, 212: 107730

[5] Dalheim ØØ, Steen S. A computationally efficient method for identification of steady state in time series data from ship monitoring. Journal of Ocean Engineering and Science, 2020, 5(4): 333-345

[6] Dalheim ØØ, Steen S. Uncertainty in the real-time estimation of ship speed-through-water. Ocean Engineering, 2021, 235: 109423

[7] Du YQ, Chen YY, Li XH, Schonborn A, Sun Z. Data fusion and machine learning for ship fuel efficiency modeling: Part III–Sensor data and meteorological data. Communications in Transportation Research, 2022, 2: 100072

[8] Guo B, Gupta P, Steen S, Tvete HA. Evaluating vessel technical performance index using in-service data. Ocean Engineering, 2023, 286: 115402 Part 2)

[9] Gupta P, Taskar B, Steen S, Rasheed A. Statistical modeling of Ship’s hydrodynamic performance indicator. Applied Ocean Research, 2021, 111: 102623

[10] Gupta P, Kim YR, Steen S, Rasheed A. Streamlined semiautomatic data processing framework for ship performance analysis. International Journal of Naval Architecture and Ocean Engineering, 2023, 15: 100550

[11] ISO. Ship and marine technology-measurement of changes in hull and propeller performance. ISO 15016, 2016, Geneva, International Standard Organization

[12] ISO. Evaluation of fuel consumption and propulsion performance in actual seas-Part 1: method for evaluating fuel consumption and propulsion performance. ISO 25817-1, 2025, Geneva, International Standard Organization

[13] ISO. Evaluation of fuel consumption and propulsion performance in actual seas-Part 2: index for life cycle fuel consumption. ISO 25817-2, 2025, Geneva, International Standard Organization

[14] ISO. Ships and marine technology-guidelines for the assessment of speed and power performance by analysis of speed trial data. ISO15016, 2025, Geneva, International Standard Organization

[15] ITTC. Recommended procedures and guidelines: preparation, conduct and analysis of speed/power trials, 7.5-04-01-01.1, 2024, Zurich, International Towing Tank Conference

[16] Killick R, Fearnhead P, Eckley I. Optimal detection of changepoints with a linear computational cost. Journal of the American Statistical Association, 2012, 107(500): 1590-1598

[17] Krasilnikov V, Skjefstad VS, Koushan K, Rambech HJ. Numerical prediction and validation of ship’s propulsion performance in full scale. Seventh International Symposium on Marine Propulsors, 2022, Trondheim, SINTEF

[18] La Ferlita A, Qi Y, Di Nardo E, El Moctar O, Schellin TE, Claramella A. A framework of a data-driven model for ship performance. Ocean Engineering, 2024, 309: 118486 Part 1)

[19] Liu S, Loh M, Leow W, Chen H, Shang B, Papanikolaou A. Rational processing of monitored ship voyage data for improved operation. Applied Ocean Research, 2020, 104: 102363

[20] Liu S, Chen H, Shang B, Papanikolaou A. Supporting predictive maintenance of a ship by analysis of onboard measurements. Journal of Marine Science and Engineering, 2022, 10(2): 215

[21] Mitterndorf M, Nielsen UD, Bingham HB. Capturing the effect of biofouling on ships by incremental machine learning. Applied Ocean Research, 2023, 138: 103619

[22] Oh MJ, Roh MI, Park SW, Chun DH, Son MJ, Lee JY. Operational analysis of container ships by using maritime big data. Journal of Marine Science and Engineering, 2021, 9(4): 438

[23] Oliveria DR, Granhag L, Larsson L. A novel indicator for ship hull and propeller performance: Examples from two shipping segments. Ocean Engineering, 2020, 205: 107229

[24] Orihara H, Tsujimoto M. Performance prediction of full-scale ship and analysis by means of onboard monitoring. Part 2: Validation of full-scale performance predictions in actual seas. Journal of Marine Science and Technology, 2018, 23(4): 782-801

[25] Papandreou C, Ziakopoulos A. Predicting VLCC fuel consumption with machine learning using operationally available sensor data. Ocean Engineering, 2022, 243: 110321

[26] Sakurada A, Sogihara N, Tsujimoto M. Development of a filtering method for evaluation of performance in a calm sea based on onboard monitoring data. Journal of the Japan Society of Naval Architects and Ocean Engineers, 2020, 31: 29-37

[27] Shaw HJ, Lin CK. Marine big data analysis of ships for the energy efficiency changes of the hull and maintenance evaluation based on the ISO 19030 standard. Ocean Engineering, 2021, 232: 108953

[28] Sogihara N, Sakurada A, Tsujimoto M. Validation of filtering method for evaluating ship performance in calm sea using onboard monitoring data. Journal of the Japan Society of Naval Architects and Ocean Engineers, 2021, 33: 25-33

[29] Trodden DG, Murphy AJ, Pazouki K, Sargeant J. Fuel usage data analysis for efficient shipping operations. Ocean Engineering, 2015, 110(8): 75-84

[30] Tsujimoto M, Orihara H. Performance prediction of full-scale ship and analysis by means of onboard monitoring (Part 1 ship performance prediction in actual seas. Journal of Marine Science and Technology, 2019, 24: 16-33

[31] Wang J, Bielicki S, Kluwe F, Orihara H, Xin G, Kume K, Oh S, Liu S, Feng P. Validation study on a new semi-empirical method for the prediction of added resistance in waves of arbitrary heading in analyzing ship speed trial results. Ocean Engineering, 2021, 240: 109959

[32] Yan R, Wang S, Psaraftis HN. Data analytics for fuel consumption management in maritime transportation: status and perspectives. Transportation Research Part E: Logistics and Transportation Review, 2021, 155: 102489

[33] Zhang MY, Tsoulakos N, Kujala P, Hirdaris S. A deep learning method for the prediction of ship fuel consumption in real operational conditions. Engineering Applications of Artificial Intelligence, 2024, 130: 107425

RIGHTS & PERMISSIONS

Harbin Engineering University and Springer-Verlag GmbH Germany, part of Springer Nature

Just Accepted

This article has successfully passed peer review and final editorial review, and will soon enter typesetting, proofreading and other publishing processes. The currently displayed version is the accepted final manuscript. The officially published version will be updated with format, DOI and citation information upon launch. We recommend that you pay attention to subsequent journal notifications and preferentially cite the officially published version. Thank you for your support and cooperation.