Human joint motion data capture and fusion based on wearable sensors

Abstract

The field of human motion data capture and fusion has a broad range of potential applications and market opportunities. The capture of human motion data for wearable sensors is less costly and more convenient than other methods, but it also suffers from poor data capture accuracy and high latency. Consequently, in order to overcome the limitations of existing wearable sensors in data capture and fusion, the study initially constructed a model of the human joint and bone by combining the quaternion method and root bone human forward kinematics through mathematical modeling. Subsequently, the sensor data calibration was optimized, and the Madgwick algorithm was introduced to address the resulting issues. Finally, a novel human joint motion data capture and fusion model was proposed. The experimental results indicated that the maximum mean error and root mean square error of yaw angle of this new model were 1.21° and 1.17°, respectively. The mean error and root mean square error of pitch angle were maximum 1.24° and 1.19°, respectively. The maximum knee joint and elbow joint data capture errors were 3.8 and 6.1, respectively. The suggested approach, which offers a new path for technological advancement in this area, greatly enhances the precision and dependability of human motion capture, which has a broad variety of application possibilities.

Keywords

Madgwick Wearable sensors / Joints / Data capture / Fusion / Madgwick

References

[1] YuQ., JiangJ., SuC., HuangY., ChenN., ShaoH.. Ti3C2TxMXene/polyvinyl alcohol decorated polyester warp knitting fabric for flexible wearable strain sensors. Tex. Res. J., 2022, 925–6810-824.

[2] AtesH.C., NguyenP.Q., Gonzalez-MaciaL.. End-to-end design of wearable sensors. Nat. Rev. Mater., 2022, 711887-907.

[3] HouX., WuH., ZhaoJ.. A portable somatosensory manipulator system based on graphene ink/paper film piezoresistive sensors for human–computer interaction. IEEE Sens. J., 2023, 231821728-21738.

[4] YanB., HuangD., HongJ., ZhangC.. Design and fabrication of rotary magnetostrictvie energy harvester for knee-joint wearable applications. Circuit World, 2023, 49167-79.

[5] GaoW., YaoJ., ZhuK., ZhaoP., ChenX.. Highly sensitive, wide-range pressure sensor based on negative Poisson’s ratio for human motion detection. IEEE Sens. J., 2023, 231212618-12625.

[6] AbduF.J., ZhangY., DengZ.. Activity classification based on feature fusion of FMCW radar human motion micro-Doppler signatures. IEEE Sens. J., 2022, 2298648-8662.

[7] XueY., YuY., YinK., LiP., XieS., HumanJ.Z.. In-hand motion recognition based on multi-modal perception information fusion. IEEE Sens. J., 2022, 2276793-6805.

[8] LeeC.J., LeeJ.K.. Inertial motion capture-based wearable systems for estimation of joint kinetics: a systematic review. Sensors, 2022, 2272507-2508.

[9] ZhangS., LiY., ZhangS., ShahabiF., XiaS., DengY., AlshurafaN.. Deep learning in human activity recognition with wearable sensors: a review on advances. Sensors, 2022, 2241476-1477.

[10] KristofferssonA., LindénM.. A systematic review of wearable sensors for monitoring physical activity. Sensors, 2022, 222573-574.

[11] ZiziM.O.F., TurquaisP., DayA.. Dual-sensor wavefield separation in a compressed domain using parabolic dictionary learning. Geophys. Prospect., 2023, 715792-810.

[12] ChelnokovY.N.. Quaternion methods and models of regular celestial mechanics and astrodynamics. Appl. Math. Mech., 2022, 43121-80.

[13] WangD., XuX., YangY., ZhangT.. A quasi-Newton quaternions calibration method for DVL error aided GNSS. IEEE Trans. Veh. Technol., 2021, 7032465-2577.

[14] ChenY., CannD., JiaJ.. Preliminary study of CO2 frost formation during cryogenic carbon capture using tomography analysis. Fuel, 2022, 328111-9

[15] CaiS., ShaoM., DuM.. A binocular-camera-assisted sensor-to-segment alignment method for inertial sensor-based human gait analysis. IEEE Sens. J., 2023, 2332663-2671.

[16] KumarS., KolekarT., PatilS.. A low-cost multi-sensor data acquisition system for fault detection in fused deposition modelling. Sensors, 2022, 222517-518.

[17] JainR., SemwalV.B., KaushikP.. Stride segmentation of inertial sensor data using statistical methods for different walking activities. Robotica, 2022, 4082567-2580.

[18] KokM., SchönT.B.. Magnetometer calibration using inertial sensors. IEEE Sens. J., 2016, 16145679-5689.

[19] QiuS., ZhaoH., JiangN.. Sensor network oriented human motion capture via wearable intelligent system. Int. J. Intell. Syst., 2022, 3721646-1673.

[20] BandewadG., DattaK.P., GawaliB.W., PawarS.N.. Review on discrimination of hazardous gases by smart sensing technology. Artif. Intell. Appl., 2023, 1286-97

RIGHTS & PERMISSIONS

The Author(s)