TrajRL-TFF: A Trajectory Representation Learning Method Based on Time-domain and Frequency-domain Feature Fusion

Abstract

Trajectory representation learning transforms raw trajectory data (sequences of spatiotemporal points) into low-dimensional representation vectors to improve downstream tasks such as trajectory similarity computation, prediction, and classification. Existing models primarily adopt self-supervised learning frameworks, often employing models like Recurrent Neural Networks (RNNs) as encoders to capture local dependency in trajectory sequences. However, individual mobility within urban areas exhibits regular and periodic patterns, suggesting the need for a more comprehensive representation from both local and global perspectives. To address this, we propose TrajRL-TFF, a trajectory representation learning method based on time-domain and frequency-domain feature fusion. First, considering the heterogeneous distribution of trajectory data in space, a quadtree is employed for spatial partitioning and coding. Then, each trajectory is converted into a quadtree-code based time series (i.e., time-domain signal), with its corresponding frequency-domain signal derived via Discrete Fourier Transform (DFT). Finally, a trajectory encoder, combining an RNN-based time-domain encoder and a Transformer-based frequency domain encoder, is constructed to capture the trajectory’s local and global features, respectively, and trained by a self-supervised sequence encoding-decoding framework with trajectory perturbation-reconstruction task. Experiments demonstrate that TrajRL-TFF outperforms baselines in downstream tasks including trajectory querying and prediction, confirming that integrating time- and frequency-domain signals enables a more comprehensive representation of human mobility regularities and patterns, which provides valuable guidance for trajectory representation learning and trajectory modeling in future studies.

Keywords

Trajectory representation learning / Trajectory encoder / Quadtree / Frequency domain / Self-supervised learning

References

[1] Alt H. The computational geometry of comparing shapes. Efficient Algorithms, 2009, 5760: 235-248

[2] Alt H, Godau M. Computing the Fréchet distance between two polygonal curves. International Journal of Computational Geometry & Applications, 1995, 5(01n02): 75-91

[3] Bahdanau, D., Cho, K., and Bengio, Y. (2015). Neural machine translation by jointly learning to align and translate. In Proceedings of the 3rd International Conference on Learning Representations.

[4] Cao J, Li Q, Tu W, Wang F. Characterizing preferred motif choices and distance impacts. Plos one, 2019, 14(4 e0215242

[5] Chang, Y., Qi, J., Liang, Y., & Tanin, E. (2023). Contrastive trajectory similarity learning with dual-feature attention. In Proceedings of the 39th International conference on data engineering (ICDE) (pp. 2933-2945). IEEE.

[6] Chen, L., Özsu, M. T., & Oria, V. (2005). Robust and fast similarity search for moving object trajectories. In Proceedings of the 2005 ACM SIGMOD international conference on Management of data (pp. 491-502).

[7] Chen, Y., Li, X., Cong, G., Bao, Z., Long, C., Liu, Y., ... & Ellison, R. (2021). Robust road network representation learning: When traffic patterns meet traveling semantics. In Proceedings of the 30th ACM International Conference on Information & Knowledge Management (pp. 211-220).

[8] Cho, K., van Merrienboer, B., Gulcehre, C., Bougares, F., Schwenk, H., & Bengio, Y. (2014). Learning phrase representations using RNN encoder-decoder for statistical machine translation. In Conference on Empirical Methods in Natural Language Processing (EMNLP 2014).

[9] Chung, J., Gulcehre, C., Cho, K., and Bengio, Y. (2014). Empirical evaluation of gated recurrent neural networks on sequence modeling. arXiv preprint arXiv:1412.3555

[10] Endo Y, Toda H, Nishida K, Ikedo J. Classifying spatial trajectories using representation learning. International Journal of Data Science and Analytics, 2016, 2(3): 107-117

[11] Fang, Z., Du, Y., Chen, L., Hu, Y., Gao, Y., & Chen, G. (2021, April). E 2 dtc: An end to end deep trajectory clustering framework via self-training. In 2021 IEEE 37th International Conference on Data Engineering (ICDE) (pp. 696-707). IEEE.

[12] Fang, Z., Du, Y., Zhu, X., Hu, D., Chen, L., Gao, Y., & Jensen, C. S. (2022). Spatio-temporal trajectory similarity learning in road networks. In Proceedings of the 28th ACM SIGKDD conference on knowledge discovery and data mining (pp. 347-356).

[13] Fu TY, Lee WC. Trembr: Exploring road networks for trajectory representation learning. Acm Transactions On Intelligent Systems And Technology, 2020, 11(1): 1-25

[14] Huang F, Lv J, Yue Y. Jointly spatial-temporal representation learning for individual trajectories. Computers, Environment and Urban Systems, 2024, 112 102144

[15] Ji Y, Gao S, Huynh T, Scheele C, Triveri J, Kruse J, Bennett C, Wen Y. Rethinking the regularity in mobility patterns of personal vehicle drivers: A multi-city comparison using a feature engineering approach. Transactions in GIS, 2023, 27(3): 663-685

[16] Jiang, J., Pan, D., Ren, H., Jiang, X., Li, C., & Wang, J. (2023, April). Self-supervised trajectory representation learning with temporal regularities and travel semantics. In 2023 IEEE 39th international conference on data engineering (ICDE) (pp. 843-855). IEEE.

[17] Jiang S, Ferreira J, Gonz´alez MC. Clustering daily patterns of human activities in the city. Data Mining And Knowledge Discovery, 2012, 25: 478-510

[18] Li, J., Wang, M., Li, L., Xin, K., Hua, W., & Zhou, X. (2023a). Trajectory representation learning based on road network partition for similarity computation. In International Conference on Database Systems for Advanced Applications (pp. 396-413). Springer Nature Switzerland.

[19] Li, L., Xue, H., Song, Y., & Salim, F. (2024, October). T-jepa: A joint-embedding predictive architecture for trajectory similarity computation. In Proceedings of the 32nd ACM International Conference on Advances in Geographic Information Systems (pp. 569-572).

[20] Li, S., Chen, W., Yan, B., Li, Z., Zhu, S., & Yu, Y. (2023b). Self-supervised contrastive representation learning for large-scale trajectories. Future Generation Computer Systems,148, 357–366.

[21] Li, X., Zhao, K., Cong, G., Jensen, C. S., & Wei, W. (2018, April). Deep representation learning for trajectory similarity computation. In 2018 IEEE 34th international conference on data engineering (ICDE) (pp. 617-628). IEEE.

[22] Liang, Y., Ouyang, K., Yan, H., Wang, Y., Tong, Z., & Zimmermann, R. (2021). Modeling Trajectories with Neural Ordinary Differential Equations. In Proceedings of the Thirtieth International Joint Conference on Artificial Intelligence (pp.1498-1504).

[23] Lin Y, Wan H, Guo S, Hu J, Jensen CS, Lin Y. Pre-training general trajectory embeddings with maximum multi-view entropy coding. IEEE Transactions on Knowledge and Data Engineering, 2023, 36(12): 9037-9050

[24] Lin, Y., Wei, T., Zhou, Z., Wen, H., Hu, J., Guo, S., ... & Wan, H. (2024). TrajFM: A vehicle trajectory foundation model for region and task transferability. arXiv preprint arXiv:2408.15251.

[25] Liu, Y., Zhao, K., Cong, G., & Bao, Z. (2020, April). Online anomalous trajectory detection with deep generative sequence modeling. In 2020 IEEE 36th International Conference on Data Engineering (ICDE) (pp. 949-960). IEEE.

[26] Lv, J., Li, Q., Sun, Q., & Wang, X. (2018). T-CONV: A convolutional neural network for multi-scale taxi trajectory prediction. In 2018 IEEE international conference on big data and smart computing (bigcomp) (pp. 82-89). IEEE.

[27] Ma, Z., Tu, Z., Chen, X., Zhang, Y., Xia, D., Zhou, G., ... & Gong, J. (2024). More than routing: Joint GPS and route modeling for refine trajectory representation learning. In Proceedings of the ACM Web Conference 2024 (pp. 3064-3075).

[28] Song C, Koren T, Wang P, Barabási AL. Modelling the scaling properties of human mobility. Nature Physics, 2010, 6(10): 818-823

[29] Sutskever, I., Vinyals, O., & Le, Q. V. (2014). Sequence to sequence learning with neural networks. In Proceedings of the 28th International Conference on Neural Information Processing Systems (pp. 3104–3112).

[30] Vlachos, M., Kollios, G., & Gunopulos, D. (2002, February). Discovering similar multidimensional trajectories. In Proceedings 18th international conference on data engineering (pp. 673-684). IEEE.

[31] Winograd S. On computing the discrete Fourier transform. Mathematics Of Computation, 1978, 32(141): 175-199

[32] Yan B, Zhao G, Song L, Yu Y, Dong J. Precln: Pretrained-based contrastive learning network for vehicle trajectory prediction. World Wide Web, 2023, 26(4): 1853-1875

[33] Yang C, Jiang R, Xu X, Xiao C, Sezaki K. SIMformer: Single-layer vanilla transformer can learn free-space trajectory similarity. Proceedings of the VLDB Endowment, 2024, 18(2): 390-398

[34] Yang, P., Wang, H., Zhang, Y., Qin, L., Zhang, W., & Lin, X. (2021, April). T3s: Effective representation learning for trajectory similarity computation. In 2021 IEEE 37th international conference on data engineering (ICDE) (pp. 2183-2188). IEEE.

[35] Yao, D., Cong, G., Zhang, C., & Bi, J. (2019, April). Computing trajectory similarity in linear time: A generic seed-guided neural metric learning approach. In 2019 IEEE 35th international conference on data engineering (ICDE) (pp. 1358-1369). IEEE.

[36] Yao, D., Hu, H., Du, L., Cong, G., Han, S., & Bi, J. (2022, August). TrajGAT: A graph-based long-term dependency modeling approach for trajectory similarity computation. In Proceedings of the 28th ACM SIGKDD conference on knowledge discovery and data mining (pp. 2275-2285).

[37] Yao, D., Zhang, C., Zhu, Z., Huang, J., & Bi, J. (2017, May). Trajectory clustering via deep representation learning. In 2017 international joint conference on neural networks (IJCNN) (pp. 3880-3887). IEEE.

[38] Zhang, C., Zhou, T., Wen, Q., & Sun, L. (2022). Tfad: A decomposition time series anomaly detection architecture with time-frequency analysis. In Proceedings of the 31st ACM international conference on information & knowledge management (pp. 2497-2507).

[39] Zhang, H., Zhang, X., Jiang, Q., Zheng, B., Sun, Z., Sun, W., & Wang, C. (2021). Trajectory similarity learning with auxiliary supervision and optimal matching. In Proceedings of the Twenty-Ninth International Conference on International Joint Conferences on Artificial Intelligence (pp. 3209-3215).

[40] Zhu, Y., Jianqiao Yu, J., Zhao, X., Wei, X., & Liang, Y. (2024). UniTraj: Universal human trajectory modeling from billion-scale worldwide traces. arXiv e-prints, arXiv-2411.

Funding

National Natural Science Foundation of China(42571532)

RIGHTS & PERMISSIONS

The Author(s)