Parameter Adaptive Non-Model-Based State Estimation Combining Attention Mechanism and LSTM

Xuebo Jin; Tianxiao Sun; Wei Chen; Huijun Ma; Yeqing Wang; Yusen Zheng

doi:10.62762/TIS.2024.137329

CiteScore

1.08

Impact Factor

Volume 1, Issue 1, IECE Transactions on Intelligent Systematics

Volume 1, Issue 1, 2024

Submit Manuscript Edit a Special Issue

Academic Editor

Shenglun Yi

University of Padua, Italy

Article QR Code

Scan the QR code for reading

Popular articles

Research on A Ship Trajectory Classification Method Based on Deep Learning YOLOv7-Bw: A Dense Small Object Efficient Detector Based on Remote Sensing Image Deep Prediction Network Based on Covariance Intersection Fusion for Sensor Data Visual Feature Extraction and Tracking Method Based on Corner Flow Detection A Mimic Fusion Algorithm for Dual Channel Video Based on Possibility Distribution Synthesis Theory Inaugural Editorial of the Chinese Journal of Information Fusion Bridging Modalities: A Survey of Cross-Modal Image-Text Retrieval Simultaneous Spatiotemporal Bias Compensation and Data Fusion for Asynchronous Multisensor Systems Extraction of Motion Information from Occupancy Grid Map Using Keystone Transform A Cyber-Physical System Based on On-Board Diagnosis (OBD-II) for Smart City

IECE Transactions on Intelligent Systematics, 2024, Volume 1, Issue 1: 40-48

Free Access | Research Article | 29 May 2024 | Cited: 4

Parameter Adaptive Non-Model-Based State Estimation Combining Attention Mechanism and LSTM

Xuebo Jin 1 *

Tianxiao Sun 1

Wei Chen 1

Huijun Ma 1

Yeqing Wang 1

Yusen Zheng 1

1 School of Computer Science and Artificial Intelligence, Beijing Technology and Business University, Beijing 100048, China

* Corresponding author: Xuebo Jin, email: [email protected]

DOI: 10.62762/TIS.2024.137329

Received: 25 December 2023, Accepted: 22 May 2024, Published: 29 May 2024

Abstract

Nowadays, state estimation is widely used in fields such as autonomous driving and drone navigation. However, in practical applications, it is difficult to obtain accurate target motion models and noise covariance.This leads to a decrease in the estimation accuracy of traditional Kalman filters. To address this issue, this paper proposes an adaptive model free state estimation method based on attention parameter learning module. This method combines Transformer's encoder with Long Short Term Memory Network (LSTM), and obtains the system's operational characteristics through offline learning of measurement data without modeling the system dynamics and measurement characteristics. In addition, based on the output of the attention learning module, the expectation maximization (EM) algorithm is used to estimate the system model parameters online, and a Kalman filter is used to obtain state estimation. This paper was validated using the GPS trajectory path dataset, and the experimental results showed that the proposed parameter adaptive model free state estimation method has better estimation accuracy than other models, providing an effective method for using deep learning networks for state estimation.

Graphical Abstract

Keywords

State Estimation

Kalman Filter

Transformer

LSTM

References

[1]Jason, S., & Marilyn, Wolf. (2015). Tailoring design for embedded computer vision applications. Computer, 48(5), 58-62.

[2]Elias, J., Marcos, P., João, V., & Carlos, D. (2023). A Robotics Club in High School: an experience report. Latin American Robotics Symposium, 683-688.

[3]Takafumi, O., Tad, G., & Jaychand, U. (2018). Autonomous Driving System based on Deep Q Learnig. International Conference on Intelligent Autonomous Systems, 201-205.

[4]Kalman, R. (1960). A New Approach to Linear Filtering and Prediction Problems. Journal of Basic Engineering, 82D, 35-45.

[5]Kalman, R. E., & Bucy, R. S. (1961). New results in linear filtering and prediction theory.

[6]Julier, S. J., Uhlmann, J. K., & Durrant-Whyte, H. F. (1995, June). A new approach for filtering nonlinear systems. In Proceedings of 1995 American Control Conference-ACC'95 (Vol. 3, pp. 1628-1632). IEEE.

[7]Arasaratnam, I., & Haykin, S. (2011). Cubature kalman smoothers. Automatica, 47(10), 2245-2250.

[8]Ghahramani, Z., & Hinton, G. E. (1996). Parameter estimation for linear dynamical systems.

[9]Choi, H. M., Kim, M. K., & Yang, H. (2021). Abnormally high water temperature prediction using LSTM deep learning model. Journal of Intelligent \& Fuzzy Systems, 40(4), 8013-8020.

[10]Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.

[11]Wang, H., & Tu, M. (2020, December). Enhancing attention models via multi-head collaboration. In 2020 International Conference on Asian Language Processing (IALP) (pp. 19-23). IEEE.

[12]Wang, J., Zhang, W., & Yang, H. (2021). Visual Analytics for RNN-Based Deep Reinforcement Learning. IEEE Transactions on Visualization and Computer Graphics, 28(12), 4141-4155.

[13]Zhou, X., Shi, J., Gong, K., Zhu, C., Hua, J., & Xu, J. (2021). A Novel Quench Detection Method Based on CNN-LSTM Model. IEEE Transactions on Applied Superconductivity, 31(5).

[14]Huang, H., Zeng, Z., Yao, D., Pei, X., & Zhang, Y. (2021). Spatial-temporal ConvLSTM for vehicle driving intention prediction. Tsinghua Science and Technology, 27(3), 599-609.

[15]Jin, X. B., Gong, W. T., Kong, J. L., Bai, Y. T., & Su, T. L. (2022). PFVAE: a planar flow-based variational auto-encoder prediction model for time series data. Mathematics, 10(4), 610.

Cite This Article

APA Style

Jin, X., Sun, T., Chen, W., Ma, H., Wang, Y., & Zheng, Y. (2024). Parameter Adaptive Non-Model-Based State Estimation Combining Attention Mechanism and LSTM. IECE Transactions on Intelligent Systematics, 1(1), 40–48. https://doi.org/10.62762/TIS.2024.137329

Article Metrics

Citations:

Google Scholar

Crossref

Scopus

Web of Science

Article Access Statistics:

PDF Downloads: 99

Publisher's Note

IECE stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

IECE or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.

IECE Transactions on Intelligent Systematics

ISSN: 2998-3355 (Online) | ISSN: 2998-3320 (Print)

Email: [email protected]

Portico

All published articles are preserved here permanently:
https://www.portico.org/publishers/iece/

Google Scholar

Crossref

Scopus

Web of Science

We use cookies