-
CiteScore
2.28
Impact Factor
Volume 1, Issue 1, IECE Transactions on Intelligent Systematics
Volume 1, Issue 1, 2024
Submit Manuscript Edit a Special Issue
Academic Editor
Shenglun Yi
Shenglun Yi
University of Padua, Italy
Article QR Code
Article QR Code
Scan the QR code for reading
Popular articles
IECE Transactions on Intelligent Systematics, Volume 1, Issue 1, 2024: 40-48

Free to Read | Research Article | 29 May 2024
Parameter Adaptive Non-Model-Based State Estimation Combining Attention Mechanism and LSTM
1 School of Computer Science and Artificial Intelligence, Beijing Technology and Business University, Beijing 100048, China
* Corresponding Author: Xuebo Jin, [email protected]
Received: 25 December 2023, Accepted: 22 May 2024, Published: 29 May 2024  
Cited by: 9  (Source: Web of Science) , 10  (Source: Google Scholar)
Abstract
Nowadays, state estimation is widely used in fields such as autonomous driving and drone navigation. However, in practical applications, it is difficult to obtain accurate target motion models and noise covariance.This leads to a decrease in the estimation accuracy of traditional Kalman filters. To address this issue, this paper proposes an adaptive model free state estimation method based on attention parameter learning module. This method combines Transformer's encoder with Long Short Term Memory Network (LSTM), and obtains the system's operational characteristics through offline learning of measurement data without modeling the system dynamics and measurement characteristics. In addition, based on the output of the attention learning module, the expectation maximization (EM) algorithm is used to estimate the system model parameters online, and a Kalman filter is used to obtain state estimation. This paper was validated using the GPS trajectory path dataset, and the experimental results showed that the proposed parameter adaptive model free state estimation method has better estimation accuracy than other models, providing an effective method for using deep learning networks for state estimation.

Graphical Abstract
Parameter Adaptive Non-Model-Based State Estimation Combining Attention Mechanism and LSTM

Keywords
State Estimation
Kalman Filter
Transformer
LSTM

Funding
This work was supported without any funding.

References
  1. Jason, S., & Marilyn, Wolf. (2015). Tailoring design for embedded computer vision applications. Computer, 48(5), 58-62.
    [Google Scholar]
  2. Elias, J., Marcos, P., João, V., & Carlos, D. (2023). A Robotics Club in High School: an experience report. Latin American Robotics Symposium, 683-688.
    [Google Scholar]
  3. Takafumi, O., Tad, G., & Jaychand, U. (2018). Autonomous Driving System based on Deep Q Learnig. International Conference on Intelligent Autonomous Systems, 201-205.
    [Google Scholar]
  4. Kalman, R. (1960). A New Approach to Linear Filtering and Prediction Problems. Journal of Basic Engineering, 82D, 35-45.
    [Google Scholar]
  5. Kalman, R. E., & Bucy, R. S. (1961). New results in linear filtering and prediction theory.
    [Google Scholar]
  6. Julier, S. J., Uhlmann, J. K., & Durrant-Whyte, H. F. (1995, June). A new approach for filtering nonlinear systems. In Proceedings of 1995 American Control Conference-ACC'95 (Vol. 3, pp. 1628-1632). IEEE.
    [Google Scholar]
  7. Arasaratnam, I., & Haykin, S. (2011). Cubature kalman smoothers. Automatica, 47(10), 2245-2250.
    [Google Scholar]
  8. Ghahramani, Z., & Hinton, G. E. (1996). Parameter estimation for linear dynamical systems.
    [Google Scholar]
  9. Choi, H. M., Kim, M. K., & Yang, H. (2021). Abnormally high water temperature prediction using LSTM deep learning model. Journal of Intelligent \& Fuzzy Systems, 40(4), 8013-8020.
    [Google Scholar]
  10. Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., ... & Polosukhin, I. (2017). Attention is all you need. Advances in neural information processing systems, 30.
    [Google Scholar]
  11. Wang, H., & Tu, M. (2020, December). Enhancing attention models via multi-head collaboration. In 2020 International Conference on Asian Language Processing (IALP) (pp. 19-23). IEEE.
    [Google Scholar]
  12. Wang, J., Zhang, W., & Yang, H. (2021). Visual Analytics for RNN-Based Deep Reinforcement Learning. IEEE Transactions on Visualization and Computer Graphics, 28(12), 4141-4155.
    [Google Scholar]
  13. Zhou, X., Shi, J., Gong, K., Zhu, C., Hua, J., & Xu, J. (2021). A Novel Quench Detection Method Based on CNN-LSTM Model. IEEE Transactions on Applied Superconductivity, 31(5).
    [Google Scholar]
  14. Huang, H., Zeng, Z., Yao, D., Pei, X., & Zhang, Y. (2021). Spatial-temporal ConvLSTM for vehicle driving intention prediction. Tsinghua Science and Technology, 27(3), 599-609.
    [Google Scholar]
  15. Jin, X. B., Gong, W. T., Kong, J. L., Bai, Y. T., & Su, T. L. (2022). PFVAE: a planar flow-based variational auto-encoder prediction model for time series data. Mathematics, 10(4), 610.
    [Google Scholar]

Cite This Article
APA Style
Jin, X., Sun, T., Chen, W., Ma, H., Wang, Y., & Zheng, Y. (2024). Parameter Adaptive Non-Model-Based State Estimation Combining Attention Mechanism and LSTM. IECE Transactions on Intelligent Systematics, 1(1), 40–48. https://doi.org/10.62762/TIS.2024.137329

Article Metrics
Citations:

Crossref

1

Scopus

9

Web of Science

9
Article Access Statistics:
Views: 1283
PDF Downloads: 190

Publisher's Note
IECE stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions
Institute of Emerging and Computer Engineers (IECE) or its licensor (e.g. a society or other partner) holds exclusive rights to this article under a publishing agreement with the author(s) or other rightsholder(s); author self-archiving of the accepted manuscript version of this article is solely governed by the terms of such publishing agreement and applicable law.
IECE Transactions on Intelligent Systematics

IECE Transactions on Intelligent Systematics

ISSN: 2998-3355 (Online) | ISSN: 2998-3320 (Print)

Email: [email protected]

Portico

Portico

All published articles are preserved here permanently:
https://www.portico.org/publishers/iece/

Copyright © 2024 Institute of Emerging and Computer Engineers Inc.