An Efficient and Accurate UAV State Estimation Method with Multi-LiDAR–IMU–Camera Fusion
Shranjeno v:
| izdano v: | Drones vol. 9, no. 12 (2025), p. 823-847 |
|---|---|
| Glavni avtor: | |
| Drugi avtorji: | , , , , |
| Izdano: |
MDPI AG
|
| Teme: | |
| Online dostop: | Citation/Abstract Full Text + Graphics Full Text - PDF |
| Oznake: |
Brez oznak, prvi označite!
|
MARC
| LEADER | 00000nab a2200000uu 4500 | ||
|---|---|---|---|
| 001 | 3286273284 | ||
| 003 | UK-CbPIL | ||
| 022 | |a 2504-446X | ||
| 024 | 7 | |a 10.3390/drones9120823 |2 doi | |
| 035 | |a 3286273284 | ||
| 045 | 2 | |b d20250101 |b d20251231 | |
| 100 | 1 | |a Ding Junfeng |u School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China; djfenghust@hust.edu.cn (J.D.); majie@hust.edu.cn (J.M.) | |
| 245 | 1 | |a An Efficient and Accurate UAV State Estimation Method with Multi-LiDAR–IMU–Camera Fusion | |
| 260 | |b MDPI AG |c 2025 | ||
| 513 | |a Journal Article | ||
| 520 | 3 | |a <sec sec-type="highlights"> What are the main findings? <list list-type="bullet"> <list-item> </list-item>The proposed DLIC method reformulates the complex, coupled UAV state estimation problem in multi-LiDAR–IMU–camera systems as an efficient distributed subsystem optimization framework. The designed feedback mechanism effectively constrains and optimizes the UAV state using the estimated subsystem states. <list-item> Extensive experiments demonstrate that DLIC achieves superior accuracy and efficiency on a resource-constrained embedded UAV platform equipped with only an 8-core CPU. It operates in real time while maintaining low memory usage. </list-item> What are the implications of the main finding? <list list-type="bullet"> <list-item> </list-item>This work demonstrates that the challenging, coupled UAV state estimation problem in multi-LiDAR–IMU–camera systems can be effectively addressed through distributed optimization techniques, paving the way for scalable and efficient estimation frameworks. <list-item> The proposed DLIC method offers a promising solution for real-time state estimation in resource-limited UAVs with multi-sensor configurations. </list-item> State estimation plays a vital role in UAV navigation and control. With the continuous decrease in sensor cost and size, UAVs equipped with multiple LiDARs, Inertial Measurement Units (IMUs), and cameras have attracted increasing attention. Such systems can acquire rich environmental and motion information from multiple perspectives, thereby enabling more precise navigation and mapping in complex environments. However, efficiently utilizing multi-sensor data for state estimation remains challenging. There is a complex coupling relationship between IMUs’ bias and UAV state. To address these challenges, this paper proposes an efficient and accurate UAV state estimation method tailored for multi-LiDAR–IMU–camera systems. Specifically, we first construct an efficient distributed state estimation model. It decomposes the multi-LiDAR–IMU–camera system into a series of single LiDAR–IMU–camera subsystems, reformulating the complex coupling problem as an efficient distributed state estimation problem. Then, we derive an accurate feedback function to constrain and optimize the UAV state using estimated subsystem states, thus enhancing overall estimation accuracy. Based on this model, we design an efficient distributed state estimation algorithm with multi-LiDAR-IMU-Camerafusion, termed DLIC. DLIC achieves robust multi-sensor data fusion via shared feature maps, effectively improving both estimation robustness and accuracy. In addition, we design an accelerated image-to-point cloud registration module (A-I2P) to provide reliable visual measurements, further boosting state estimation efficiency. Extensive experiments are conducted on 18 real-world indoor and outdoor scenarios from the public NTU VIRAL dataset. The results demonstrate that DLIC consistently outperforms existing multi-sensor methods across key evaluation metrics, including RMSE, MAE, SD, and SSE. More importantly, our method runs in real time on a resource-constrained embedded device equipped with only an 8-core CPU, while maintaining low memory consumption. | |
| 653 | |a Central processing units--CPUs | ||
| 653 | |a Navigation | ||
| 653 | |a Cameras | ||
| 653 | |a Embedded systems | ||
| 653 | |a Feedback | ||
| 653 | |a Image registration | ||
| 653 | |a Optimization | ||
| 653 | |a Sensors | ||
| 653 | |a State estimation | ||
| 653 | |a Feature maps | ||
| 653 | |a Data integration | ||
| 653 | |a Methods | ||
| 653 | |a Registration | ||
| 653 | |a Subsystems | ||
| 653 | |a Inertial platforms | ||
| 653 | |a Lidar | ||
| 653 | |a Real time | ||
| 653 | |a Constraints | ||
| 653 | |a Multisensor fusion | ||
| 653 | |a Coupling | ||
| 700 | 1 | |a An, Pei |u School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China; djfenghust@hust.edu.cn (J.D.); majie@hust.edu.cn (J.M.) | |
| 700 | 1 | |a Yu, Kun |u National Key Laboratory of Science and Technology on Electromagnetic Energy, Naval University of Engineering, Wuhan 430033, China; wh_ykun23@nue.edu.cn | |
| 700 | 1 | |a Ma, Tao |u Institute of Computer Application, China Academy of Engineering Physics, Mianyang 621900, China; whumatao@163.com | |
| 700 | 1 | |a Fang, Bin |u Qingjiang Research Center, Wuhan 430200, China; d201477572@alumni.hust.edu.cn | |
| 700 | 1 | |a Ma, Jie |u School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China; djfenghust@hust.edu.cn (J.D.); majie@hust.edu.cn (J.M.) | |
| 773 | 0 | |t Drones |g vol. 9, no. 12 (2025), p. 823-847 | |
| 786 | 0 | |d ProQuest |t Advanced Technologies & Aerospace Database | |
| 856 | 4 | 1 | |3 Citation/Abstract |u https://www.proquest.com/docview/3286273284/abstract/embedded/7BTGNMKEMPT1V9Z2?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text + Graphics |u https://www.proquest.com/docview/3286273284/fulltextwithgraphics/embedded/7BTGNMKEMPT1V9Z2?source=fedsrch |
| 856 | 4 | 0 | |3 Full Text - PDF |u https://www.proquest.com/docview/3286273284/fulltextPDF/embedded/7BTGNMKEMPT1V9Z2?source=fedsrch |