A Hybrid Single-Shot Vision-AI and Geospatial Framework for Multimodal Infrastructure Degradation Mapping in Urban Networks
DOI:
https://doi.org/10.51903/dza92157Keywords:
Digital Twin, Edge Computing, Geospatial Analysis, Infrastructure Inspection, Object DetectionAbstract
Conventional transportation infrastructure inspection is often labor-intensive, time-consuming, and limited to individual asset types, reducing the efficiency of large-scale infrastructure management. This study proposes a hybrid Vision-AI and geospatial framework for automated multimodal infrastructure deterioration detection and digital asset monitoring. The framework integrates a YOLO-based object detection model, edge computing, geospatial synchronization, and a Digital Twin Web-GIS platform to detect, localize, and visualize infrastructure defects in real time. Experimental evaluation under multiple environmental conditions demonstrated stable detection performance, achieving 95.1% Precision, 94.3% Recall, 94.7% F1-score, and 96.4% [email protected] under daylight conditions while maintaining reliable accuracy under shadowed, wet, and low-light environments. Edge deployment on the NVIDIA Jetson Orin Nano also provided low-latency inference suitable for real-time field applications. The novelty of this research lies in the integration of multimodal Vision-AI defect detection, edge computing, geospatial synchronization, and Digital Twin visualization within a unified framework capable of simultaneously monitoring heterogeneous transportation infrastructure assets. This study contributes by addressing the research gap between AI-based inspection and spatial asset management while providing an operational framework for automated maintenance decision support. The results demonstrate that integrating artificial intelligence with geospatial technologies can improve the accuracy, efficiency, and scalability of intelligent transportation infrastructure inspection and management.
Downloads
References
Costa, D. G., Bittencourt, J. C. N., Oliveira, F., Peixoto, J. P., & Jesus, T. C. (2024). Achieving Sustainable Smart Cities through Geospatial Data-Driven Approaches. Sustainability, 16(2), 640. https://doi.org/10.3390/su16020640
Dritsas, E., & Trigka, M. (2025). Remote Sensing and Geospatial Analysis in the Big Data Era: A Survey. Remote Sensing, 17(3), 550. https://doi.org/10.3390/rs17030550
Duran, B., Eftekhar Azam, S., & Sanayei, M. (2024). Leveraging Deep Learning for Robust Structural Damage Detection and Classification: A Transfer Learning Approach via CNN. Infrastructures, 9(12), 229. https://doi.org/10.3390/infrastructures9120229
Gao, Y., Xiong, G., Hu, Z., Chai, C., & Li, H. (2024). Bridge Digital Twin for Practical Bridge Operation and Maintenance by Integrating GIS and BIM. Buildings, 14(12), 3731. https://doi.org/10.3390/buildings14123731
Haji Mohd, M. N., Mohd Asaari, M. S., Lay Ping, O., & Rosdi, B. A. (2023). Vision-Based Hand Detection and Tracking Using Fusion of Kernelized Correlation Filter and Single-Shot Detection. Applied Sciences, 13(13), 7433. https://doi.org/10.3390/app13137433
James, E., & Martinez, S. (2025). Multi-Agent AI Simulation for Evaluating Sustainability of Urban Transportation Infrastructure. Civil Engineering Science and Technology, 1(2), 186–202. https://doi.org/10.51903/tx30kz14
Ji, Y., Zhang, D., He, Y., Zhao, J., Duan, X., & Zhang, T. (2025). Improved YOLO11 Algorithm for Insulator Defect Detection in Power Distribution Lines. Electronics, 14(6), 1201. https://doi.org/10.3390/electronics14061201
Kazanskiy, N., Khabibullin, R., Nikonorov, A., & Khonina, S. (2025). A Comprehensive Review of Remote Sensing and Artificial Intelligence Integration: Advances, Applications, and Challenges. Sensors, 25(19), 5965. https://doi.org/10.3390/s25195965
Khan, Z., Shen, Y., & Liu, H. (2025). ObjectDetection in Agriculture: A Comprehensive Review of Methods, Applications, Challenges, and Future Directions. Agriculture, 15(13), 1351. https://doi.org/10.3390/agriculture15131351
Kim, J.-W., Choi, H.-W., Kim, S.-K., & Na, W. S. (2024). Review of Image-Processing-Based Technology for Structural Health Monitoring of Civil Infrastructures. Journal of Imaging, 10(4), 93. https://doi.org/10.3390/jimaging10040093
Li, H., Cheng, H., Niu, Q., Li, C., Wang, L., He, X., Yang, Y., & Wang, P. (2026). Small Target Detection in Agricultural Visual Perception: Progress and Challenges. Agriculture, 16(13), 1366. https://doi.org/10.3390/agriculture16131366
Liang, B., Li, Z., Xu, M., Xiao, J., & Long, H. (2024). Study on the Design Parameters of Landscape Elements of Urban Tunnel Body Segments in China Based on Biomass Perception. Applied Sciences, 14(14), 6100. https://doi.org/10.3390/app14146100
Liu, C., Zhang, S., Hu, M., & Song, Q. (2024). Object Detection in Remote Sensing Images Based on Adaptive Multi-Scale Feature Fusion Method. Remote Sensing, 16(5), 907. https://doi.org/10.3390/rs16050907
Liu, H., Fu, Y., Ma, Y., & Zhang, W. (2025). Multimodal Fusion and Dynamic Resource Optimization for Robust Cooperative Localization of Low-Cost UAVs. Drones, 9(12), 820. https://doi.org/10.3390/drones9120820
Lv, Z., Hao, Z., Zhu, Y., & Lu, C. (2025). A Review on Automated Detection and Identification Algorithms for Highway Pavement Distress. Applied Sciences, 15(11), 6112. https://doi.org/10.3390/app15116112
Ma, J., Yang, Q., Peng, X., & Xia, K. (2025). Review on Durability Deterioration and Mitigation of Concrete Structures. Coatings, 15(9), 982. https://doi.org/10.3390/coatings15090982
Mohammadi, S., Sattarpanah Karganroudi, S., & Rahmanian, V. (2025). Advancements in Smart Nondestructive Evaluation of Industrial Machines: A Comprehensive Review of Computer Vision and AI Techniques for Infrastructure Maintenance. Machines, 13(1), 11. https://doi.org/10.3390/machines13010011
Nugroho, A. S., & Wibowo, M. C. (2024). Design and Implementation of Animated Stickers as an Educational Tool for Adolescent Drug Awareness Using the MDLC Method. International Journal of Graphic Design, 2(2), 195–206. https://doi.org/10.51903/ijgd.v2i2.2114
Ozturk, H. Y., & Zappa, E. (2025). Automated Crack Width Measurement in 3D Models: A Photogrammetric Approach with Image Selection. Information, 16(6), 448. https://doi.org/10.3390/info16060448
Sanz Bobi, J. D., Garrido Martínez-Llop, P., Rubio Marcos, P., Solano Jiménez, Á., & Fernández, J. G. (2024). Prediction of Degraded Infrastructure Conditions for Railway Operation. Sensors, 24(8), 2456. https://doi.org/10.3390/s24082456
Schatzl, J., Korenjak, A. K., Gerhold, F., & Marschnig, S. (2026). Integrating Railway Infrastructure Data: A Spatial–Temporal Database for Track Deterioration Analysis. Applied Sciences, 16(13), 6544. https://doi.org/10.3390/app16136544
Syafril, M., Arief, S., & Pangaribuan, J. D. (2025). Application of Digital Twin Technology for Real-Time Monitoring and Predictive Maintenance of Coastal Bridges under Climate Change Scenarios. Jurnal Rekayasa Sipil Dan Arsitektur, 1(2), 39–51. https://doi.org/10.51903/5fkqb467
Torbali, M. E., Zolotas, A., & Avdelidis, N. P. (2023). A State-of-the-Art Review of Non-Destructive Testing Image Fusion and Critical Insights on the Inspection of Aerospace Composites towards Sustainable Maintenance Repair Operations. Applied Sciences, 13(4), 2732. https://doi.org/10.3390/app13042732
Trigka, M., & Dritsas, E. (2025). A Comprehensive Survey of Deep Learning Approaches in Image Processing. Sensors, 25(2), 531. https://doi.org/10.3390/s25020531
Yuan, Q., Shi, Y., & Li, M. (2024). A Review of Computer Vision-Based Crack Detection Methods in Civil Infrastructure: Progress and Challenges. Remote Sensing, 16(16), 2910. https://doi.org/10.3390/rs16162910
Zaroujtaghi, A., Mansourihanis, O., Tayarani, M., Mansouri, F., Hemmati, M., & Soltani, A. (2025). A Systematic Review of GIS Evolution in Transportation Planning: Towards AI Integration. Future Transportation, 5(3), 97. https://doi.org/10.3390/futuretransp5030097
Zhang, H., Dong, Y., Hou, Y., Cheng, X., Xie, P., & Di, K. (2025). Research on Asphalt Pavement Surface Distress Detection Technology Coupling Deep Learning and Object Detection Algorithms. Infrastructures, 10(4), 72. https://doi.org/10.3390/infrastructures10040072
Downloads
Published
Issue
Section
License
Copyright (c) 2026 Civil Engineering Science and Technology
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
