Testing Autonomous Vehicles in Virtual Environments: A Review of Simulation Tools and Techniques
Abstract
Autonomous vehicles (AVs) have the potential to transform the transportation industry by improving road safety, reducing traffic congestion, and enhancing fuel efficiency. Significant progress has been made in autonomous vehicle (AV) technologies, especially in sensor systems, machine learning, and artificial intelligence. These advancements enable vehicles to navigate complex environments and make real-time decisions. Despite these advancements, numerous challenges remain in ensuring the safety, reliability, and acceptance of AVs. Key issues include sensor fusion, the ability to handle unpredictable scenarios, the development of universally accepted regulatory frameworks, and public trust in autonomous systems. Furthermore, ethical dilemmas, such as decision-making in unavoidable accident situations, present additional concerns. The deployment of AVs also raises questions about the impact on employment in driving-dependent industries and the infrastructure needed to support these technologies. This paper reviews the current state of AV development, examining the progress made in simulation-based testing, sensor technology, and decision-making algorithms. Additionally, it discusses the challenges that still need to be addressed, including safety concerns, regulatory barriers, and societal implications. The paper concludes by outlining potential areas for future research, such as improving sensor reliability, enhancing machine learning algorithms, integrates an analysis of simulation-based testing, decision-making algorithms, and sensor technologies with a forward-looking discussion on legal frameworks, public trust, and employment impacts, offering a holistic perspective on the path toward AV integration.
Keywords
Full Text:
PDFReferences
D. Parekh, N. Poddar, A. Rajpurkar, M. Chahal, N. Kumar, G. P. Joshi, and W. Cho, “A review on autonomous vehicles: Progress, methods and challenges,” Electronics, vol. 11, no. 14, p. 2162, 2022, https://doi.org/10.3390/electronics11142162.
J. Wang, L. Zhang, Y. Huang, and J. Zhao, “Safety of autonomous vehicles,” Journal of advanced transportation, vol. 2020, no. 1, p. 8867757, 2020, https://doi.org/10.1155/2020/8867757.
S. Malik, M. A. Khan, H. El-Sayed, J. Khan, and O. Ullah, “How do autonomous vehicles decide?,” Sensors, vol. 23, no. 1, p. 317, 2022, https://doi.org/10.3390/s23010317.
G. Bathla et al., “Autonomous vehicles and intelligent automation: Applications, challenges, and opportunities,” Mobile Information Systems, vol. 2022, no. 1, p. 7632892, 2022, https://doi.org/10.1155/2022/7632892.
K. Othman, “Exploring the implications of autonomous vehicles: A comprehensive review,” Innovative Infrastructure Solutions, vol. 7, no. 2, p. 165, 2022, https://doi.org/10.1007/s41062-022-00763-6.
P. Jing, H. Hu, F. Zhan, Y. Chen, and Y. Shi, “Agent-based simulation of autonomous vehicles: A systematic literature review,” IEEE Access, vol. 8, pp. 79089-79103, 2020, https://doi.org/10.1109/ACCESS.2020.2990295.
J. Li, E. Rombaut, and L. Vanhaverbeke, “A systematic review of agent-based models for autonomous vehicles in urban mobility and logistics: Possibilities for integrated simulation models,” Computers, Environment and Urban Systems, vol. 89, p. 101686, 2021, https://doi.org/10.1016/j.compenvurbsys.2021.101686.
A. Uzzaman and W. Muhammad, “A Comprehensive Review of Environmental and Economic Impacts of Autonomous Vehicles,” Control Systems and Optimization Letters, vol. 2, no. 3, pp. 303-309, 2024, https://doi.org/10.59247/csol.v2i3.131.
B. Ben Elallid, M. Bagaa, N. Benamar, and N. Mrani, “A reinforcement learning based autonomous vehicle control in diverse daytime and weather scenarios,” Journal of Intelligent Transportation Systems, pp. 1-14, 2024, https://doi.org/10.1080/15472450.2024.2370010.
P. Aryal, “Optimization of geometric road design for autonomous vehicle,” Dissertation, 2020, https://www.diva-portal.org/smash/record.jsf?pid=diva2%3A1527750.
I. Fursa et al., “Worsening perception: Real-time degradation of autonomous vehicle perception performance for simulation of adverse weather conditions,” arXiv, 2021, https://doi.org/10.4271/12-05-01-0008.
A. Giannaros et al., “Autonomous vehicles: Sophisticated attacks, safety issues, challenges, open topics, blockchain, and future directions,” Journal of Cybersecurity and Privacy, vol. 3, no. 3, pp. 493-543, 2023, https://doi.org/10.3390/jcp3030025.
Y. Su and L. Wang, “Integrated framework for test and evaluation of autonomous vehicles,” Journal of Shanghai Jiaotong University (Science), vol. 26, pp. 699-712, 2021, https://doi.org/10.1007/s12204-021-2360-y.
D. J. Fremont et al., “Formal scenario-based testing of autonomous vehicles: From simulation to the real world,” 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pp. 1-8, 2020, https://doi.org/10.1109/ITSC45102.2020.9294368.
J. Vargas, S. Alsweiss, O. Toker, R. Razdan, and J. Santos, “An overview of autonomous vehicles sensors and their vulnerability to weather conditions,” Sensors, vol. 21, no. 16, p. 5397, 2021, https://doi.org/10.3390/s21165397.
Y. Fu, C. Li, F. R. Yu, T. H. Luan, and Y. Zhang, “A decision-making strategy for vehicle autonomous braking in emergency via deep reinforcement learning,” IEEE transactions on vehicular technology, vol. 69, no. 6, pp. 5876-5888, 2020, https://doi.org/10.1109/TVT.2020.2986005.
M. N. Ahangar, Q. Z. Ahmed, F. A. Khan, and M. Hafeez, “A survey of autonomous vehicles: Enabling communication technologies and challenges,” Sensors, vol. 21, no. 3, p. 706, 2021, https://doi.org/10.3390/s21030706.
Y. Chen, S. Chen, T. Xiao, S. Zhang, Q. Hou and N. Zheng, "Mixed Test Environment-based Vehicle-in-the-loop Validation - A New Testing Approach for Autonomous Vehicles," 2020 IEEE Intelligent Vehicles Symposium (IV), pp. 1283-1289, 2020, https://doi.org/10.1109/IV47402.2020.9304658.
R. Nadafianshahamabadi, M. Tayarani, and G. Rowangould, “A closer look at urban development under the emergence of autonomous vehicles: Traffic, land use and air quality impacts,” Journal of transport geography, vol. 94, p. 103113, 2021, https://doi.org/10.1016/j.jtrangeo.2021.103113.
Q. A. Al-Haija, M. Gharaibeh, and A. Odeh, “Detection in adverse weather conditions for autonomous vehicles via deep learning,” Ai, vol. 3, no. 2, pp. 303-317, 2022, https://doi.org/10.3390/ai3020019.
Y. Zhang, A. Carballo, H. Yang, and K. Takeda, “Perception and sensing for autonomous vehicles under adverse weather conditions: A survey,” ISPRS Journal of Photogrammetry and Remote Sensing, vol. 196, pp. 146-177, 2023, https://doi.org/10.1016/j.isprsjprs.2022.12.021.
A. P. Carrone, J. Rich, C. A. Vandet, and K. An, “Autonomous vehicles in mixed motorway traffic: capacity utilisation, impact and policy implications,” Transportation, pp. 1-32, 2021, https://doi.org/10.1007/s11116-020-10154-4.
K. Aswal, H. Pathak, N. Singh, and N. Gupta, “Strength and Limitations of Publicly Available Anti-Malware Tools Against Obfuscated Malware,” 2023 5th International Conference on Inventive Research in Computing Applications (ICIRCA), pp. 1261-1266, 2023, https://doi.org/10.1109/ICIRCA57980.2023.10220600.
B. Martínez-Rodríguez, S. Bilbao-Arechabala, and F. Jorge-Hernandez, “Security architecture for swarms of autonomous vehicles in smart farming,” Applied sciences, vol. 11, no. 10, p. 4341, 2021, https://doi.org/10.3390/app11104341.
H. Alghodhaifi and S. Lakshmanan, “Autonomous vehicle evaluation: A comprehensive survey on modeling and simulation approaches,” IEEE Access, vol. 9, pp. 151531-151566, 2021, https://doi.org/10.1109/ACCESS.2021.3125620.
Z. Ghodsi et al., “Generating and characterizing scenarios for safety testing of autonomous vehicles,” 2021 IEEE Intelligent Vehicles Symposium (IV), pp. 157-164, 2021, https://doi.org/10.1109/IV48863.2021.9576023.
S. Chen, Y. Leng, & S. Labi, “A deep learning algorithm for simulating autonomous driving considering prior knowledge and temporal information,” Computer‐Aided Civil and Infrastructure Engineering, vol. 35, no. 4, pp. 305-321, 2020, https://doi.org/10.1111/mice.12495.
P. Kaur, S. Taghavi, Z. Tian, and W. Shi, “A survey on simulators for testing self-driving cars,” 2021 Fourth International Conference on Connected and Autonomous Driving (MetroCAD), pp. 62-70, 2021, https://doi.org/10.1109/MetroCAD51599.2021.00018.
D. Garikapati, Y. Liu, M. Brown, T. Littlehale, H. Yamamoto and C. Bao, "Dual-Cockpit Human and Hardware-In-the-Loop Test Bench for Autonomous Vehicle Development," IEEE Transactions on Intelligent Vehicles, 2024, https://doi.org/10.1109/TIV.2024.3401086.
K. M. Cime et al., “Hardware-in-the-Loop, Traffic-in-the-Loop and Software-in-the-Loop Autonomous Vehicle Simulation for Mobility Studies,” SAE Technical Paper 2020-01-0704, 2020, https://doi.org/10.4271/2020-01-0704.
J. Dillmann et al., “Keeping the driver in the loop in conditionally automated driving: A perception-action theory approach,” Transportation research part F: traffic psychology and behaviour, vol. 79, pp. 49-62, 2021, https://doi.org/10.1016/j.trf.2021.03.003.
Y. Chung and Y. P. Yang, “Hardware-in-the-loop simulation of self-driving electric vehicles by dynamic path planning and model predictive control,” Electronics, vol. 10, no. 19, p. 2447, 2021, https://doi.org/10.3390/electronics10192447.
D. Bruggner, A. Hegde, F. S. Acerbo, D. Gulati and T. D. Son, "Model in the Loop Testing and Validation of Embedded Autonomous Driving Algorithms," 2021 IEEE Intelligent Vehicles Symposium (IV), pp. 136-141, 2021, https://doi.org/10.1109/IV48863.2021.9575530.
S. Bhaskaran, “Software-in-the-loop testing for autonomous vehicles with docker,” Dept. Electr. Eng. Comput. Sci., Univ. California, Berkeley, CA, USA, Rep. UCB/EECS-2022-135, 2022, https://www2.eecs.berkeley.edu/Pubs/TechRpts/2022/EECS-2022-135.html.
I. D. Buzdugan, S. Butnariu, I. A. Roșu, A. C. Pridie, and C. Antonya, “Personalized driving styles in safety-critical scenarios for autonomous vehicles: an approach using driver-in-the-loop simulations,” Vehicles, vol. 5, no. 3, pp. 1149-1166, 2023, https://doi.org/10.3390/vehicles5030064.
T. Getahun and A. Karimoddini, "An Integrated Vision-Based Perception and Control for Lane Keeping of Autonomous Vehicles," IEEE Transactions on Intelligent Transportation Systems, vol. 25, no. 8, pp. 9001-9015, 2024, https://doi.org/10.1109/TITS.2024.3376516.
Y. Li and J. Ibanez-Guzman, "Lidar for Autonomous Driving: The Principles, Challenges, and Trends for Automotive Lidar and Perception Systems," IEEE Signal Processing Magazine, vol. 37, no. 4, pp. 50-61, 2020, https://doi.org/10.1109/MSP.2020.2973615.
A. K. Aggarwal, “GPS-based localization of autonomous vehicles,” Autonomous Driving and Advanced Driver-Assistance Systems (ADAS), pp. 437-448, 2021, https://doi.org/10.1201/9781003048381-24.
E. Besenval. Hardware-in-the-Loop for the Whole Vehicle Development Process. (Doctoral dissertation, Politecnico di Torino), 2025, http://webthesis.biblio.polito.it/id/eprint/35021.
G. Silano, P. Oppido and L. Iannelli, "Software-in-the-loop simulation for improving flight control system design: a quadrotor case study," 2019 IEEE International Conference on Systems, Man and Cybernetics (SMC), pp. 466-471, 2019, https://doi.org/10.1109/SMC.2019.8914154.
K. Cammaerts, P. Morse, and K. Kidera, “Improving performance through the use of driver-in-the-loop simulations,” ATZ worldwide, vol. 121, no. 1, pp. 52-57, 2019, https://doi.org/10.1007/s38311-018-0198-1.
D. J. Yeong, G. Velasco-Hernandez, J. Barry, and J. Walsh, “Sensor and sensor fusion technology in autonomous vehicles: A review,” Sensors, vol. 21, no. 6, p. 2140, 2021, https://doi.org/10.3390/s21062140.
W. Farag, “Kalman-filter-based sensor fusion applied to road-objects detection and tracking for autonomous vehicles,” Proceedings of the Institution of Mechanical Engineers, Part I: Journal of Systems and Control Engineering, vol. 235, no. 7, pp. 1125-1138, 2021, https://doi.org/10.1177/0959651820975523.
A. Stateczny, M. Wlodarczyk-Sielicka, and P. Burdziakowski, “Sensors and sensor’s fusion in autonomous vehicles,” Sensors, vol. 21, no. 19, p. 6586, 2021, https://doi.org/10.3390/s21196586.
H. D. Nguyen, M. Choi, and K. Han, “Risk-informed decision-making and control strategies for autonomous vehicles in emergency situations,” Accident Analysis & Prevention, vol. 193, p. 107305, 2023, https://doi.org/10.1016/j.aap.2023.107305.
Ó. Pérez-Gil, R. Barea, E. López-Guillén, L. M. Bergasa, C. Gómez-Huélamo, R. Gutiérrez, and A. Díaz-Díaz, “Deep reinforcement learning based control for Autonomous Vehicles in CARLA,” Multimedia Tools and Applications, vol. 81, no. 3, pp. 3553-3576, 2022, https://doi.org/10.1007/s11042-021-11437-3.
G. Rong et al., "LGSVL Simulator: A High Fidelity Simulator for Autonomous Driving," 2020 IEEE 23rd International Conference on Intelligent Transportation Systems (ITSC), pp. 1-6, 2020, https://doi.org/10.1109/ITSC45102.2020.9294422.
U. Gazder, K. Alhalabi, and O. AlAzzawi, “Calibration of autonomous vehicles in PTV VISSIM,” 3rd Smart Cities Symposium (SCS 2020), vol. 2020, pp. 39-42, 2020, https://doi.org/10.1049/icp.2021.0752.
L. Cao, X. Feng, J. Liu, and G. Zhou, “Automatic Generation System for Autonomous Driving Simulation Scenarios Based on PreScan,” Applied Sciences, vol. 14, no. 4, p. 1354, 2024, https://doi.org/10.3390/app14041354.
H. Sadid and C. Antoniou, “Modelling and simulation of (connected) autonomous vehicles longitudinal driving behavior: A state‐of‐the‐art,” IET Intelligent Transport Systems, vol. 17, no. 6, pp. 1051-1071, 2023, https://doi.org/10.1049/itr2.12337.
F. Hauer, T. Schmidt, B. Holzmüller and A. Pretschner, "Did We Test All Scenarios for Automated and Autonomous Driving Systems?," 2019 IEEE Intelligent Transportation Systems Conference (ITSC), Auckland, New Zealand, 2019, pp. 2950-2955, 2019, https://doi.org/10.1109/ITSC.2019.8917326.
M. Malayjerdi, V. Kuts, R. Sell, T. Otto, and B. C. Baykara, “Virtual simulations environment development for autonomous vehicles interaction,” ASME International Mechanical Engineering Congress and Exposition, vol. 84492, p. V02BT02A009, 2020, https://doi.org/10.1115/IMECE2020-23362.
Y. Lu, H. Ma, E. Smart and H. Yu, "Real-Time Performance-Focused Localization Techniques for Autonomous Vehicle: A Review," IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 7, pp. 6082-6100, 2022, https://doi.org/10.1109/TITS.2021.3077800.
H. Wang et al., "Risk Assessment and Mitigation in Local Path Planning for Autonomous Vehicles With LSTM Based Predictive Model," IEEE Transactions on Automation Science and Engineering, vol. 19, no. 4, pp. 2738-2749, 2022, https://doi.org/10.1109/TASE.2021.3075773.
M. Garg and M. Bouroche, "Can Connected Autonomous Vehicles Improve Mixed Traffic Safety Without Compromising Efficiency in Realistic Scenarios?," IEEE Transactions on Intelligent Transportation Systems, vol. 24, no. 6, pp. 6674-6689, 2023, https://doi.org/10.1109/TITS.2023.3238889.
Q. Lu, T. Tettamanti, D. Hörcher, and I. Varga, “The impact of autonomous vehicles on urban traffic network capacity: an experimental analysis by microscopic traffic simulation,” Transportation Letters, vol. 12, no. 8, pp. 540-549, 2020, https://doi.org/10.1080/19427867.2019.1662561.
M. Carvalho, et al., “Towards a model of snow accretion for autonomous vehicles,” Atmosphere, vol. 15, no. 5, p. 548, 2024, https://doi.org/10.3390/atmos15050548.
B. Feroz, A. Mehmood, H. Maryam, S. Zeadally, C. Maple and M. A. Shah, "Vehicle-Life Interaction in Fog-Enabled Smart Connected and Autonomous Vehicles," IEEE Access, vol. 9, pp. 7402-7420, 2021, https://doi.org/10.1109/ACCESS.2020.3049110.
H. P. Schöner, “Simulation in development and testing of autonomous vehicles,” 18. Internationales Stuttgarter Symposium: Automobil-und Motorentechnik, pp. 1083-1095, 2018, https://doi.org/10.1007/978-3-658-21194-3_82.
A. L. Siegfried, A. Bayne, L. F. Beck, and K. Freund, “Older adult willingness to use fully autonomous vehicle (FAV) ride sharing,” Geriatrics, vol. 6, no. 2, p. 47, 2021, https://doi.org/10.3390/geriatrics6020047.
DOI: https://doi.org/10.59247/csol.v3i2.196
Refbacks
- There are currently no refbacks.
Copyright (c) 2025 Asif Uzzaman