Combining Neural Gas and Reinforcement Learning for Adaptive Traffic Signal Control

Miletić, Mladen and Ivanjko, Edouard and Mandžuka, Sadko and Koltovska Nechoska, Daniela (2021) Combining Neural Gas and Reinforcement Learning for Adaptive Traffic Signal Control. In: 63rd International Symposium ELMAR-2021.

Text ELMAR2021-GNG-RL_DKN.pdf Download (5MB)

Abstract

Travel time of vehicles in urban traffic networks
can be reduced by using Adaptive Traffic Signal Control (ATSC) to change the signal program according to the current traffic situation. Modern ATSC approaches based on Reinforcement Learning (RL) can learn the optimal signal control policy. While there are multiple RL based ATSC implementations available, most suffer from high state-action complexity leading to slow convergence and long training time. In this paper, the state action complexity of ATSC based RL is reduced by implementing Growing Neural Gas learning structure as an integral part of RL, leading to high convergence rate and system stability.
The presented approach is evaluated on a simulated signalized intersection, and compared with self-organizing map RL-based ATSC systems. Obtained results prove that the reduction of state action complexity in this manner improves the effectiveness of RL based ATSC not needing to have an a priory analysis of needed number of neurons for state representation.

Keywords—Intelligent Transportation Systems; Adaptive Traffic Signal Control; Reinforcement Learning; Growing Neural Gas; Machine Learning

Item Type:	Conference or Workshop Item (Paper)
Subjects:	Scientific Fields (Frascati) > Engineering and Technology > Other engineering and technologies
Divisions:	Faculty of Technical Sciences
Depositing User:	Prof. d-r. Daniela Koltovska Nechoska
Date Deposited:	09 Nov 2021 10:56
Last Modified:	09 Nov 2021 10:56
URI:	https://eprints.uklo.edu.mk/id/eprint/6608

Actions (login required)

View Item