Application of Reinforcement Learning as a Tool of Adaptive Traffic Signal Control on Isolated Intersections

Bombol, Kristi and Koltovska Nechoska, Daniela and Veljanovska, Kostandina Application of Reinforcement Learning as a Tool of Adaptive Traffic Signal Control on Isolated Intersections. In: International Conference on Traffic and Transportation Engineering ICTTE 2011, Dubai.

Text ICTTE 2011.pdf Download (301kB)

Abstract

A large number of intelligent systems have been improved and adapted to the flow changes as well as for effective management of the signal time changes.
For a long time it was believed that the systems responding to real time traffic would enable significant benefits. However, numerous limitations have appeared such as the existence of the models with high level of detail precision, the uncertainty in predicting future traffic flows, the difficulty in arrival time estimation, the lack of self-adjusting mechanism.
The difficulties in optimising the signal control strategy and the importance of finding a solution to this problem have initiated a great number of new researches. The results highlight the artificial intelligence methods as a possible solution. It has been determined that the artificial intelligent systems achieve the same results that man does when performing cognitive tasks. These systems are characterized with the ability to accumulate and use knowledge, set a problem, learn, process, conclude, solve the problem and exchange knowledge.
The research presented in this paper proposes an adaptive signal control performed by a control agent able to adapt to an optimal policy by learning from the environment. The goal to be achieved is minimization of the delays in the system.
First, the problem of reinforcement learning has been set. The first computation results of the Q-learning application for adaptive traffic signal control are presented.
It is concluded that the results obtained are in favor of the adaptive signal control strategy compared to the fixed and actuated signal control.

Item Type:	Conference or Workshop Item (Paper)
Subjects:	Scientific Fields (Frascati) > Engineering and Technology > Other engineering and technologies
Divisions:	Faculty of Technical Sciences
Depositing User:	Prof. d-r. Daniela Koltovska Nechoska
Date Deposited:	15 Sep 2020 07:07
Last Modified:	13 Oct 2020 08:58
URI:	https://eprints.uklo.edu.mk/id/eprint/5741

Actions (login required)

View Item