Ramp Metering Control Based on the Q-Learning Algorithm

Ivanjko, Edouard and Koltovska Nechoska, Daniela and Gregurić, Martin and Vujić, Miroslav and Jurković, Goran and Mandžuka, Sadko (2015) Ramp Metering Control Based on the Q-Learning Algorithm. Cybernetics and Information Technologies, 15 (5). ISSN 1314-4081

[thumbnail of 7_Ed_Ivanjko-CIT-Autonomic-Q-learning-2014-11-10-edited-md-Gotovo.pdf] Text

Download (454kB)


Modern urban highways are under the influence of increased traffic demand and cannot fulfill the desired level of service anymore. In most of the cases there is no space available for any infrastructure building. Solutions from the domain of intelligent transport systems are used, such as ramp metering. To cope with the significant daily changes of the traffic demand, various approaches with autonomic properties like self-learning are applied for ramp metering. One of these approaches is reinforced learning. In this paper the Q-Learning algorithm is applied to learn the local ramp metering control law in a simulation environment, implemented in a VISSIM microscopic simulator. The approach proposed is tested in simulations with emphasis on the mainstream speed and travel time, using a typical on-ramp configuration.

Item Type: Article
Subjects: Scientific Fields (Frascati) > Engineering and Technology > Other engineering and technologies
Divisions: Faculty of Technical Sciences
Depositing User: Prof. d-r. Daniela Koltovska Nechoska
Date Deposited: 15 Sep 2020 07:05
Last Modified: 13 Oct 2020 08:53
URI: https://eprints.uklo.edu.mk/id/eprint/5725

Actions (login required)

View Item View Item