19th AIAI 2023, 14 - 17 June 2023, León, Spain

Decentralized Multi Agent Deep Reinforcement Q-learning for Intelligent Traffic Controller

Thamilselvam B, Subrahmanyam Kalyanasundaram, M.V. Panduranga Rao

Abstract:

  Recent development of deep reinforcement learning models has impacted many fields, especially decision based control systems. Urban traffic signal control is one of the most decision based control systems that minimizes traffic congestion as well as overall traffic delay. In this work, we use a decentralized multi-agent reinforcement learning model represented by a novel state and reward function. In comparison to other single agent models reported in literature, this approach uses minimal data collection to control the traffic lights. Our model is assessed using traffic data that has been synthetically generated. Additionally, we compare the outcomes to those of existing models and employ the Monaco SUMO Traffic (MoST) Scenario to examine real-time traffic data. Finally, we use statistical model checking (specifically, the MultiVeStA) to check performance properties. Our model works well in all synthetic generated data and real time data.  

*** Title, author list and abstract as seen in the Camera-Ready version of the paper that was provided to Conference Committee. Small changes that may have occurred during processing by Springer may not appear in this window.