Hierarchal Clusters Based Traffic Control System

Document Type : Original Article

Authors

1 Dept. of Computer Science and Eng., Faculty of Elect., Eng., Menoufia University

2 Computer science and Engineering, Faculty of Electronic Engineering, Menoufia University, Menouf 32952, Egypt.

Abstract

Traffic jam is a crucial issue affecting cities around the world. They are only getting worse as the population and number of vehicles continues to increase significantly. Traffic signal controllers are considered as the most important mechanism to control the traffic, specifically at intersections, the field of Machine Learning offers more advanced techniques which can be applied to provide more flexibility and make the controllers more adaptive to the traffic state. Efficient and adaptive traffic controllers can be designed using a multi-agent reinforcement learning approach, in which, each controller is considered as an agent and is responsible for controlling traffic lights around a single junction. A major problem of reinforcement learning approach is the need for coordination between agents and exponential growth in the state-action space. This paper proposes using machine learning clustering algorithm, namely, hierarchal clustering, in order to divide the targeted network into smaller sub-networks, using real traffic data of 65 intersection of the city of Ottawa to build our simulations, the paper shows that applying the proposed methodology helped solving the curse of dimensionality problem and improved the overall network performance.

Keywords

Main Subjects


[1]Kuyer, Lior, et al. "Multiagent reinforcement learning for urban traffic control using coordination graphs." Machine Learning and Knowledge Discovery in Databases. Springer Berlin Heidelberg, 2008. 656-671.
[2] El-Tantawy, Samah, BaherAbdulhai, and HossamAbdelgawad. "Multiagent reinforcement learning for integrated network of adaptive traffic signal controllers (MARLIN-ATSC):
methodology and large-scale application on downtown
toronto." Intelligent Transportation Systems, IEEE Transactions
on14.3 (2013): 1140-1150.
[3] Labadie, John W. "Advances in Water Resources Systems
Engineering: Applications of Machine Learning." Modern Water
Resources Engineering. Humana Press, 2014. 467-523.
[4] Messer, Carroll J., and Ramanan V. Nageswara. Improved
Traffic Signal Coordination Strategies for Actuated Control. No.
[5] Vital, Allan Saldanha, et al. "Development of Intelligenet traffic
Lights using Multi Agent Systems." 12th WCTR july 11-15,
2010 lisbon, portugal
[6] Almejalli, Khaled, KeshavDahal, and M. AlamgirHossain.
"Intelligent traffic control decision support
system." Applications of Evolutionary Computing. Springer
Berlin Heidelberg, 2007. 688-701.
[7] Wiering, M. (2000, June). Multi-agent reinforcement learning
for traffic light control. In ICML (pp. 1151-1158).
SWITCH/96/465110-1. Southwest Region University
Transportation Center, Center for Transportation Research,
University of Texas, 1996
[8] Cichosz, Pawel. Data Mining Algorithms: Explained Using R.
John Wiley & Sons, 2015.
[9] McKenney, Dave, and Tony White. "Distributed and adaptive
traffic signal control within a realistic traffic
simulation." Engineering Applications of Artificial
Intelligence 26.1 (2013): 574-583.
[10] Behrisch, Michael, et al. "SUMO–Simulation of Urban
MObility." The Third International Conference on Advances in
System Simulation (SIMUL 2011), Barcelona, Spain. 2011.
[11] Wu, Xiaoping, et al. "Green-Wave Traffic Theory Optimization
and Analysis." World Journal of Engineering and
Technology 2.03 (2014): 14.
[12] Tan, Ming. "Multi-agent reinforcement learning: Independent
vs. cooperative agents." Proceedings of the tenth international
conference on machine learning. 1993.
[13] Jain, Anil K., and Richard C. Dubes. Algorithms for clustering
data. Prentice-Hall, Inc., 1988.
[14] Jain, Anil K., M. NarasimhaMurty, and Patrick J. Flynn. "Data
clustering: a review." ACM computing surveys (CSUR) 31.3
(1999): 264-323.
[15] Carbonell, Jaime G., Ryszard S. Michalski, and Tom M.
Mitchell. "An overview of machine learning." Machine learning.
Springer Berlin Heidelberg, 1983. 3-23.
[16] Whitehead, Steven D. "A Complexity Analysis of Cooperative
Mechanisms in Reinforcement Learning." AAAI. 1991.
[17] Balaji, P. G., X. German, and D. Srinivasan. "Urban traffic
signal control using reinforcement learning agents." IET
Intelligent Transport Systems 4.3 (2010): 177-188.
[18] OpenStreetMap, February2011.
/http://www.openstreetmap.orgS.
[19] Comparing different techniques for controlling traffic signals
vol 7 No.3 2016
[20] Mousavi, SeyedSajad, et al. "Traffic Light Control Using Deep
Policy-Gradient and Value-Function Based Reinforcement
Learning." arXiv preprint arXiv:1704.08883 (2017).
[21] Watkins, Christopher JCH, and Peter Dayan. "Qlearning."
Machine learning 8, no. 3-4 (1992): 279-292.
[22] Sutton, Richard S., and Andrew G. Barto. Reinforcement
learning: An introduction. MIT press, 1998.
[23] García-Nieto, José, Enrique Alba, and A. Carolina Olivera.
"Swarm intelligence for traffic light scheduling: Application to
real urban areas." Engineering Applications of Artificial
Intelligence 25, no. 2 (2012): 274-283.
[24] Passos, Lúcio Sanchez, and Rosaldo Rossetti. "Traffic light
control using reactive agents." In Information Systems and
Technologies (CISTI), 2010 5th Iberian Conference on, pp. 1-6.
IEEE, 2010.
[25] Lin, Yilun, Xingyuan Dai, Li Li, and Fei-Yue Wang. "An Efficient
Deep Reinforcement Learning Model for Urban Traffic
Control." arXiv preprint arXiv:1808.01876 (2018).