TY - GEN
T1 - Transfer Learning Method in Reinforcement Learning-based Traffic Signal Control
AU - Mao, Zhenyu
AU - Li, Jialong
AU - Zheng, Nianzhao
AU - Tei, Kenji
AU - Honiden, Shinichi
N1 - Funding Information:
The research was partially supported by JSPS KAKENHI.
Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Traffic signal control is becoming more important in intelligent transport systems. Existing studies managed to increase the traffic efficiency on the assumption of a stable traffic environment where no emergencies occur. However, accidents and road closures happen from time to time, and the existing studies cannot guarantee efficiency when such temporary changes happen in the road conditions. Thus, we designed a transfer learning method for existing reinforcement learning-based traffic signal control systems. Our proposed method uses parameters from the previous training model to initialize the new model to increase its initial performance, thus speeding up the learning process and reducing the time needed to adapt to road condition changes.
AB - Traffic signal control is becoming more important in intelligent transport systems. Existing studies managed to increase the traffic efficiency on the assumption of a stable traffic environment where no emergencies occur. However, accidents and road closures happen from time to time, and the existing studies cannot guarantee efficiency when such temporary changes happen in the road conditions. Thus, we designed a transfer learning method for existing reinforcement learning-based traffic signal control systems. Our proposed method uses parameters from the previous training model to initialize the new model to increase its initial performance, thus speeding up the learning process and reducing the time needed to adapt to road condition changes.
KW - intelligent transport systems
KW - reinforcement learning
KW - traffic signal control
KW - transfer learning
UR - http://www.scopus.com/inward/record.url?scp=85123462746&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85123462746&partnerID=8YFLogxK
U2 - 10.1109/GCCE53005.2021.9621842
DO - 10.1109/GCCE53005.2021.9621842
M3 - Conference contribution
AN - SCOPUS:85123462746
T3 - 2021 IEEE 10th Global Conference on Consumer Electronics, GCCE 2021
SP - 304
EP - 307
BT - 2021 IEEE 10th Global Conference on Consumer Electronics, GCCE 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 10th IEEE Global Conference on Consumer Electronics, GCCE 2021
Y2 - 12 October 2021 through 15 October 2021
ER -