Traffic Theory

Reinforcement Learning Versus PDE Backstepping and PI Control for Congested Freeway Traffic

Yu, Huan
Park, Saehong
Bayen, Alexandre
2022

We develop reinforcement learning (RL) boundary controllers to mitigate stop-and-go traffic congestion on a freeway segment. The traffic dynamics of the freeway segment are governed by a macroscopic Aw–Rascle–Zhang (ARZ) model, consisting of 2 \times 2 quasi-linear partial differential equations (PDEs) for traffic density and velocity. The boundary stabilization of the linearized ARZ PDE model has been solved by PDE backstepping, guaranteeing spatial L<sup>2</sup> norm regulation of the traffic state to uniform density and velocity and ensuring that traffic oscillations are...

Unified Automatic Control of Vehicular Systems With Reinforcement Learning

Yan, Zhongxia
Kreidieh, Abdul Rahman
Vinitsky, Eugene
Bayen, Alexandre M.
2023

Emerging vehicular systems with increasing proportions of automated components present opportunities for optimal control to mitigate congestion and increase efficiency. There has been a recent interest in applying deep reinforcement learning (DRL) to these nonlinear dynamical systems for the automatic design of effective control strategies. Despite conceptual advantages of DRL being model-free, studies typically nonetheless rely on training setups that are painstakingly specialized to specific vehicular systems. This is a key challenge to efficient analysis of diverse vehicular and...

From Sim to Real: A Pipeline for Training and Deploying Traffic Smoothing Cruise Controllers

Lichtle, Nathan
Vinitsky, Eugene
Nice, Matthew
Bhadani, Rahul
Bunting, Matthew
2024

Designing and validating controllers for connected and automated vehicles to enhance traffic flow presents significant challenges, from the complexity of replicating real-world stop-and-go traffic dynamics in simulation, to the intricacies involved in transitioning from simulation to actual deployment. In this work, we present a full pipeline from data collection to controller deployment. Specifically, we collect 772 km of driving data from the I-24 in Tennessee, and use it to build a one-lane simulator, placing simulated vehicles behind real-world trajectories. Using policy-gradient...

Integrating Multi-Source Data for Bi-Level Traffic Simulator Calibration: A Literature Review and Highway Case Study

Samaei, Maryam
Ameli, Mostafa
Davis, Jon F.
McQuade, Sean T.
Lee, Jonathan W.
Piccoli, Benedetto
Bayen, Alexandre M.
2024

Traffic simulation serves as a powerful tool for pre-evaluating policies and technologies. In this context, simulation-based Dynamic traffic assignment (DTA) models are capable of capturing traffic dynamics. They are well-known as critical tools in controlling and predicting traffic situations. The reliability of simulation results heavily depends on the calibration process. Most studies in the literature formulate and calibrate simulators based on a single source of collected data or multiple data sets with the same spatiotemporal characteristics. However, in practice, traffic data is...

Impact of Navigation Apps on Congestion and Spread Dynamics on a Transportation Network

Bagabaldo, Alben Rome
Gan, Qianxin
Bayen, Alexander M.
González, Marta C.
2024

In recent years, the widespread adoption of navigation apps by motorists has raised questions about their impact on local traffic patterns. Users increasingly rely on these apps to find better, real-time routes to minimize travel time. This study uses microscopic traffic simulations to examine the connection between navigation app use and traffic congestion. The research incorporates both static and dynamic routing to model user behavior. Dynamic routing represents motorists who actively adjust their routes based on app guidance during trips, while static routing models users who stick to...

Scalable Learning of Segment-Level Traffic Congestion Functions

Choudhury, Shushman
Kreidieh, Abdul Rahman
Tsogsuren, Iveel
Arora, Neha
Osorio, Carolina
Bayen, Alexandre M.
2024

We propose and study a data-driven framework for identifying traffic congestion functions (numerical relationships between observations of traffic variables) at global scale and segment-level granularity. In contrast to methods that estimate a separate set of parameters for each roadway, ours learns a single black-box function over all roadways in a metropolitan area. First, we pool traffic data from all segments into one dataset, combining static attributes with dynamic time-dependent features. Second, we train a feed-forward neural network on this dataset, which we can then use on any...

Improving Social Cost in Traffic Routing with Bounded Regret via Second-Best Tolls

Alanqary, Arwa
Kreidieh, Abdul Rahman
Samitha Samaranayake
Bayen, Alexandre M.
2024

In this work, we investigate algorithmic improvements that navigation services can implement to steer road networks toward a system-optimal state while retaining high levels of user compliance. We model the compliance of users using marginal regret, and we extend the definition of the social cost function to account for various traffic congestion externalities. We propose a routing algorithm for the static traffic assignment problem that improves the social cost with guarantees on the worst-case regret in the network. This algorithm leverages the connection we establish between this...

Stability of Ring Roads and String Stability of Car Following Models

Chou, Fang-Chieh
Keimer, Alexander
Bayen, Alexandre M.
2024

The ring road, a closed circular track, provides a controlled environment for studying car-following behavior in dynamic traffic flow. This work examines the ring road from a stability analysis perspective to shed light on its underlying stability mechanisms. We model the ring road as an interconnected system composed of subsystems of ODEs which can represent car-following dynamics. We analyze its stability based on the string stability of these subsystems and then apply the findings to ring road models. Our study addresses both interconnected systems consisting of homogeneous (identical)...

Design, Preparation, and Execution of the 100-AV Field Test for the CIRCLES Consortium: Methodology and Implementation of the Largest Mobile Traffic Control Experiment to Date

Ameli, Mostafa
McQuade, Sean T.
Lee, Jonathan W.
Bunting, Matthew
Nice, Matthew
Wang, Han
Barbour, William
Weightman, Ryan J.
Denaro, Christopher
Delorenzo, Ryan
Hornstein, Sharon
Davis, Jon F.
Timsit, Dan
Wagner, Riley
Xu, Ruotong
Mahmood, Malaika
Mahmood, Mikail
Monache, Maria Laura Delle
Seibold, Benjamin
Work, Daniel
Sprinkle, Jonathan M.
Piccoli, Benedetto
Bayen, Alexandre M.
2025

This article presents the comprehensive design, setup, execution, and evaluation of the MegaVanderTest (MVT) experiment conducted by the Congestion Impacts Reduction via CAV-in-the-Loop Lagrangian Energy Smoothing (CIRCLES) Consortium, which aimed to mitigate traffic congestion using partially autonomous vehicles (AVs) (see “Summary”). The experiment involved 100 vehicles on Nashville’s Interstate 24 (I-24) highway, utilizing various control algorithms to smooth stop-and-go traffic waves. The execution of the MVT experiment required a coordinated effort from multiple teams. This article...

Traffic Control via Connected and Automated Vehicles (CAVs): An Open-Road Field Experiment with 100 CAVs

Lee, Jonathan W.
Wang, Han
Jang, Kathy
Lichtle, Nathan
Hayat, Amaury
Bunting, Matthew
Alanqary, Arwa
Barbour, William
Fu, Zhe
Gong, Xiaoqian
Gunter, George
Hornstein, Sharon
Kreidieh, Abdul Rahman
Nice, Mat-Thew W.
Richardson, William A.
Shah, Adit
Vinitsky, Eugene
Wu, Fangyu
Xiang, Shengquan
Almatrudi, Sulaiman
Althukair, Fahd
Bhadani, Rahul
Carpio, Joy
Chekroun, Raphael
Cheng, Eric
Chiri, Maria Teresa
Chou, Fang-Chieh
Delorenzo, Ryan
Gibson, Marsalis
Gloudemans, Derek A.
Gollakota, Anish
Ji, Junyi
Keimer, Alexander
Khoudari, Nour
Mahmood, Malaika
Mahmood, Mikail
Matin, Hossein Nick Zinat
McQuade, Sean T.
Ramadan, Rabie
Urieli, Daniel
Wang, Xia
Wang, Yanbing
Xu, Rita
Yao, Mengsha
You, Yiling
Zachár, Gergely
Zhao, Yibo
Ameli, Mostafa
Baig, Mirza Najamuddin
Bhaskaran, Sarah
Butts, Kenneth
Gowda, Manasi
Janssen, Caroline
Lee, John
Pedersen, Liam
Wagner, Riley
Zhang, Zimo
Zhou, Chang
Work, Daniel B.
Seibold, Benjamin
Sprinkle, Jonathan M.
Piccoli, Benedetto
Monache, Maria Laura Delle
Bayen, Alexandre M.
2025

The CIRCLES project aims to reduce instabilities in traffic flow, which are naturally occurring phenomena due to human driving behavior. Also called “phantom jams” or “stop-and-go waves,” these instabilities are a significant source of wasted energy. Toward this goal, the CIRCLES project designed a control system, referred to as the MegaController by the CIRCLES team, that could be deployed in real traffic. Our field experiment, the MegaVanderTest (MVT), leveraged a heterogeneous fleet of 100 longitudinally controlled vehicles as Lagrangian traffic actuators, each of which ran a controller...