Connected and Automated Vehicles

Traffic Smoothing Controllers for Autonomous Vehicles Using Deep Reinforcement Learning and Real-World Trajectory Data

Lichtle, Nathan
Jang, Kathy
Shah, Adit
Vinitsky, Eugene
Lee, Jonathan W.
Alexandre Bayen
2023

Designing traffic-smoothing cruise controllers that can be deployed onto autonomous vehicles is a key step towards improving traffic flow, reducing congestion, and enhancing fuel efficiency in mixed autonomy traffic. We bypass the common issue of having to carefully fine-tune a large traffic micro-simulator by leveraging real-world trajectory data from the I–24 highway in Tennessee, replayed in a one-lane simulation. Using standard deep reinforcement learning methods, we train energy-reducing wave-smoothing policies. As an input to the agent, we observe the speed and distance of only the...

Enabling Mixed Autonomy Traffic Control

Nice, Matthew
Bunting, Matthew
Richardson, Alex
Zachár, Gergely
Lee, Jonathan W.
Alexandre Bayen
2023

We demonstrate a new capability of automated vehicles: mixed autonomy traffic control. With this new capability, automated vehicles can shape the traffic flows composed of other non-automated vehicles, which has the promise to improve safety, efficiency, and energy outcomes in transportation systems at a societal scale. Investigating mixed autonomy mobile traffic control must be done in situ given that the complex dynamics of other drivers and their response to a team of automated vehicles cannot be effectively modeled. This capability has been blocked because there is no existing scalable...

Connected and Automated Vehicle Technology is Not Enough; it Must also be Collaborative

Patire, Anthony D.
Dion, Francois
Alexandre Bayen
2023

Connected and automated vehicles (CAVs) will revolutionize the way we travel; however, what impact this revolution will have on advancing broader societal goals is uncertain. To date, the private sector technology rollout has emphasized the automation side of CAVs and neglected the potentially transformative possibilities brought by a more collaborative notion of connectivity. This may have significant downsides from a broader societal perspective. For example, CAVs (including those on the road today) collect a vast amount of data gathered through onboard systems (e.g., radar, lidar,...

Optimal Control of Autonomous Vehicles for Flow Smoothing in Mixed-Autonomy Traffic

Alanqary, Arwa
Gong, Xiaoqian
Keimer, Alexander
Seibold, Benjamin
Piccoli, Benedetto
Alexandre Bayen
2023

This article studies the optimal control of autonomous vehicles over a given time horizon to smooth traffic. We model the dynamics of a mixed-autonomy platoon as a system of non-linear ODEs, where the acceleration of human-driven vehicles is governed by a car-following model, and the acceleration of autonomous vehicles is to be controlled. We formulate the car-following task as an optimal control problem and propose a computational method to solve it. Our approach uses an adjoint formulation to compute gradients of the optimization problem explicitly, resulting in more accurate and...

Car-Following Models: A Multidisciplinary Review

Zhang, Tianya Terry
Jin, Peter J.
McQuade, Sean T.
Alexandre Bayen
Piccoli, Benedetto
2024

Car-following (CF) algorithms are crucial components of traffic simulations and have been integrated into many production vehicles equipped with Advanced Driving Assistance Systems (ADAS). Insights from the model of car-following behavior help researchers to understand the causes of various macro phenomena that arise from interactions between pairs of vehicles. Car-following Models encompass multiple disciplines, including traffic engineering, physics, dynamic system control, cognitive science, machine learning, deep learning, and reinforcement learning. This paper presents an extensive...

Reduce Emissions and Improve Traffic Flow Through Collaborative Autonomy

Patire, Anthony D.
Dion, Francois
Alexandre Bayen
2024

This report explores opportunities for employing autonomous driving technology to dampen stop-and-go waves on freeways. If successful, it could reduce fuel consumption and emissions. This technology was tested in an on-road experiment with 100 vehicles over one week. Public stakeholders were engaged to assess the planning effort and feasibility of taking the technology to the next level: a pilot involving 1000+ vehicles over several months. Considerations included the possible geographical boundaries, target fleets of vehicles, and suitable facilities such as bridges or managed lanes. Flow...

Designing, Simulating, and Performing the 100-AV Field Test for the CIRCLES Consortium: Methodology and Implementation of the Largest Mobile Traffic Control Experiment to Date

Ameli, Mostafa
McQuade, Sean T.
Lee, Jonathan W.
Bunting, Matthew
Nice, Matthew
Alexandre Bayen
2024

Previous controlled experiments on single-lane ring roads have shown that a single partially autonomous vehicle (AV) can effectively mitigate traffic waves. This naturally prompts the question of how these findings can be generalized to field operational, high-density traffic conditions. To address this question, the Congestion Impacts Reduction via CAV-in-the-loop Lagrangian Energy Smoothing (CIRCLES) Consortium conducted MegaVanderTest (MVT), a live traffic control experiment involving 100 vehicles near Nashville, TN, USA. This article is a tutorial for developing analytical and...

Kernel-based Planning and Imitation Learning Control for Flow Smoothing in Mixed Autonomy Traffic

Fu, Zhe
Alanqary, Arwa
Kreidieh, Abdul Rahman
Alexandre Bayen
2024

This article presents a new architecture for managing heterogeneous fleets aimed at achieving flow harmonization in mixed-autonomy traffic, demonstrating robustness across different sensing paradigms. We develop a kernel-based planning controller capable of providing anticipative coordination over low-bandwidth or high-latency networks. Furthermore, we employ a scenario-based optimization technique to tune the parameters of the proposed controller which offers performance improvement over the grid search technique across different simulation scenarios. Additionally, our architecture...

Decentralized Vehicle Coordination: The Berkeley DeepDrive Drone Dataset and Consensus-Based Models

Wu, Fangyu
Wang, Dequan
Hwang, Minjune
Hao, Chenhui
Lu, Jiawei
Zhang, Jiamu
Chou, Christopher
Darrell, Trevor
Alexandre Bayen
2025

A significant portion of roads, particularly in densely populated developing countries, lacks explicitly defined right-of-way rules. These understructured roads pose substantial challenges for autonomous vehicle motion planning, where efficient and safe navigation relies on understanding decentralized human coordination for collision avoidance. This coordination, often termed “social driving etiquette,” remains underexplored due to limited open-source empirical data and suitable modeling frameworks. In this paper, we present a novel dataset and modeling framework designed to study motion...

Optimal Control of ODE Car-Following Models: Applications to Mixed-Autonomy Platoon Control via Coupled Autonomous Vehicles

Alanqary, Arwa
Alexandre Bayen
Gong, Xiaoqian
Gollakota, Anish
Keimer, Alexander
Pandian, Ashish
2025

In this paper, we study the optimal control of a mixed-autonomy platoon driving on a single lane to smooth traffic flow. The platoon consists of autonomous vehicles, whose acceleration is controlled, and human-driven vehicles, whose behavior is described using a microscopic car-following model. We formulate the optimal control problem where the dynamics of the platoon are describing through a system of non-linear ODEs, with explicit constraints on both the state and the control variables. Theoretically, we analyze the well-posedness of the system dynamics under a reasonable set of...