Intelligent Transportation Systems

Proximal Policy Optimization (PPO) is a ubiquitous on-policy reinforcement learning algorithm but is significantly less utilized than off-policy learning algorithms in multi-agent settings. This is often due to the belief that PPO is significantly less sample efficient than off-policy methods in multi-agent systems. In this work, we carefully study the performance of PPO in cooperative multi-agent settings. We show that PPO-based multi-agent algorithms achieve surprisingly strong performance in four popular multi-agent testbeds: the particle-world environments, the StarCraft multi-...

This paper introduces a parameter estimation approach for decoding digital sensor signals in a cyber-physical system. For unknown or not fully characterized digital sensor data, it can be difficult to decipher a desired signal from background or noise. In a cyber-physical system with networked sensors, we can leverage knowledge of the physical system to inform the decoding of the digital signals. This work in progress is a case study on deciphering commercial vehicle on-board sensor networks that communicate through the Controller Area Network (CAN). By understanding the stock vehicle...

As public and private institutions recognize the role of space exploration as a catalyst for economic growth, various areas of innovation are expected to emerge as drivers of the space economy. These include space transportation, in-space manufacturing, bioproduction, in-space agriculture, nuclear launch, and propulsion systems, as well as satellite services and their maintenance. However, the current nature of space as an open-access resource and global commons presents a systemic risk for exuberant competition for space goods and services, which may result in a “tragedy of the commons”...

Congestion pricing policies are increasingly being considered to aid in congestion management and transportation funding in urban areas. This article presents a case study of the optimization of congestion pricing policy design using the Berkeley Integrated System for Transportation Optimization (BISTRO), an open-sourced transportation planning and decision support system (DSS) that uses an agent-based simulation (ABS) and optimization framework to evaluate transportation system interventions. The study exemplifies how the granularity offered by activity-based travel demand models and ABS...