## The State-of-the-Art of Coordinated Ramp Control with Mixed Traffic Conditions

Zhouqiao Zhao, Ziran Wang, Guoyuan Wu, Fei Ye, and Matthew J. Barth Center for Environmental Research and Technology University of California, Riverside, CA, USA 92521 email: zzhao084@ucr.edu; zwang050@ucr.edu; gywu@cert.ucr.edu; fye001@ucr.edu; barth@ece.ucr.edu

Abstract -Ramp metering, a traditional traffic control strategy for conventional vehicles, has been widely deployed around the world since the 1960s. On the other hand, the last decade has witnessed significant advances in connected and automated vehicle (CAV) technology and its great potential for improving safety, mobility and environmental sustainability. Therefore, a large amount of research has been conducted on cooperative ramp merging for CAVs only. However, it is expected that the phase of mixed traffic, namely the coexistence of both humandriven vehicles and CAVs, would last for a long time. Since there is little research on the system-wide ramp control with mixed traffic conditions, the paper aims to close this gap by proposing an innovative system architecture and reviewing the state-of-the-art studies on the key components of the proposed system. These components include traffic state estimation, ramp metering, driving behavior modeling, and coordination of CAVs. All reviewed literature plot an extensive landscape for the proposed system-wide coordinated ramp control with mixed traffic conditions.

such as lane occupancy, average speed, and length of onramp queue. This information is usually collected with fixedlocation sensors, e.g., inductive loop detectors and cameras.

## I. INTRODUCTION

With ever increase of travel demands, freeways play a significant role in facilitating the transportation-related activities. As an indispensable part of the freeway system, on/off-ramps and the associated controls have attracted much attention from worldwide researchers for the following reasons:

- · The ramp merging areas have consistently witnessed potential conflicts between on-ramp vehicles and mainline vehicles;
- · Uncontrolled inflow traffic to the freeway network can lead to congestion;
- · Due to limited vision range and uncoordinated merging behaviors with other vehicles, the drivers may experience unnecessary acceleration/deceleration, thus resulting in excessive energy consumption and pollutant emissions.

Therefore, ramp metering becomes a key element of advanced demand and traffic management strategy for freeways [1], whose major goal is to mitigate mainline congestion by controlling the entrance rate from on-ramps. Traditionally, ramp metering is designed for conventional vehicles with human drivers. It utilizes the traffic signals (green and red phases) installed at on-ramps to regulate the inflow rate to the freeway network. For each green phase, one or more vehicles are allowed to enter the mainline, and the metering rate depends on the estimated traffic states in real time,

Connected and automated vehicle (CAV) technology has been studied extensively in the last decade. The idea of automated vehicle based freeway system can be traced back to 1970 [2]. With the on-board sensing system, CAVs can perceive the surrounding environment. With the communication abilities between CAVs and roadside infrastructures and among CAVs, detailed and accurate traffic information can be shared. Thus, higher resolution of system states can be estimated for improving the adaptability and systemwide optimality of ramp metering strategies. Furthermore, the controllability of the automated vehicles enables the centralized or distributed coordination on the maneuvers of a number of vehicles for better merging. This may unlock abundant opportunities for more efficient and more delicate ramp control protocols on an individual vehicle basis. Nevertheless, assuming all vehicles are CA Vs may be too ambitious for the near future, and it is expected that CAVs would have to coexist with other conventional vehicles for another decade(s). Therefore, the solution to a mixed traffic would be of much realistic value although it still remains a major challenge.

The goal of this paper is twofold: a) to propose an innovative system architecture for cooperative ramp control in the mixed traffic environment; and b) to review relevant studies on the key components of the proposed system. The remainder of this paper is organized as follows. In Section II, we propose a hierarchical architecture for the mixed traffic coordinated ramp control system. In Section III, we survey the area of traffic state estimation. In Section IV, ramp metering algorithms for conventional vehicles are reviewed. Asurvey of driving behavior modeling is presented in Section V. Section VI reviews the coordination algorithms for CAVs, especially at freeway ramp areas. Section VII concludes the findings from literature review and discusses some future research directions.

## II. SYSTEM ARCHITECTURE

The typical freeway system contains multiple on-ramps and off-ramps. By leveraging CAV technology, we can better estimate and predict the traffic states in real time, and develop a ramp control system that can: 1) improve the operational efficiency of entire freeway by cooperatively regulating the

Fig. 1: Demonstration of the System Architecture

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00573v1-figure-5eeebba5-0619-428a-b34d-ebfa90e0dbd5.jpg)

inflow rates of all ramps; 2) mitigate safety concerns at the ramp merging areas by coordinating the movements of vehicles on both mainline and ramp; and 3) reduce the excessive vehicular energy consumption and emissions by smoothing the longitudinal maneuvers of CAVs and other traffic. Because of the involvement of conventional humandriven vehicles, design of the trajectories for CAVs should predict the behavior of conventional vehicles based on certain models such as car-following and merge gap acceptance. Fig. 1 illustrates the system architecture of the proposed cooperative ramp control system for mixed traffic. As shown in the figure, the hierarchical system can be divided into a real-time data processor and a 3-level structure.

The first key component of the system is traffic state estimation . Because of the mixed traffic condition, not every vehicle can be observed exhaustively. Therefore, the input data fed into the module includes CAV data (such as location and instantaneous speed), and traffic surveillance data (such as vehicle counts and lane occupancy). This data partially reflect the real-time traffic conditions. The goal of traffic state estimation is to provide accurate prediction of the current traffic information both microscopically and macroscopically based on apriori knowledge and partial observation [3]. The Section III provides a comprehensive review of current research of traffic state estimation.

At the corridor-level, the ramp metering algorithm calculates system-wide optimal inflow rate for each on-ramp, given the estimate of macroscopic traffic states. The resultant inflow rate serves as the constraint for boundary control at lower level ( i.e. , ramp-level). For mixed traffic, the conventional ramp metering algorithms need to be further extended to consider CAVs in the context, where a hybrid ramp control strategy should be developed. In Section IV, we will review not only corridor-wide ramp metering algorithms but also some well-known localized algorithms such as ALINEA [4].

The ramp-level module coordinates the maneuvers of CAVs and human-driven vehicles at the merging area and regulates the ramp inflow rate based on the output from the corridor-level control. Desired CAVs trajectories are calculated by a centralized controller. To complete this task, the controller should keep tracking the human-driven vehicles and predicting their behaviors, and the trajectories of CAVs should be adjusted accordingly. Therefore, two key components will be reviewed and presented in Section V and VI. Section V summarizes the research on driving behavior modeling for conventional vehicles, while Section VI presents the recent findings of cooperative merging for CA Vs. Omidvar et al. [5] observed that the human-driven tend to stay a constant speed, which may simplify the modeling of conventional vehicles' dynamics. For the merging protocol of mixed traffic, we propose a two-step centralized control scheme (for CAVs) as shown in figure 1. The first step is to predict the order of the vehicles based on the estimated time-to-arrival (TOA) at the merging point. Some existing algorithms use heuristic rules like first-come-first-serve [6]. Then, a centralized controller can be designed to govern the movement of CAVs when interacting with conventional vehicles, without compromising the safety.

Once the trajectory is calculated for the involved CAV, a lower-level controller (at the vehicle dynamics level) is designed for trajectory tracking. Please note that the powertrain control of the CAVs is not up for discussion in this paper.

## III. TRAFFIC STATE ESTIMATION

Accurate measurement and estimation of prevailing traffic conditions are the foundation of effective ramp control system. Since it is difficult and expensive to obtain complete information on the traffic ( e.g. , 100% penetration rate of connected vehicles), estimation of traffic states, such as flow, density, and speed, from partially observed traffic data plays an important role. Seo et al. performed a comprehensive survey about traffic state estimation which provides a guideline into this field [3]. The categories listed below are on the basis of their suggestion.

At the macroscopic scale, road networks are divided into several segments without further merging or diverging, which are called links. Inside each link, the traffic states can be considered to be homogeneous. Usually, flow (veh/hr), density (veh/km), and speed (km/hr) are three key variables used for traffic flow management. There might be other equivalent variables. For example, some ramp metering algorithms use occupancy as system input, which is quite comparable to density with the assumption or estimation of vehicle length.

Raw data available for estimation can be categorized as: stationary and mobile . The stationary data is collected by fixed location sensors such as inductive loop detectors, micro-wave radars on roadside, and surveillance cameras. The mobile data is collected by moving vehicles equipped with sensors such as GPS, on-board radar, and camera. The emergence of CAVs on roads can provide a significant amount of mobile sensor data.

Traffic flow model is widely used for traffic state estimation. The models are usually based on physical and empirical relations. Borrowing the idea of hydrodynamic theory, fundamental diagram depicts the relationship between density and speed, and/or density and flow [7], [8]. Another dynamic representation model with the hydrodynamic theory is cell transmission model (CTM) [9], which utilizes the discrete analog of the differential equations arising from a special case of the hydrodynamic model of traffic flow. Because of the conservation law for the traffic hydrodynamic, the aggregated behavior of traffic is depicted by partial differential equations. Lighthill-Whitham-Richard (LWR) model is the most commonly used first-order model [10], [11], and there are many higher-order models such as Payne-Whitham (PW) model [12], [13].

## A. Model-based Approaches

Model-based approaches are widely used in the field of traffic state estimation, where aforementioned traffic flow models are applied. The parameters of the models are usually calibrated via historical data from the field. After the calibration, target data is fed into the model to estimate the traffic states. Coifman proposed a method of estimating microscopic vehicle information ( i.e. , travel times and trajectories) using LWR model and loop detector data [14]. Wang and Papageorgiou estimated macroscopic traffic via Extended Kalman Filter (EKF) [15]. However, these approaches may fail if inappropriate models are adopted.Furthermore, as the parameters are calibrated by specific data sets, the modelbased approaches may not be so adaptive to the drastic changes of traffic conditions.

## B. Learning-based Approaches

Different from model-based approaches, no empirical traffic flow models are used in learning-based approaches. Learning-based models are trained through statistical methodologies or machine learning techniques given a large amount of historical data. A typical learning-based estimation approach was proposed by Tak et al. [16], in which k-nearest neighbors (KNN) algorithm was applied. Because of the challenge to well interpret the features of learning scheme, it is difficult to analytically comprehend how the entire system works even though the results may be very attractive. Additionally, similar to the model-based approaches, the dependency of trained data set makes the system not flexible enough to transfer to other untrained scenarios.

## C. Streaming-data-driven Approaches

Without using neither empirical models nor historical data, streaming-date-driven approaches only rely on real-time data and 'weak' assumptions. Therefore, it is more robust to different traffic conditions. The 'weak' assumption such as Conservation Law is generally reasonable, considering the physical constraints. A recent research was performed by Florin et al. [17], who presented mobile observer method with aggregated information of number of overtaking maneuver of vehicles. The increasing number of CAVs and connected vehicles on freeways can provide a large amount of streaming data for traffic state estimation, which makes it possible to consider mixed traffic scenarios. BekiarisLiberis el al. proposed a mixed traffic state estimation method with streaming-data-driven approach utilizing only average speed measurements reported by connected vehicles and a minimum number (sufficient to guarantee observability) of spot-sensor-based total flow measurements [18].

## IV. RAMP METERING

A ramp meter is a traffic signal on a freeway on-ramp area that is used to regulate the inflow rate of vehicles onto the freeway. Although there are some review papers about ramp metering algorithms in the past few decades, such as [19]-[21], latest progress in this area especially related to machine learning technique was not included. In this section, we will divide the up-to-date ramp metering algorithms into three categories: rule-based, control-based, learning-based, and review them respectively.

## A. Rule-based Approaches

A typical rule-based approach contains a hierarchy logic to adjust the ramp rate internally and coordinately. In general, the rule-based algorithms are easy to define, modify, and are relatively computational efficient. They simplify the nonlinear feature of the traffic, which is complex to be modeled accurately without hard assumptions.

A widely used rule-based method to achieve system-wide coordination is competitive approach, which usually contains two competitive controllers running in parallel, where the more restrictive metering rate would be chosen. Additional adjustment could be introduced to address other constrains like queue effects. Bottleneck Algorithm [22] used upstream occupancy and bottleneck data as system inputs, and the algorithm contains coordinated bottleneck controllers and local controllers. Similar to the Bottleneck Algorithm, two-module structure were proposed in the System-Wide Adaptive Ramp Metering (SWARM) Algorithm [23] as well. SWARM made decision based on estimated lane density using Kalman filter and linear regression. The local controller (called SWARM2) calculated metering rates by preserving headway which was converted from estimated local density, and the coordinated controller (called SWARM1) calculated metering rates to adjust the current density to the desired value.

ZONE [24] Algorithm was another well known rulebased approach which segmented freeway into zones, and it used Conservation Law to model the volume change of the traffic. By integrating the real-time measurement on upstream mainline volume with historical data, the algorithm chose a predefined metering rate accordingly. Fuzzy Logic [25], [26] algorithm was developed in 1998, which converted empirical knowledge into finite fuzzy rules. The proper choice of rules might lead to a robust system, but it could be overwhelming to identify appropriate rules for a system-wide ramp metering. Advanced Real-time Metering System (ARMS) [27] was made up of free-flow control, congestion prediction, and congestion reduction. The algorithm maximized the throughput and tried to reduce the risk of congestion, and Origin-Destination (O-D) information was used to distribute the calculated ramp volume to each ramp. Dynamic Ramp Metering [28] is a hierarchical coordinated control of ramps that contains state estimation, O-D prediction, local control and area-wide control to minimize the total system travel time.

## B. Control-based Approaches

Control-based approaches introduce automatic control techniques such as feedback control into the ramp metering system. Unlike the rule-based approaches whose strategies may be sophisticated, control-based ones are usually succinct, robust and efficient. However, the nonlinearity of the traffic dynamics pose some challenges for these approaches.

ALINEA was first proposed by Papageorgiou et al. [4] in 1991. By introducing the feedback into the control design, the algorithm is robust to the disturbance. Papageorgiou et al. also provided a guideline for the design of ALINEA ramp metering system [29]. The algorithm uses downstream occupancy as system inputs, controls the metering rates in response to the change of occupancy, and regulates them to the desired level. Although ALINEA is a local ramp metering algorithm, it draws much attention due to its simplicity, stability, and efficiency. Therefore, a large number of variations of ALINEA have been proposed to adapt to more complicated scenarios (e.g., METALINE, FL-ALINEA, UPALINEA, X-ALINEA/Q, PI-ALINEA) [20], [30]-[33] or to extend for achieving system-wide benefits (HERO) [34].

Linear-quadratic (LQ) feedback control algorithms are another type of control-based methods proposed by Isaksen and Payne [35] and Golstein and Kumar [36], which optimize the system performance such as throughput (vehicle miles per hour). In order to minimized total delay of the freeway network, Model Predictive control (MPC) approaches were applied by some researchers. Hegyi et al. [37] proposed a MPC scheme in a rolling horizon framework to coordinate the variable speed limits and ramp metering. To coordinate the traffic flows in an urban network with both freeways and arterial, Haddad et al. [38] developed an MPC-based algorithm for perimeter control including ramp metering strategies. Stratified Ramp Metering Algorithm was proposed by Geroliminis et al. [39], where a more accurate density estimation algorithm was developed. The metering rates were calculated to delay the onset of the breakdown and to accelerate system recovery. The algorithm could be regarded as a extended version of Stratified Zone Algorithm (SZM) [40]

which aims to maximize the network throughput. The MPC scheme was also used to solve the optimization problem.

## C. Learning-based Approaches

With the rapid advance in machine learning techniques such as artificial neural network (ANN) and reinforcement learning, more and more learning-based approaches for ramp metering emerge recently. Because of the nonlinear feature of traffic dynamics, learning-based approaches seem to be a shortcut to achieve better performance.

Zhang et al. proposed a local freeway ramp metering using ANN [41]. The controllers calculate the proportionalintegral (PI) feedback gain using multi-layer feed-forward (MLF) neural network which can be tuned by both historical data and on-line streaming data. Coordinated Ramp metering algorithm using ANN was firstly proposed by Wei and Wu [42]. The coordinated metering rate was trained by a traffic simulation model and expert system.

The recent breakthroughs of Reinforcement Learning (RL) provide another promising direction for ramp metering. Numerous RL-based algorithms have sprung up in the past five years. A local ramp metering algorithm was developed by Lu and Huang [43]. Fares et al. , and Lu et al. proposed a coordinated ramp metering algorithm using Q-Learning technique [44], [45]. Belletti et al. proposed an expert level ramp metering control based on multi-task deep reinforcement learning [46], and Schmidt-Dumont et al. combined ramp metering with variable speed limits based on decentralised reinforcement learning [47].

## V. DRIVING BEHAVIOR MODELING

Modeling and predicting the driving behavior of conventional human-driven vehicles are essential for designing the motion behavior of CAVs in mixed traffic conditions. As the foundation of microscopic traffic models, car-following (CF) logic describes the longitudinal interactions between vehicles assuming there is no lane changing or overtaking. Over the past decades, a considerable number of car-following models have been proposed and developed [48], [49]. For instance, Gipps model [50], Krauss model [51] and intelligent driver model (IDM) [52] were well-developed to address the speed adjustment according to the principle of collision avoidance between vehicles. A comprehensive comparative study of car-following models used in the state-of-the-art microscopic traffic simulators was conducted in [53]. More recently, to improve the traffic flow stability, an anticipation optimal velocity model (AOVM) was proposed by Peng et al. considering the anticipation effect of optimal velocity [54]. Given that human factors plays an essential role in driving behaviors especially under complex traffic conditions, notable efforts have been made to integrate human factors into the conventional CF model in order to describe more realistic driving behavior [49]. For example, an adaptive neural-fuzzy inference system (ANFIS) was proposed in [55] that integrated human expert knowledge and neural network to adapt the vehicle speed for car-following and collision prevention. Instead of assuming constant reaction time, Khodayari et al. proposed a artificial neural network (ANN) car-following model to estimate the following vehicle's acceleration based on variable reaction delay input [56]. In [57], a number of numerical tests showed that ANNs provide a good approximation of car following dynamics. Comparative studies and evaluation between major car-following models under mixed traffic conditions can be found in [58].

To describe the driving behavior in various traffic situations, some new methods have been proposed that use mathematical models and neural networks like Bayesian filtering, Recurrent Neural Network to predict a driver's intended actions across traffic situations [59], [60]. Artificial neural network (ANN) and radial basis function neural network (RBF-NN) showed great benefits to predict the vehicle second-by-second trajectory in congested traffic condition in terms of accuracy and efficiency [61], [62]. To investigate the cause of stop-and-go pattern and estimate the vehicle behavior in traffic, Agamennoni et al. proposed a recursive Bayesian filtering approach for that purpose [59]. The problem of multi-agent inference was tackled by decoupling the joint inference to log-linear combinations of individual dependencies. Toledo et al. [63] further developed an integrated driving behavior model that combine lane changing behavior and acceleration based on target lane model and target gap model as short-term goal and plan.

Some cutting-edge research involved studying the interaction between human driven vehicle and CAVs. To investigate the impact of AVs on traffic flow, the authors in [64] assumed both AVs and human-driven vehicles follow the well-known intelligent driver model (IDM) but with different parameters. Simulation study of a single AV and several human-driven vehicles interaction showed with stabilization can be achieve via a single autonomous vehicle driving around the equilibrium speed [65]. In this work, a secondorder car following model (i.e. optimal-velocity-follow-the leader (OV-FTL) model) was applied to describe the humandriven vehicles' behaviors as well as AV. With estimating vehicle behaviors and anticipate their future trajectories, more effective coordination between vehicles could be achieved in mixed traffic condition.

## VI. COORDINATION OF CAVS

In this section, we mainly review the literature that were focused on the low-level system of the coordinated ramp control, which is the coordination of CAVs in terms of their motion control algorithms. Some previous work were reviewed by Rios-Torres et al. and Scarinci et al. [66], [67]. However, in this section, we strategically categorize all related literature into two types: centralized approaches and distributed approaches. Additionally, we include more recent papers that were not reviewed by the previous surveys.

## A. Centralized Approaches

In this section, we define a CAV coordination approach as centralized if the tasks and control commands of the system are globally conducted by the roadside infrastructure and/or the transportation management center (TMC) for all

CAVs. Some of the major reasons that such coordination is conducted in a centralized manner are that, each CAV in the system might not have global information of the system, nor can they conduct computations locally that consume large computational power and long computational time.

In some centralized approaches, tasks and control commands were executed by different layers of the centralized controller. A two-layer CAV coordination system at ramp was proposed by Schimidt et el. in 1983, which was based on non-linear system dynamics behavior [68]. In their system, the higher layer is in charge of the sequence control, while the lower layer is in charge of the motion control of vehicles. Ran et al. proposed a similar centralized multi-layer automated ramp system, and also built a microscopic simulation model to validate its characteristics, as well as the designing requirements of the minimum ramp length [69].

Other than aforementioned approaches, coordination of CAVs at ramp can also be modeled as an optimization problem to be solved by the centralized controller, with the aim of minimizing travel time or fuel consumption. Awal et al. proposed an optimization problem with the objective of reducing merging time at ramps and thus reducing merging bottlenecks [70]. Raravi et al. formulated an optimization problem which aims at minimizing the Driving-Time-ToIntersection (DTTI) of vehicles, subject to certain constraints for ensuring safety [71]. Rios-Torres et al. presented an optimization framework and an analytical closed-form solution that allowed online coordination of CAVs at on-ramp merging zones [72]. Xie et al. formulated this case as a nonlinear optimization problem, and conducted a simulation evaluation with MATLAB and Car2X module in VISSIM [73].

## B. Distributed Approaches

Different from centralized approaches that rely on the roadside infrastructure and/or the TMC with infrastructureto-vehicle (I2V) communication, distributed approaches of CAV coordination at ramp control conduct coordination decisions locally among different CAVs through vehicle-tovehicle (V2V) communication. Compared to the centralized approaches, the distributed approaches bring several benefits, including reducing communication requirement and improving scalability.

The concept of virtual vehicle coordination at ramps was originated from Uno et al. [74]. The proposed approach maps a virtual vehicle onto the highway main line before the actual merging happens, allowing vehicles to perform safer and smoother merging maneuver. Lu et al. applied a similar idea in their proposed systems, where they first formulated the merging problems differently with respect to two different geometric layouts of the road ( i.e. , either with or without a parallel lane), and then proposed a speed based closed-loop adaptive control method to control the longitudinal speed of merging CAVs [75].

Besides the virtual vehicle ideas, other distributed approaches were also proposed to control the longitudinal motion of CAVs at ramps. Dao et al. proposed a distributed control protocol to assign vehicles into vehicle strings in the merging scenario [76]. Zhou et al. developed a vehicle trajectory planning method for CAV coordination at ramp, formulating the planning tasks of the ramp vehicle and the mainline vehicle as two related distributed optimal problems [77]. Wang et al. proposed a distributed consensus-based CAV coordination system [78]. Furthermore, agent-based modeling and simulation of the proposed CAV coordination system was conducted in game engine Unity3D, and it was compared to human-in-the-loop simulation to evaluate its benefits in terms of mobility and sustainability [79], [80].

## VII. CONCLUSIONS AND DISCUSSION

This paper proposed a system architecture for cooperative ramp control in a mixed traffic environment, and presented a survey on the following key aspects:

- · Traffic State Estimation. We demonstrated a few representative methodologies to estimate traffic states from infrastructure-based surveillance as well as CA Vs for the reference of corridor-wide ramp metering. The modelbased traffic estimation approaches have been the most commonly used for decades. However, with the improvement in sensing techniques and high-performance computing, plus the advent of CAVs, the research focus has gradually turned to learning-based and/or streamingdata-driven approaches. Moreover, the streaming-datadriven approaches seem to be quite promising, due to their robustness to the disturbances such as nonrecurrent traffic situations.
- · Corridor-level Control. From the perimeter control perspective, we illustrated how the most popular ramp metering algorithms, especially those focusing on systemwide benefits, determine the ramp inflow rate in a coordinated manner. The effectiveness of reviewed algorithms has been proven via microscopic simulation and/or real world implementation. Recently, considerable attention has been shifted to learning-based approaches (e.g., Reinforcement Learning), because they showed great potentials to achieving satisfactory solutions without compromising the real-time performance.
- · Ramp-level Control. Keeping in mind the context of mixed traffic for ramp-level control, we first reviewed the driving behaviors of conventional vehicles in response to other vehicles (either non-CAVs or CAVs). Then, we highlighted the studies on cooperative merging protocols for CAVs in scenarios with both full and partial penetration rates. The proper trajectory planning for CAVs in mixed traffic environment is more challenging due to resultant disturbance from humandriven vehicles. Thus, a considerable amount of effort has been made to understand human behaviors when interacting with other traffic. Both microscopic behavior models ( e.g. , car-following) and machine learning techniques ( e.g. , ANN) have been well adopted to predict human-driven vehicles' trajectories and/or infer driving intention. Therefore, cooperative ramp control in mixed traffic could be achieved by integrating the predicted conventional vehicles' dynamics into the constraints of

the solution space for coordinated trajectory planning of CAVs.

Although many positive findings related to coordinated ramp control in mixed traffic scenarios have been reviewed and analyzed in this survey, there are still some open questions that need to be addressed as future work:

- 1) How to build a more reliable architecture of coordinated ramp control systems in a mixed traffic environment? A ramp merging area is usually featured as a highly dynamic environment, where driving behaviors may bifurcate significantly due to a variety of factors, such as congestion level, weather condition, and even the drivers' prevailing mood. The presence of CAVs further complicates the situations. The ability to quickly identify the operation scenarios at both corridor level and ramp level, and the flexibility to adapt to different scenarios would be attractive features to enable a reliable ramp control system. Also, due to the involvement of CAVs, V2V communications and I2V communications play critical roles. A resilient system should take into account the odds of packet loss and latency, as well as communication vulnerability subject to cyber-attacks (such as jamming, data injection, and vehicle sensor manipulation).
- 2) How to realize a hybrid ramp control in mixed traffic? According to the literature review, few studies developed ramp merging control for mixed traffic and even fewer discussed the realization of the proposed system. Minimum effort may involve the upgrade of conventional ramp metering infrastructure with wireless communication capabilities to tally the inflow rates of CAVs for the regulation (with signal head display) of conventional vehicles' inflow rates. CA Vs' dynamics are governed by the developed control schemes, regardless of signal head display on the ramp meter. Some safety concerns may arise due to such mixed operation on the same facility (or lane). Another option is to build dedicated infrastructure such as special lanes or grade-separated facilities for preferential treatment of CAVs. However, the system efficiency may be degraded if the demand ratio between CAVs and conventional vehicles does not match the supply (roadway capacity) for respective category. Similar considerations may be applied to the intersection management in presence of both CAVs and conventional vehicles.
- 3) How to balance the system performance and computational effort? To achieve better performance, higher resolution of data and more delicate control would be preferable. Adaptive strategies on the selection of system parameters (e.g., sensing or control frequency) and system structure (i.e., centralized, decentralized, distributed, and hierarchical) may be necessary in response to various CAV penetration rates, while maximizing the utilization of available resources (for computation or storage).
- 4) How to further boost the system capacity? It is selfevident that the system capacity varies with the pen-

etration rate of CAVs. In the ideal situation where all vehicles are CAVs, the optimal scheduling strategy can be developed to achieve the maximum throughput of the target ramp merging area. From the perspective of entire corridor, the coordination of inflow rates among ramps is needed to achieve system-wide optimum. In addition, other strategies such as variable speed limit (or intelligent speed adaptation) and cooperative lane changing, when deployed in combination, could help improve the capacity of overall freeway system.

## ACKNOWLEDGMENT

This study is funded by the National Center for Sustainable Transportation (NCST). The contents of this paper reflect only the views of the authors, who are responsible for the statement presented herein.

## REFERENCES

- [1] A. Mizuta, K. Roberts, L. Jacobsen, and N. Thompson, 'Ramp metering: A proven, cost-effective operational strategy,' U.S. Department of Transportation Federal Highway Administration, Tech. Rep., October 2014.
- [2] R. E. Fenton, 'Automatic vehicle guidance and control-a state of the art survey,' IEEE Transactions on Vehicular Technology , vol. 19, no. 1, pp. 153-161, Feb 1970.
- [3] T. Seo, A. M. Bayen, T. Kusakabe, and Y. Asakura, 'Traffic state estimation on highway: A comprehensive survey,' Annual Reviews in Control , vol. 43, pp. 128-151, jan 2017.
- [4] M. Papageorgiou, H. Hadj-Salem, and J. Blosseville, 'ALINEA: A local feedback control law for on-ramp metering,' Transportation Research Record , pp. 58-64, 1991.
- [5] A. Omidvar and M. Pourmehrab, 'Optimizing Freeway Merge Operations under Conventional and Automated Vehicle Traffic,' Transportation Research Record: Journal of the Transportation Research Board , no. November, 2018.
- [6] J. Rios-Torres and A. A. Malikopoulos, 'Automated and cooperative vehicle merging at highway on-ramps,' IEEE Transactions on Intelligent Transportation Systems , vol. 18, no. 4, pp. 780-789, April 2017.
- [7] B. Greenshields, J. Bibbins, W. Channing, and H. Miller, 'A study of traffic capacity,' Highway Research Board proceedings , vol. 1935, 1935.
- [8] G. Newell, 'A simplified theory of kinematic waves in highway traffic, part i: General theory,' Transportation Research Part B: Methodological , vol. 27, no. 4, pp. 281 - 287, 1993.
- [9] C. F. Daganzo, 'The cell transmission model: A dynamic representation of highway traffic consistent with the hydrodynamic theory,' Transportation Research Part B: Methodological , vol. 28, no. 4, pp. 269 - 287, 1994.
- [10] M. Lighthill and G. Whitham, 'On kinematic waves II. A theory of traffic flow on long crowded roads,' Proceedings of the Royal Society of London. Series A. Mathematical and Physical Sciences , vol. 229, no. 1178, pp. 317-345, may 1955.
- [11] P. I. Richards, 'Shock Waves on the Highway,' Operations Research , vol. 4, no. 1, pp. 42-51, feb 1956.
- [12] H. Payne, 'Models of freeway traffic and control,' Mathematical Models of Public Systems , no. 1, pp. 51-61, 1971.
- [13] G. B. Whitham, Linear and Nonlinear Waves . John Wiley &amp; Sons, 1974, vol. 42.
- [14] B. Coifman, 'Estimating travel times and vehicle trajectories on freeways using dual loop detectors,' Transportation Research Part A: Policy and Practice , vol. 36, no. 4, pp. 351 - 364, 2002.
- [15] Y. Wang and M. Papageorgiou, 'Real-time freeway traffic state estimation based on extended kalman filter: a general approach,' Transportation Research Part B: Methodological , vol. 39, no. 2, pp. 141 167, 2005.
- [16] S. Tak, S. Woo, and H. Yeo, 'Data-driven imputation method for traffic data in sectional units of road links,' IEEE Transactions on Intelligent Transportation Systems , vol. 17, no. 6, pp. 1762-1771, June 2016.
- [17] R. Florin and S. Olariu, 'On a variant of the mobile observer method,' IEEE Transactions on Intelligent Transportation Systems , vol. 18, no. 2, pp. 441-449, Feb 2017.
- [18] N. Bekiaris-Liberis, C. Roncoli, and M. Papageorgiou, 'Highway traffic state estimation with mixed connected and conventional vehicles,' IEEE Transactions on Intelligent Transportation Systems , vol. 17, no. 12, pp. 3484-3497, Dec 2016.
- [19] K. Shaaban, M. A. Khan, and R. Hamila, 'Literature Review of Advancements in Adaptive Ramp Metering,' Procedia Computer Science , vol. 83, no. Ant, pp. 203-211, 2016.
- [20] W. Jin and M. Zhang, 'Evaluation of On-ramp Control Algorithims,' California Partners for Advanced Transit and Highways , 2001.
- [21] K. Bogenberger and A. D. May, 'Advanced Coordinated Traffic Responsive Ramp Metering Strategies,' California Partners for Advanced Transit and Highways , 1999.
- [22] L. Jacobson, K. Henry, and O. Mehyar, 'Real-time metering algorithm for centralized control,' Transportation Research Record , no. 1732, pp. 20-32, 1989.
- [23] G. Paesani, J. Kerr, P. Perovich, and F. E. Khosravi, 'System Wide Adaptive Ramp Metering (SWARM),' in Merging the Transportation and Communications Revolutions. Abstracts for ITS America Seventh Annual Meeting and ExpositionITS America , 1997.
- [24] Y. Stephanedes, 'Implementation of on-line zone control strategies for optimal ramp metering in the Minneapolis ring road,' Road Traffic Monitoring and Control , vol. 26-28, pp. 181-184, 1994.
- [25] C. Taylor, D. Meldrum, and L. Jacobson, 'Fuzzy ramp metering: Design overview and simulation results,' Transportation Research Record , vol. 1634, no. 1, pp. 10-18, 1998.
- [26] C. Taylor and D. Meldrum, 'Evaluation of a Fuzzy Logic Ramp Metering Algorithm : a Comparative Study Among Three Ramp Metering Algorithms,' Washington State Department of Transportation, Tech. Rep. February, 2000.
- [27] J.-C. Liu, J. L. Kim, Y. Chen, Y. Hao, S. Lee, T. Kim, and M. Thomadakis, 'An Advanced real-time ramp metering system (ARMS): the system concept,' Texas Department of Transportation, Texas, Tech. Rep. November, 1994.
- [28] O. J. Chen, A. F. Hotz, and M. E. Ben-Akiva, 'Development and Evaluation of a Dynamic Ramp Metering Control Model,' IFAC Transportation Systems , 1997.
- [29] M. Papageorgiou, E. Kosmatopoulos, I. Papamichail, and Y. Wang, 'A misapplication of the local ramp metering strategy alinea,' IEEE Transactions on Intelligent Transportation Systems , vol. 9, no. 2, pp. 360-365, June 2008.
- [30] M. Papageorgiou, H. Hadj-Salem, J. Blosseville, and N. Bhouri, 'Modelling and Real-time Control of Traffic Flow on the Boulevard Peripherique in Paris,' Transportation Research Part A: General , vol. 24, pp. 345 - 359, 1990.
- [31] E. Smaragdis, M. Papageorgiou, and E. Kosmatopoulos, 'A flowmaximizing adaptive local ramp metering strategy,' Transportation Research Part B: Methodological , vol. 38, no. 3, pp. 251-270, 2004.
- [32] R. Jiang, E. Chung, and J. Lee, 'Local on-ramp queue management strategy with mainline speed recovery,' Procedia-Social and Behavioral Sciences , vol. 43, pp. 201-209, 2012.
- [33] Y. Kan, Y. Wang, M. Papageorgiou, and I. Papamichail, 'Local ramp metering with distant downstream bottlenecks: A comparative study,' Transportation Research Part C: Emerging Technologies , vol. 62, pp. 149-170, jan 2016.
- [34] I. Papamichail, M. Papageorgiou, V. Vong, and J. Gaffney, 'HERO coordinated ramp metering implemented at the Monash Freeway,' Transportation Research Board, 89th Annual Meeting, Washington, DC , pp. 10-14, 2010.
- [35] L. Isaksen and H. Payne, 'Suboptimal control of linear systems by augmentation with application to freeway traffic regulation,' IEEE Transactions on Automatic Control , vol. 18, no. 3, pp. 210-219, June 1973.
- [36] N. Goldstein and K. Kumar, 'A decentralized control strategy for freeway regulation,' Transportation Research Part B: Methodological , vol. 16, no. 4, pp. 279-290, aug 1982.
- [37] A. Hegyi, B. De Schutter, and H. Hellendoorn, 'Model predictive control for optimal coordination of ramp metering and variable speed limits,' Transportation Research Part C: Emerging Technologies , vol. 13, no. 3, pp. 185-209, jun 2005.
- [38] J. Haddad, M. Ramezani, and N. Geroliminis, 'Cooperative traffic control of a mixed network with two urban regions and a freeway,' Transportation Research Part B: Methodological , vol. 54, pp. 17-36, aug 2013.
- [39] N. Geroliminis, A. Srivastava, and P. Michalopoulos, 'Development of the Next Generation Stratified Ramp Metering Algorithm Based on

Freeway Design,' Center for Transportation Studies. Retrieved from the University of Minnesota Digital Conservancy, Tech. Rep., 2011.

- [40] N. Geroliminis, J. Haddad, and M. Ramezani, 'Optimal perimeter control for two urban regions with macroscopic fundamental diagrams: A model predictive approach,' IEEE Transactions on Intelligent Transportation Systems , vol. 14, no. 1, pp. 348-359, 2013.
- [41] H. M. Zhang and S. G. Ritchie, 'Freeway ramp metering using artificial neural networks,' Transportation Research Part C: Emerging Technologies , vol. 5, no. 5, pp. 273 - 286, 1997.
- [42] C. Wei and K. Wu, 'Applying an artificial neural network model to freeway ramp metering control,' Transportation Planning Journal , vol. 25, no. 3, 1996.
- [43] C. Lu and J. Huang, 'A self-learning system for local ramp metering with queue management,' Transportation Planning and Technology , vol. 40, no. 2, pp. 182-198, 2017.
- [44] A. Fares and W. Gomaa, 'Multi-Agent Reinforcement Learning Control for Ramp Metering,' in Progress in Systems Engineering . Springer, Cham, 2015, pp. 167-173.
- [45] C. Lu, J. Huang, L. Deng, and J. Gong, 'Coordinated Ramp Metering with Equity Consideration Using Reinforcement Learning,' Journal of Transportation Engineering, Part A: Systems , 2017.
- [46] F. Belletti, D. Haziza, G. Gomes, and A. M. Bayen, 'Expert Level Control of Ramp Metering Based on Multi-Task Deep Reinforcement Learning,' IEEE Transactions on Intelligent Transportation Systems , vol. 19, no. 4, pp. 1198-1207, 2018.
- [47] T. Schmidt-Dumont and J. H. Van Vuuren, 'Decentralised reinforcement learning for ramp metering and variable speed limits on highways,' IEEE Transactions on Intelligent Transportation Systems , vol. 14, no. 8, 2015.
- [48] M. Brackstone and M. McDonald, 'Car-following: a historical review,' Transportation Research Part F: Traffic Psychology and Behaviour , vol. 2, no. 4, pp. 181-196, 1999.
- [49] M. Saifuzzaman and Z. Zheng, 'Incorporating human-factors in carfollowing models: A review of recent developments and research needs,' Transportation Research Part C: Emerging Technologies , vol. 48, pp. 379 - 403, 2014.
- [50] P. Gipps, 'A behavioural car-following model for computer simulation,' Transportation Research Part B: Methodological , vol. 15, no. 2, pp. 105 - 111, 1981.
- [51] S. Krauss, 'Microscopic modeling of traffic flow: Investigation of collision free vehicle dynamics,' Ph.D. dissertation, Dt. Zentrum f¨ ur Luft-und Raumfahrt eV, Abt. Unternehmensorganisation und . . . , 1998.
- [52] M. Treiber, A. Hennecke, and D. Helbing, 'Derivation, properties, and simulation of a gas-kinetic-based, non-local traffic model,' Physical Review E , vol. 59, no. 1, p. 239, 1999.
- [53] S. Panwai and H. Dia, 'Comparative evaluation of microscopic carfollowing behavior,' IEEE Transactions on Intelligent Transportation Systems , vol. 6, no. 3, pp. 314-325, Sep. 2005.
- [54] G. han Peng and R. jun Cheng, 'A new car-following model with the consideration of anticipation optimal velocity,' Physica A: Statistical Mechanics and its Applications , vol. 392, no. 17, pp. 3563-3569, 2013.
- [55] J. M. and, 'An anfis controller for the car-following collision prevention system,' IEEE Transactions on Vehicular Technology , vol. 50, no. 4, pp. 1106-1113, July 2001.
- [56] A. Khodayari, A. Ghaffari, R. Kazemi, and R. Braunstingl, 'A modified car-following model based on a neural network model of the human driver effects,' IEEE Transactions on Systems, Man, and Cybernetics -Part A: Systems and Humans , vol. 42, no. 6, pp. 1440-1449, Nov 2012.
- [57] F. Wu and D. B. Work, 'Connections between classical car following models and artificial neural networks,' in 2018 21st International Conference on Intelligent Transportation Systems (ITSC) , Nov 2018, pp. 3191-3198.
- [58] V. Kanagaraj, G. Asaithambi, C. N. Kumar, K. K. Srinivasan, and R. Sivanandan, 'Evaluation of different vehicle following models under mixed traffic conditions,' Procedia - Social and Behavioral Sciences , vol. 104, pp. 390-401, 2013, 2nd Conference of Transportation Research Group of India (2nd CTRG).
- [59] G. Agamennoni, J. I. Nieto, and E. M. Nebot, 'A bayesian approach for driving behavior inference,' in 2011 IEEE Intelligent Vehicles Symposium (IV) , June 2011, pp. 595-600.
- [60] J. Morton, T. A. Wheeler, and M. J. Kochenderfer, 'Analysis of recurrent neural networks for probabilistic modeling of driver behavior,' IEEE Transactions on Intelligent Transportation Systems , vol. 18, no. 5, pp. 1289-1298, May 2017.
- [61] F. Ye, P. Hao, X. Qi, G. Wu, K. Boriboonsomsin, and M. J. Barth, 'Prediction-based eco-approach and departure at signalized intersections with speed forecasting on preceding vehicles,' IEEE Transactions on Intelligent Transportation Systems , vol. 20, no. 4, pp. 1378-1389, April 2019.
- [62] A. Ghaffari, A. Khodayari, A. Panahi, and F. Alimardani, 'Neuralnetwork-based modeling and prediction of the future state of a stop amp;go behavior in urban areas,' in 2012 IEEE International Conference on Vehicular Electronics and Safety (ICVES 2012) , July 2012, pp. 399-404.
- [63] T. Toledo, H. N. Koutsopoulos, and M. Ben-Akiva, 'Integrated driving behavior modeling,' Transportation Research Part C: Emerging Technologies , vol. 15, no. 2, pp. 96 - 112, 2007.
- [64] M. T. Arne Kesting and D. Helbing, 'Enhanced intelligent driver model to access the impact of driving strategies on traffic capacity,' Philosophical Transactions of the Royal Society A: Mathematical, Physical and Engineering Sciences , vol. 368(1928), p. 4585-4605, 2010.
- [65] S. Cui, B. Seibold, R. Stern, and D. B. Work, 'Stabilizing traffic flow via a single autonomous vehicle: Possibilities and limitations,' in 2017 IEEE Intelligent Vehicles Symposium (IV) , June 2017, pp. 1336-1341.
- [66] J. Rios-Torres and A. A. Malikopoulos, 'A survey on the coordination of connected and automated vehicles at intersections and merging at highway on-ramps,' IEEE Transactions on Intelligent Transportation Systems , vol. 18, no. 5, pp. 1066-1077, May 2017.
- [67] R. Scarinci and B. Heydecker, 'Control concepts for facilitating motorway on-ramp merging using intelligent vehicles,' Transport Reviews , vol. 34, no. 6, pp. 775-797, 2014.
- [68] G. K. Schmidt and B. Posch, 'A two-layer control scheme for merging of automated vehicles,' in The 22nd IEEE Conference on Decision and Control , 1983, pp. 495-500.
- [69] B. Ran, S. Leight, and B. Chang, 'A microscopic simulation model for merging control on a dedicated-lane automated highway system,' Transportation Research Part C: Emerging Technologies , vol. 7, no. 6, pp. 369 - 388, 1999.
- [70] T. Awal, L. Kulik, and K. Ramamohanrao, 'Optimal traffic merging strategy for communicationand sensor-enabled vehicles,' in 16th International IEEE Conference on Intelligent Transportation Systems (ITSC 2013) , Oct 2013, pp. 1468-1474.
- [71] G. Raravi, V. Shingde, K. Ramamritham, and J. Bharadia, 'Merge algorithms for intelligent vehicles,' in Next Generation Design and Verification Methodologies for Distributed Embedded Control Systems , S. Ramesh and P. Sampath, Eds. Dordrecht: Springer Netherlands, 2007, pp. 51-65.
- [72] J. Rios-Torres and A. A. Malikopoulos, 'Automated and cooperative vehicle merging at highway on-ramps,' IEEE Transactions on Intelligent Transportation Systems , vol. 18, no. 4, pp. 780-789, Apr. 2017.
- [73] Y. Xie, H. Zhang, N. H. Gartner, and T. Arsava, 'Collaborative merging strategy for freeway ramp operations in a connected and autonomous vehicles environment,' Journal of Intelligent Transportation Systems , vol. 21, no. 2, pp. 136-147, 2017.
- [74] A. Uno, T. Sakaguchi, and S. Tsugawa, 'A merging control algorithm based on inter-vehicle communication,' in Proceedings 199 IEEE/IEEJ/JSAI International Conference on Intelligent Transportation Systems , Oct. 1999, pp. 783-787.
- [75] X.-Y. Lu and K. J. Hedrick, 'Longitudinal control algorithm for automated vehicle merging,' in Proceedings of the 39th IEEE Conference on Decision and Control , vol. 1, Dec. 2000, pp. 450-455.
- [76] T. Dao, C. M. Clark, and J. P. Huissoon, 'Distributed platoon assignment and lane selection for traffic flow optimization,' in IEEE Intelligent Vehicles Symposium (IV) , Jun. 2008, pp. 739-744.
- [77] Y. Zhou, M. E. Cholette, A. Bhaskar, and E. Chung, 'Optimal vehicle trajectory planning with control constraints and recursive implementation for automated on-ramp merging,' IEEE Transactions on Intelligent Transportation Systems , pp. 1-12, 2018.
- [78] Z. Wang, G. Wu, and M. Barth, 'Distributed consensus-based cooperative highway on-ramp merging using V2X communications,' in SAE Technical Paper , Apr. 2018.
- [79] Z. Wang, B. Kim, H. Kobayashi, G. Wu, and M. J. Barth, 'Agentbased modeling and simulation of connected and automated vehicles using game engine: A cooperative on-ramp merging study,' arXiv:1810.09952 , 2018.
- [80] Z. Wang, G. Wu, K. Boriboonsomsin, M. J. Barth, K. Han, B. Kim, and P. Tiwari, 'Cooperative ramp merging system: Agent-based modeling and simulation using game engine,' SAE International Journal of Connected and Automated Vehicles , vol. 2, no. 2, May 2019.
Zhouqiao Zhao Ziran Wang Guoyuan Wu Fei Ye Matthew J. Barth
The State-of-the-Art of Coordinated Ramp Control with Mixed Traffic Conditions
Ramp metering, a traditional traffic control strategy for conventional
vehicles, has been widely deployed around the world since the 1960s. On the
other hand, the last decade has witnessed significant advances in connected and
automated vehicle (CAV) technology and its great potential for improving
safety, mobility and environmental sustainability. Therefore, a large amount of
research has been conducted on cooperative ramp merging for CAVs only. However,
it is expected that the phase of mixed traffic, namely the coexistence of both
human-driven vehicles and CAVs, would last for a long time. Since there is
little research on the system-wide ramp control with mixed traffic conditions,
the paper aims to close this gap by proposing an innovative system architecture
and reviewing the state-of-the-art studies on the key components of the
proposed system. These components include traffic state estimation, ramp
metering, driving behavior modeling, and coordination of CAVs. All reviewed
literature plot an extensive landscape for the proposed system-wide coordinated
ramp control with mixed traffic conditions.