Decentralized Cooperative Merging of Platoons of Connected and Automated Vehicles at Highway On-Ramps
Abstract
In this paper, we present an optimization framework for cooperative merging of platoons of connected and automated vehicles at highway on-ramps. The framework includes (1) an optimal scheduling algorithm, through which, each platoon derives the sequence and time to enter the highway safely, and (2) the formulation of an optimal control problem the solution of which allows each platoon to derive its optimal control input (acceleration/deceleration) in terms of fuel consumption. We evaluate the efficacy of the proposed optimization framework through VISSIM-MATLAB simulation environment. The proposed framework significantly reduces the crossing time and fuel consumption of platoons at the highway on-ramps compared to the baseline scenario where the vehicles on the minor road yield to the vehicles on the highway.
I INTRODUCTION
Highway on-ramp is one of the main sources of traffic bottlenecks as the capacity of the road section is lesser than the neighboring roads. Several research efforts in the literature have used ramp metering to maximize the capacity of the highway by regulating the inflow of vehicles from on-ramps. Athan [1] formulated a vehicle merging problem and facilitated the safe merging of vehicles without severe acceleration and deceleration except in emergency conditions. An overview of various research efforts in the literature that regulated flow of vehicles using ramp metering can be found in [2]. In these approaches, there is no communication between the merging vehicles and extreme care is expected from the drivers while merging from on-ramps. The advances in connected vehicle technologies and automated driving can avoid human errors and offer better opportunities to improve the mobility of commuters [3].
Cooperative merging control of connected and automated vehicles (CAVs) can reduce congestion and provide significant benefits in terms of road capacity, fuel consumption, travel time, and vehicle emissions [4]. Merging control algorithms for cooperative vehicles were presented in [5, 6] to create appropriate gap between vehicles from on-ramps to enter the motorway. In another effort, an optimal control framework for cooperative merging was presented to minimize fuel consumption [7]. A detailed summary of various approaches for coordination of CAVs at highway on-ramps can be found in [4].
Recently, an optimal control framework was developed to minimize travel time and fuel consumption of vehicles [8]. The research effort in [9] formulated an optimal control problem to minimize the engine effort and passenger discomfort. Some research efforts facilitated safe merging using optimization techniques [10], reinforcement learning [11] and multi-agent Q-learning [12]. The majority of research efforts in the literature have developed merging control algorithms without determining optimal merging sequence. Several effective solutions to compute optimal sequence can be achieved through scheduling theory [13]. Many scheduling theory-based control algorithms have been proposed in the literature to optimally coordinate the vehicles at various transportation scenarios [14, 15, 16, 17, 18, 19].
In our proposed framework, We model the problem of cooperative merging at highway on-ramps as a job-shop scheduling problem, and present an optimal scheduling algorithm through which each platoon derives the sequence and time to enter the highway safely. Then, we present an optimal control problem where each platoon derives the optimal control input (acceleration/deceleration) in terms of fuel consumption of the platoons at the highway.
The remainder of the paper is organized as follows. In Section II, we present the problem formulation and the optimal scheduling algorithm. In Section III, we provide an analytical solution for the optimal control problem. In Section IV, we evaluate the efficacy of the proposed framework through simulations, and present simulation results. We conclude with a discussion in Section V.
II PROBLEM FORMULATION
We consider a traffic scenario where a secondary road with single-lane merges onto another single-lane main road and P1, P2, P3 and P4 are the platoons of CAVs at merging roadways (Fig. 1).

The region where the secondary road merges onto the main road is called the merging zone (MZ) and has a length . The merging zone is a conflict area where a potential lateral collision could occur. There is also a control zone (CZ) inside of which the vehicles can communicate with each other. The length of the control zone is . A coordinator stores information about the geometry of the merging roadways and broadcasts this information back to the vehicles. Note that the coordinator does not take part in the decision-making process. In our modeling framework, we impose the following assumptions:
Assumption 1:
The communication between the coordinator and CAVs occurs without any errors and delays.
Assumption 2:
The platoons of CAVs enters the control zone as stable platoons, i.e., all the vehicles in the platoon move at a consensual speed and maintain the desired space between vehicles [20].
Assumption 3: The value of should be sufficiently
large so that a platoon can reach the speed limit before entering the merging zone.
The first assumption may be strong, but it is relatively
straightforward to relax it as long as the measurement noise and delays are bounded. We impose the second assumption since our main focus is to facilitate the safe merging of CAVs entering as platoons at highway on-ramps rather than the stability and formation of the platoons. However, future research should relax this assumption and study the implications of the proposed solution on the stability and formation of platoons. The third assumption is to enable the slower platoons with an initial speed less than the speed limit to reach the speed limit before they reach the merging zone.
II-A Vehicle Model and Constraints
Let be the number of platoons of CAVs arriving at the control zone at time . Each platoon receives a unique identification number from the coordinator at the time of entry into control zone. The queue of platoons of CAVs in the control zone is denoted by . Let , , be the number of vehicles in each platoon . We assume that each vehicle is governed by the second order dynamics
(1) |
where , , denote position, speed, and, acceleration/deceleration.
Let and be the time at which the leader vehicle enters the control zone and merging zone, respectively. Let denote the state of each vehicle with as initial state, where , taking values in the state space . The control input and speed of each vehicle is bounded with the following constraints
(2) | |||
(3) |
where are the minimum and maximum control inputs and are the minimum and maximum speed limits, respectively.
II-B Optimal Scheduling Algorithm for Platoons Crossing the Merging Zone
In this section, we apply scheduling theory to derive a control algorithm that provides the optimal schedule for each platoon to enter the merging zone. We consider a job-shop scheduling problem to find the optimal sequence and schedule for the platoons at merging roadways. A job-shop scheduling problem addresses the scheduling of multiple jobs on a single machine or several machines. It optimally allocates the jobs on the machines with an objective to improve the performance criteria. We model the problem of cooperative merging of platoons at highway on-ramps as a job-shop scheduling problem. We consider merging roadways as a single machine and the platoons of CAVs as jobs.
Let be the time that a platoon takes to reach the merging zone. We consider the speed at which the platoon enters the control zone as initial speed of the platoon. We consider two cases to compute the time at which each platoon reaches the merging zone. In Case 1, we consider that the initial speed of platoons is the same as the speed limit. In Case 2, we consider that the initial speed of platoons is less than the speed limit. Let be the initial speed of the platoon .
Case 1:
We compute using , i.e.,
(4) |
Case 2:
Let be the time taken by the platoon to accelerate to the speed limit. Then,
(5) |
Let be the distance traveled during acceleration, then,
(6) |
and thus,
(7) |
Let be the time that a platoon takes to exit the merging zone. Then,
(8) |
where is the number of CAVs in platoon , is the safe time gap provided to ensure safety of platoons entering and leaving the merging zone, and is the headway between consecutive CAVs in the platoon .
Definition 1: The completion time is the time taken by the platoon to completely exit the merging zone.The completion time of platoon is
(9) |
Definition 2: The total completion time of platoons to cross the merging zone is
(10) |
Definition 3: Let be the weight assigned to each platoon based on the priority. The total weighted completion time of platoons is
(11) |
We model the problem of cooperative merging of platoons of CAVs at highway on-ramps as job-shop scheduling problem [21], where 1 represents a single machine, and represents the total weighted completion time. A schedule is optimal if it minimizes . The objective of the modeled scheduling problem is to minimize the crossing time, i.e., the total weighted completion time of platoons at highway on-ramps. Each platoon leader solves problem to derive the time to enter the merging zone with the objective to minimize the crossing time of platoons at the merging zone, i.e., total weighted completion time of platoons. The platoons entering the merging zone from the main roadway are given higher priority than platoons entering from the secondary road. The higher priority to platoons in main roadway allow them to enter the merging zone before the platoons entering from the secondary road. The weights are assigned based on the priority of the platoon. We aim to avoid the deceleration of vehicles in the main roadway. Hence, for platoons entering the main roadway is assigned greater value than the the platoons entering from the secondary road. Each platoon leader communicates with the coordinator to acquire the information about the geometry and topology of the merging roadways. In addition, the platoon leaders broadcast their attributes including the link number, lane number, unique identification number, the speed at which they enter the control zone, maximum acceleration, maximum speed limit, number of followers in the platoon, safe time gap, headway and speed limit to other platoon leaders and coordinator.
The optimal scheduling algorithm running in each platoon leader uses the information of initial speed, maximum acceleration, and maximum speed limit to compute the time that a platoon arrives at the merging zone. Then, it uses the information of the length of the merging zone, number of followers in the platoon, safe time gap, headway of each platoon, and speed limit to compute the time that the platoon exits the merging zone. Next, it computes the completion time of each platoon based on the weights assigned to the platoons. Then, it calculates the total weighted completion time of platoons. Further, the algorithm arranges the platoons in the non-decreasing order of weighted completion time. Finally, the algorithm computes the time at which each platoon has to enter the merging zone. The proposed scheduling algorithm yields an optimal
schedule that minimizes the crossing time of platoons.
Theorem 1: A schedule is optimal in minimizing the crossing time of the platoons, i.e., the total weighted completion time if and only if it places the platoons in the order of non-decreasing weighted completion time .
Proof:
Let , , and be the platoons in the control zone arriving at time and . Let be the schedule in which platoons are not arranged in the order of non-decreasing weighted completion times of platoons. Then in schedule , platoon precedes platoon and . Let be the another schedule in which platoon precedes platoon . We know that , , and are the completion time of platoons , , and , respectively. Let , , and be the weights assigned to platoons , , and , respectively.
Let and be the total weighted completion time of the platoons in the schedule and , respectively. The total weighted completion time of schedules and are
(12) | |||||
(13) | |||||
(14) |
This contradicts the optimality of schedule . Hence, schedule in which platoons arranged in the order of non-decreasing weighted completion time is optimal.
II-C Optimal Control Problem
Each platoon leader computes the time to enter the merging zone using the optimal scheduling algorithm. Then, each leader derives the optimal control input to enter the merging zone in a schedule specified by the scheduling algorithm. The position of platoons in the queue designates the time that a platoon enters the merging zone. Here, we have two cases: 1) If , then the leader solves a time optimal control problem, and 2) if , then the leader solves an energy optimal control problem to derive the optimal control input. The leader broadcasts the derived schedule and optimal control input to the following vehicles until the last follower has completely crossed the merging zone.
II-C1 Time Optimal Control Problem
II-C2 Energy Optimal Control Problem
III Analytical Solution
In this section, we present the closed-form analytical solutions for the time (15) and energy (16) optimal control problems for each leader .
III-A Analytical Solution of the Time Optimal control problem
We derive the Hamiltonian function for each leader with the state and control constraints as follows
(17) |
where and are costates and , , , and are Lagrange multipliers. We derive optimal control input for platoons with initial speed either equal to speed limit or less than speed limit while entering the control zone.
Case 1:
In this case, the optimal control input is
(18) |
Substituting (18) in (1), we derive the optimal position and velocity
(19) | ||||
(20) | ||||
(21) | ||||
(22) |
where , , and are integration constants computed using the initial and final conditions in (15).
Case 2:
The optimal control input based on [22] is
(23) |
Substituting (23) in (1), we derive the optimal position and velocity,
(24) | ||||
(25) |
where is integration constant computed using the initial and final conditions in (15).
III-B Analytical Solution of the Energy Optimal Control Problem
For this problem, the Hamiltonian function for each leader is
(26) |
where and are costates, and , , , and are the Lagrange multipliers and as the state and control constraints are not active. The optimal control input based on [23] is
(27) |
substituting (27) in (1), we get the optimal position and velocity,
(28) | ||||
(29) |
where , and are integration constants computed using initial and final conditions in (16).
IV Simulation Results and Discussions
We model the traffic scenario where secondary road with single lane merges onto single lane main road in VISSIM 11.00 simulation environment. The size of platoons entering the main roadway varies from to vehicles. The size of platoons entering from the secondary road ranges from to vehicles. The length of the merging zone is designed to be . Based on Assumption 3, the length of the control zone is designed to be so that the platoons can reach the speed limit before entering the merging zone. The maximum speed limit is set as . The maximum acceleration and minimum deceleration limit are and , respectively.
The optimal scheduling algorithm is implemented in MATLAB. The information of the platoons are collected in real-time through COM interface from the VISSIM simulation environment. Based on the collected information, each platoon leader calculates the time to enter the merging zone. Further, the optimal control input for each platoon to enter the merging zone is derived. The speed of platoons corresponding to the derived optimal control input is updated in real-time through COM interface in VISSIM.
We compare the performance of the proposed framework with a baseline scenario where the vehicles from secondary road stop and yield for vehicles entering from the main road. We design the volume of vehicles entering from the main road as . The volume of vehicles entering the secondary road is considered as . The simulation is run for seconds. The performance measures of the vehicles under baseline scenario and proposed optimal framework are shown in Figs. 2, 3, 4, and 5. The proposed framework eliminated the stop-and-go driving behavior and resulted in negligible delay for platoons. The proposed framework reduced average travel time and fuel consumption by 54.3% and 57.8%, respectively. The average delay is reduced by 88.92% and the average speed of platoons is increased by 63.53% compared to the baseline scenario.




V Concluding Remarks and Discussions
In this paper, we presented an optimization framework for cooperative merging of platoons of CAVs at highway on-ramps. We modeled the problem as a job-shop scheduling problem and presented an algorithm to derive the schedule of each platoon to enter the merging zone. Then, we provided the analytical solution for the optimal control problem to minimize fuel consumption and crossing time of platoons at highway on-ramps. We validated the proposed framework through simulations, and we noticed significant improvements in fuel consumption, while minimizing stop-and-go driving behavior.
Ongoing efforts consider lane changes for coordination of CAVs at multi-lane roads [24] and multiple scenarios [25]. In our framework, we assumed that vehicles form stable platoons before arriving the control zone. Future research should focus on the stability and formation of the platoons along with cooperative merging in mixed traffic environment with human-driven vehicles and CAVs.
References
- [1] M. Athans, “A unified approach to the vehicle-merging problem,” Transp. Res.,vol. 3, no. 1, pp. 123–133, Apr. 1969.
- [2] M. Papageorgiou and A. Kotsialos, “Freeway ramp metering: An overview,” IEEE transactions on intelligent transportation systems, vol. 3, no. 4, pp. 271–281, 2002.
- [3] L. Zhao and A. A. Malikopoulos, “Enhanced mobility with connectivity and automation: A review of shared autonomous vehicle systems,” IEEE Intelligent Transportation Systems Magazine, 2020.
- [4] J. Rios-Torres and A. A. Malikopoulos, “A survey on the coordination of connected and automated vehicles at intersections and merging at highway on-ramps,” IEEE Transactions on Intelligent Transportation Systems, vol. 18, no. 5, pp. 1066–1077, 2017.
- [5] R. Scarinci, B. Heydecker, and A. Hegyi, “Analysis of traffic performance of a merging assistant strategy using cooperative vehicles,” IEEE Transactions on Intelligent Transportation Systems, vol. 16, no. 4, pp. 2094–2103, 2015.
- [6] A. Mosebach, S. Röchner, and J. Lunze, “Merging control of cooperative vehicles,” IFAC-PapersOnLine, vol. 49, no. 11, pp. 168–174, 2016.
- [7] J. Rios-Torres and A. A. Malikopoulos, “Automated and cooperative vehicle merging at highway on-ramps,” IEEE Transactions on Intelligent Transportation Systems, vol. 18, no. 4, pp. 780–789, 2017.
- [8] W. Xiao and C. G. Cassandras, “Decentralized optimal merging control for connected and automated vehicles,” In 2019 American Control Conference (ACC), pp. 3315–3320, 2019.
- [9] I. A. Ntousakis, I. K. Nikolos, and M. Papageorgiou, “Optimal vehicle trajectory planning in the context of cooperative merging on highways,” Transportation research part C: emerging technologies, vol. 71, pp. 464–488, 2016.
- [10] G. Raravi, V. Shingde, K. Ramamritham, and J. Bharadia, “Merge algorithms for intelligent vehicles,” Proc. Next Gener. Des. Verif. Methodol. Distrib. Embed. Control Syst., pp. 51–65, 2007.
- [11] P. Wang and C. Y. Chan, “Autonomous ramp merge maneuver based on reinforcement learning with continuous action space,” arXiv preprint arXiv:1803.09203, 2018.
- [12] L. Schester and L. E. Ortiz, “Longitudinal position control for highway on-ramp merging: A multi-agent approach to automated Driving,” In 2019 IEEE Intelligent Transportation Systems Conference pp. 3461-3468, 2019.
- [13] P. Brucker and P. Brucker, “Scheduling algorithms,” Vol. 3. Berlin: Springer, 2007.
- [14] J. Wu, A. Abbas-Turki, and A. El Moudni, “Cooperative driving: an ant colony system for autonomous intersection management,” Applied Intelligence, vol. 37, no. 2, pp. 207–222, 2012.
- [15] L. Bruni, A. Colombo, and D. Del Vecchio, “Robust multi-agent collision avoidance through scheduling,” In 52nd IEEE Conference on Decision and Control, pp. 3944–3950, 2013.
- [16] N. Murgovski, G. R. de Campos, and J. Sjöberg, “Convex modeling of conflict resolution at traffic intersections,” In 2015 54th IEEE conference on decision and control, pp. 4708–4713, 2015.
- [17] G.R. De Campos, F. Della Rossa, and A. Colombo, “Optimal and least restrictive supervisory control: Safety verification methods for human-driven vehicles at traffic intersections, In 2015 54th IEEE Conference on Decision and Control, pp. 1707–1712, 2015.
- [18] B. Chalaki and A. A. Malikopoulos, “Time-optimal coordination for connected and automated vehicles at adjacent intersections,” arXiv preprint arXiv:1911.04082, 2020.
- [19] M. A. Guney and I. A. Raptis, “Scheduling-Based Optimization for Motion Coordination of Autonomous Vehicles at Multilane Intersections,“ Journal of Robotics, 2020.
- [20] W. S. Levine, and M. Athans, “On the optimal error regulation of a string of moving vehicles,” IEEE Transactions on Automatic Control, Vol. 11, no. 3, pp.355-361. 1966.
- [21] W. E. Smith, “Various optimizers for single‐stage production,” Naval Research Logistics Quarterly, Vol. 3, no. 1‐2, pp. 59–66, 1956.
- [22] S. D. Kumaravel, A. A. Malikopoulos, and R. Ayyagari, “Optimal coordination of platoons of connected and automated vehicles at signal-free intersections,” arXiv preprint arXiv:2001.04866, 2020.
- [23] A. A. Malikopoulos, C. G. Cassandras, and Y. Zhang, “A decentralized energy-optimal control framework for connected automated vehicles at signal-free intersections,”Automatica, vol. 93, pp. 244–256, 2018.
- [24] A. A. Malikopoulos, Beaver, L.E., and Chremos, I.V., “Optimal Time Trajectory and Coordination for Connected and Automated Vehicles,”Automatica, vol. 125, pp. 109469 2021.
- [25] B. Chalaki and A. A. Malikopoulos, “Optimal Control of Connected and Automated Vehicles at Multiple Adjacent Intersections,” IEEE Trans. on Control Systems Tech., arXiv preprint arXiv:2008.02379, 2021.