Skip to main content

A quantitative study of Cooperative Awareness Messages in production VANETs

Abstract

In Vehicular Ad-hoc Networks (VANETs), vehicles gather Cooperative Awareness Messages (CAMs) sent from other vehicles via wireless broadcast. Each received message has to be processed by an in-vehicle system. In series implementations, such an in-vehicle system needs to cope with limited resources whose capacity is not yet defined. Therefore, information about the received CAM rate is a crucial input for the development of series VANET products. CAMs from distant vehicles are less likely to be received than those of nearby vehicles. Designers of applications leveraging CAM information are interested in the frequency of received CAMs originating from vehicles depending on their distance. In this paper, we study future CAM rates depending on various parameters. We set up a road traffic simulation for selected highway scenarios. We estimate the rates of generated CAMs and introduce the notion of relative channel load. We present a new approximative channel model to determine a vehicle’s message reception probability. That model is used to simulate the rates of received CAMs for each vehicle. Moreover, we investigate the origin of received CAMs and times between consecutive CAMs received from the same sender (inter-reception times) depending on distance. Most results depend on the penetration rate of VANET technology that will increase in the near future. We derive approximative formulae and use them to validate our simulation results. They are quite accurate, and so they may also serve for simple forecasts. The results from our analysis show that the rates of generated and received CAMs lead to several challenges for the design of an efficient and robust VANET implementation.

1 Introduction

Wireless communication among vehicles and between vehicles and roadside infrastructure has been identified [1] as a key technology to enhance road traffic safety, advance driving comfort, and increase ecological and economic efficiency. Typical terms for these efforts are Vehicular Ad-hoc Networks (VANETs), Car-to-Car communication (Car2Car, C2C), or Vehicle-to-Vehicle communication (V2V).

Currently, VANET technology is on the leap to market introduction. A set of standards for a first implementation will be finished soon, and harmonization among continents is taking place. Multiple field tests of different extent are conducted and show the practicability of these standards [2]. In the context of this work, the main result of the European standardization is the use of two types of messages: event-based messages and status information messages [3, 4]. The latter is sent frequently by each participating vehicle to inform receivers about their environment and to support various applications. They are called Cooperative Awareness Messages (CAMs). A CAM is sent only when a set of rules is met so that the resulting CAM send frequency can be 1 to 10 Hz. The CAMs are aggregated in a so-called local dynamic map (LDM). From this database, information about the traffic situation can be extracted.

In recently conducted experiments and field operational tests, the abundant processing power for the low rate of received CAMs was more than sufficient. However, in series vehicles, this will be challenging for several reasons. The hardware is embedded and provides less computing capabilities than the powerful hardware that is usually installed in experimental vehicles. Also, the field operational tests have a limited number of participating vehicles and are focused on message processing at lower networking layers. Therefore, a bottleneck in the processing chain could not be detected so far. However, the CAM load in in-vehicle systems will increase with the penetration rate of VANET technology in series vehicles. Initial market introductions are expected for 2015 according to a memorandum of understanding among European car manufacturers [5]. Each VANET system that is sold has to be able to cope with rising penetration rates for its complete lifetime [6, 7]. This is a challenge and the motivation for this study of CAMs in future VANETs.

Our methodology is as follows. We set up a road traffic simulation for two selected highway scenarios. First, we derive the rate of CAMs which are generated by each vehicle based on its movement. Second, we introduce a new statistical channel model which computes the probability for a successful message reception based on distance between sender and receiver, and a newly defined relative channel load. This allows the calculation of the rate of CAMs received by vehicles equipped with VANET technology. We use the statistical channel model to give approximation formulae to validate the results of the simulation. We use these formulae to conduct parameter studies of the relative channel load and received CAM rates. Finally, we use our simulation and analytic estimations to quantify the frequency of CAMs received from a certain vehicle depending on distance and characterize the local origin of all received CAMs.

The remainder of this paper is organized as follows. Table 1 provides an overview of the abbreviations and symbols used in this paper. In Section 2, we briefly review related work. Section 3 gives an introduction to the standardized message types and their triggers. The core Sections 4 and 8 are structured as depicted in Figure 1. Section 4 presents the simulation setup and scenarios used to evaluate the rate of generated CAMs. In Section 5, we introduce a new statistical channel model to derive the reception probability of a CAM. In Section 6, we investigate the channel load by extending our simulation and using an estimating formula, which we also use in Section 7 to determine the rates of received CAMs. Section 8 describes an analysis of the origins of received CAMs. In Section 9, we evaluate times between consecutive CAMs received from the same vehicle (inter-reception times) depending on its distance. Finally, in Section 10, we conclude and provide an outlook on further research.

Table 1 List of abbreviations and symbols
Figure 1
figure 1

Organization of the paper. The work is structured into CAM generation, transmission, and reception.

2 Related work

Standards for VANET technologies are in the finalization process for a first market introduction. In parallel, national and international field operational tests are conducted. Their aim is to prove the interoperability and practical feasibility of the standards. Three recently conducted field operational tests were realized in Germany (sim TD), France (score@F), and Europe (DRIVE C2X) [810]. As they focused on the communication between vehicles, these field operational tests utilized powerful hardware. For implementation in series vehicles, less powerful hardware will be used for size, cost, and robustness reasons.

In academic research on the topic of VANETs, complete tool chains for simulations are usually used. Examples for such tool chains are VEINS and VSimRTI [11, 12]. Instead of applying one of these products, we chose to build our own tool chain. This simplifies the use of our new statistical channel model and the controllability of all simulation modules. Nevertheless, we take advantage of available tools like the road simulator SUMO [13].

Several papers report investigations of radio transmission quality in real experiments [14, 15]. In general, line-of-sight is one key for a high message reception probability. Therefore, we focus on highway scenarios on parallel lanes where line-of-sight between communicating vehicles can be assumed. In contrast, highway interchanges are places with a very high number of vehicles and high message sending rates, but the radio transmission quality between the street levels is low.

Statistical channel models for reception of VANET messages have been published in [16, 17] based on studies in [18]. We adapt them by incorporating a simple representation for the hidden station effect into the channel model. This effect was identified to be the dominant one for multiple sender scenarios in a non-congested channel [19].

Characteristics of message reception in VANETs have been gathered in several publications, e.g., [2023]. The results depend on the setup of the conducted experiment or simulation, the tools applied, usage of recent standards, and overall objectives. To our knowledge, there is no approach available that combines a statistical channel model and available European VANET standards and estimates channel load, rates of received CAMs, inter-reception times between CAMs from a vehicle depending on distance, and the spatial distribution of the origin of received CAMs. These performance metrics are required for the sizing and design of a CAM-processing architecture in series vehicles and for developers of applications using CAM information.

3 VANET message types and message triggers

The European Telecommunications Standards Institute (ETSI) defined two message types to support VANET applications: Decentralized Environmental Notification Messages (DENMs) and Cooperative Awareness Messages (CAMs). We briefly review their purpose and describe under which conditions they are triggered.

3.1 Decentralized Environmental Notification Message

DENMs are used by vehicles and roadside infrastructure to notify other traffic participants about specific events on or near the roads. Each DENM is the result of an event detection process conducted by the sending vehicle, and therefore, DENMs occur infrequently and rarely [3]. Because of their rare occurrence, DENMs do not create a large processing load at the receiver. For this reason, we can neglect them in our following investigations.

3.2 Cooperative Awareness Messages

To enable vehicles to be aware of their environment, all vehicles and some road infrastructure devices in a VANET broadcast CAMs [4]. CAMs contain information about the sender like vehicle type, position, heading, speed, and acceleration. Each participating vehicle has to send CAMs on a regular basis. The receiver of such messages interprets them and creates a so-called local dynamic map (LDM). The LDM is an environment database maintained in and by each vehicle and supports various applications.

The quality of the environment awareness correlates with the number of CAMs received from traffic participants. However, unnecessary status updates from many senders, e.g., for standing vehicles, could lead to channel congestion. Therefore, CAMs are only triggered when a set of rules is met [3]:

  • The current heading of the vehicle differs at least 4°

  • from the heading in the last CAM, or

  • The current position of the vehicle differs at least 4 m

  • from the position in the last CAM, or

  • The current speed of the vehicle differs at least 0.5 m s

  • from the speed in the last CAM, or

  • The last CAM was sent 1 s earlier.

Each of these conditions has to be checked repeatedly after a back-off time TOff[3, 24]. Usually TOff is set to 100 ms. To avoid channel congestion, TOff is set to higher values if the relative channel load exceeds 25%. This ultimately leads to lower CAM generation frequencies.

4 Simulative approximation of CAM generation

In this section, we describe the setup for our road traffic simulation and introduce two realistic road traffic scenarios. The road traffic simulation generates movement traces for all simulated vehicles. We use these traces to derive the instances of CAM transmissions. They yield a characterization of CAM inter-generation times, and they are input to the channel model in the next section.

4.1 Road traffic simulation

Our tool chain utilizes the microscopic and continuous traffic simulator SUMO for vehicle trace generation [13]. We chose SUMO because of its convenience, features, and wide acceptance in the field of VANET simulation [25]. Moreover, SUMO is computationally efficient even for big simulation scenarios [26].

Since SUMO’s ability to save vehicle traces into files is limited, we chose to use the traffic control interface (TraCI) to connect a Java program via TCP connection to SUMO. This approach allows us to get all vehicle information we need and save it to a file on disk for later use [27].

Figure 2 illustrates our simulation tool chain from the map extraction to the output of the vehicle trajectory dump: We extracted a road map from OpenStreetMap via jOSM, which we converted with the SUMO tool netconvert to a network file. This network file and a route file created with the tool traffic modeler is the input for SUMO [28]. Our own tool TraCI Dump saves the vehicle trajectories of the traffic simulation to a file. This file is then used by a CAM triggering program to generate logs which contain information about all generated CAMs.

Figure 2
figure 2

Overview of the simulation tool chain.

4.2 Derivation of CAM generation instances

Based on the vehicle trajectory dump created with SUMO, we execute the CAM triggering algorithm as described in Section 3.2. For each simulation time step, a check is performed whether the conditions for the generation of a new CAM are met, as long as a vehicle has not left the simulated map section. Each CAM and its generation time is logged and accumulated for statistical analysis.

4.3 Road traffic simulation scenarios

We chose two typical German map sections: one from the Autobahn A5 south of Frankfurt having eight lanes in parallel (see Figure 3) and the other from the Autobahn A6 near Nuremberg having the typical four parallel lanes on German highways (see Figure 4). Both Autobahn sections have low crash barriers and no walls between the lanes. We assume the VANET antennas to be mounted on top of the vehicles and, therefore, can postulate line-of-sight for message transmission on the wireless channel.

Figure 3
figure 3

Simulated road section A5. Autobahn A5 south of Frankfurt, Germany. CAMs received within the boxed areas are used for the statistics.

Figure 4
figure 4

Simulated road section A6. Autobahn A6 west of Nuremberg, Germany. CAMs received within the boxed areas are used for the statistics.

The traffic simulator was parameterized in a way that vehicle departs, speeds, and routes ensure a high vehicle density and high vehicle speeds. The road sections for traffic simulation also contain highway interchanges and ramps. This ensures typical road traffic entropy and helps to avoid homogeneous and unnatural effects in vehicular movement. We limit the area for statistical analyses to highway areas between the interchanges. Statistics for receivers are gathered only within an area with a distance of at least 1 km to the intersections.

Our simulations cover about 8,000 and 6,000 vehicles on the A5 and A6 scenario within a time frame of 1 h. The simulation proceeds in time steps of 100 ms so that time is measured as a multiple of 100 ms in the simulation results.

4.4 Numerical results

We first illustrate and analyze the dependence of distance between vehicles, CAM inter-generation times, and CAM rate density on vehicle speeds.

4.4.1 Dependency of CAM generation on vehicle speeds

As CAM generation rules take vehicle dynamics into account, the CAM generation rate per vehicle increases with the vehicle’s speed. Furthermore, the average distance between vehicles increases with speed [29]. As a result, the CAM rate density, i.e., the CAM rate generated per road segment and time interval, also depends on the average vehicle speed. We illustrate these relationships in the following.

Figure 5 shows the average inter-vehicle distance d vehicle inter . For safety reasons, it increases with increasing speed [29]. The figure also shows how the time between consecutively generated CAMs by each vehicle T CAM inter decreases with increasing speed v of that vehicle. To determine the speed for which we can expect the highest CAM rates on the transmission channel, we define the CAM rate density as

σ CAM = n lanes · σ vehicle T CAM inter with
(1)
Figure 5
figure 5

Impact of vehicle speed. The CAM inter-generation time and the inter-vehicle distance depend on the average vehicle speed.

σ vehicle = 1 d vehicle inter + l vehicle
(2)

The parameter nlanes is the overall number of lanes in both directions, and lvehicle indicates the average vehicle length so that σvehicle is the vehicle density on a single lane in terms of number of vehicles per meter. Multiplying the CAM rate density σCAM with a road distance yields the CAM rate generated on that road section. Figure 6 shows the CAM rate density of a single lane. It first increases and then decreases with increasing speed so that we observe a maximum CAM rate density at a speed of 72 km h . Therefore, we chose that speed to run our simulations in the following.

Figure 6
figure 6

CAM rate density for a single lane. The CAM rate density σCAM depends on the average vehicle speed v.

4.4.2 CAM inter-generation times

Figure 7 shows a histogram of CAM inter-generation times from vehicles in our simulation. The time between most consecutive CAMs is 200 ms. This is a characteristic value for free or synchronized traffic on highways where the typical cruise speed is 72 to 144 km h . At that speed, vehicles change their position by more than 4 m after 200 ms which triggers the generation of a CAM, yielding that value a typical CAM inter-generation time.

Figure 7
figure 7

CAM inter-generation time. Histogram of time T CAM inter between consecutive CAMs generated by vehicles in the simulation.

5 Channel approximation model

In this section, we introduce a new statistical channel model. It will be used to compute the reception probability of a message depending on the distance between sender and receiver and the current relative channel load. We use the statistical channel model to simulate the reception of each generated CAM by other vehicles. We do not use discrete-event network simulators like ns-2 or OMNet++ because of their complexity and huge set of tunable parameters. The statistical channel model provides the most relevant characteristics of the radio channel for our purposes.

First, we define the notion of relative channel load. Then, we derive the new statistical channel model by explaining its main components: signal attenuation for a single sender-receiver pair and the hidden station phenomenon which is the dominating effect in the presence of multiple senders and low channel loads [19].

5.1 Definition of relative channel load

A vehicle’s antenna obtains signals from all senders within its maximum achievable communication range with radius d range comm . The rate of generated CAMs from vehicles within this range is denoted by r sent cr . The fraction of r sent cr and the transmission bandwidth C define the channel load for message size BCAM:

ρ= r sent cr · B CAM C .
(3)

We use the default transmission bandwidth of 802.11p, i.e., C=6 Mbit s , and a message size of BCAM=200 bytes [4, 30].

5.2 Signal attenuation for a single sender and receiver

The Nakagami m-distribution is a well-known model to accurately characterize signal attenuation in wireless channels [31]. This holds also for VANETs and was experimentally validated for typical setups [18]. Killat et al. used a tuned model of the Nakagami m-distribution to provide a function for the reception probability of a message depending on the distance d between sender and receiver. They validated their model using a discrete-event network simulation [16, 17].

The model divides the communication range d range comm in two parts. For small distances, the model considers Friis path loss, while for higher distances, it considers the two-ray ground model. The transition distance is denoted as the crossover distance

d co =4·π· h snd · h rcv λ ,
(4)

where hsnd and hrcv are the installation heights of the sender’s and receiver’s antennas and λ is the wavelength of the signal [32, 33]. For distances greater than dco, the signal reflection on the ground as formulated by the two-ray ground model needs to be respected.

They derived the following formula for the transmission success rate:

P Nakagami success ( d ) = e - 3 d d range comm 2 · 1 + 2 ( d d range comm ) 2 + 9 2 d d range comm 4 , ifd d co e - 3 γ d 2 d range comm 2 · 1 + 2 γ d 2 d range comm 2 + 9 2 γ 2 d 2 d range comm 4 , ifd > d co .

The parameter γ depends on the height of both sender and receiver antennas and the wavelength of the signal, and can be calculated as

γ= λ 4 · π · h snd · h rcv 2 = d co - 2 .
(5)

5.3 Hidden station phenomenon for multiple senders

Because of several effects, the message reception probability in multiple sender scenarios is lower than in single sender-receiver scenarios. In case of an uncongested channel, the dominating phenomenon in multiple sender scenarios was found to be the hidden station effect [19]. This effect is caused by several sending nodes in the reach of a receiving node but with each sending node being out of the reach of the other sending nodes. In such constellations, the sending nodes are not able to coordinate the channel access and possibly send messages at the same time. This leads to colliding signals on the channel at the receiving node and hence decreases the probability for correct message reception.

The hidden station effect has multiple manifestations, but the dominant one comes into play after the hidden station range dHS which is a section of the communication range d range comm . With a required signal-to-noise ratio threshold ΓSNR for successful decoding and a path loss coefficient μ, we calculate dHS as

d HS = d range comm 1 + Γ SNR 1 μ .
(6)

For constant μ, P hidden loss increases linearly with increasing distance [19]:

P hidden loss (d,ρ)1.5·ρ· T air T air + T CA · d - d HS d HS - 1 m ,
(7)

where Tair corresponds to the air time of a packet and TCA corresponds to the channel access time.

5.4 Combination of effects

We combine P Nakagami success and P hidden loss as independent effects and calculate the message reception probability

P combined success ( d , ρ ) = 1 - P hidden loss ( d , ρ ) · P Nakagami success ( d ) .
(8)

According to European standardization, congestion control will be implemented on multiple network layers, including the access layer [34]. Thus, the transmission of CAMs is governed by a congestion control mechanism whose objective is to keep the channel load low enough to guarantee efficient transmission. It takes effect at a relative channel load of 25% and above. Since our model does not respect congestion control effects, it is valid only up to a relative channel load of 25%.

5.5 Numerical results

In our studies, we use the channel parameters provided in Table 2. For this set of parameters, Figure 8 shows the reception probability of a CAM depending on the distance d between sender and receiver and on the relative channel load ρ. The reception probability decreases with the distance. It is almost independent of the studied channel load up to a distance of 250 m. From then on, larger channel loads lead to lower CAM reception probabilities and the impact of the relative channel load on the reception probability is large, in particular in the range between 300 and 900 m. Relative channel loads ρ larger than 25% are not investigated because the applied channel model is not valid for that range. It would rather overestimate reception probabilities for such relative channel loads.

Table 2 Parameter configuration for the channel model
Figure 8
figure 8

Illustration of the output of the channel model. The message reception probability depends on the distance between sender and receiver and the relative channel load. The model is only valid for relative channel loads ρ ≤ 25% as it ignores congestion control effects.

6 Estimation of relative channel loads

In the following, we first explain how the relative channel load is computed from logged CAM generation instants in the simulation. Then, we propose a simple formula that approximates the channel load depending on characteristic parameters. Finally, we discuss simulation results and compare them with analytical results. We show that the formula matches the simulated channel load quite well and use it to conduct a parameter study.

6.1 Simulative approximation of relative channel loads

Figure 9 depicts our simulation tool chain for the determination of the relative channel load. The logged CAMs from Figure 2 are the input for an aggregation program which determines the local channel load for each receiving vehicle. We describe the performed steps in the following.

Figure 9
figure 9

Tool chain to determine the channel load. The logged CAMs are aggregated over the receivers’ vicinities to calculate their perceived relative channel load.

In Section 4, we used the output of the road traffic simulation to determine the instances at which vehicles would trigger CAMs. We now use these data in combination with the penetration rate of VANET technology to determine the rate r sent cr of sent CAMs in the vicinity of a receiver. The penetration rate φ is the ratio of vehicles which are equipped with VANET technology.

We first determine which vehicles actually send CAMs in a specific time step. Then, we summarize the number of broadcasted CAMs within a range of d range comm to determine the local rate of sent CAMs r sent cr for each receiver and each simulation time step. Using r sent cr and Equation 3, we can calculate the perceived relative load ρ for each receiver and each simulation time step. The mean relative channel load ρ ¯ is calculated as the average relative channel load over all simulated intervals and all receivers. We use it for validation and illustration purposes.

6.2 Analytical approximation of relative channel loads

To derive an analytical formula for the average relative channel load, we first calculate the average rate of messages triggered in the vicinity of each receiver by

r ¯ rcvd cr =2· n lanes · d range comm · σ vehicle ·φ· 1 T sent CAM .
(9)

This analytical approximation assumes straight roads, equidistant vehicles, and constant vehicle speeds leading to a constant time T sent CAM between two consecutive CAMs from a single vehicle.

The average rate r ¯ rcvd cr of CAMs triggered in the vicinity of a receivers may be input to Equation 3 to calculate the average relative channel load.

6.3 Numerical results

Figure 10 depicts the average relative channel load from simulative and analytical approximation (circles and solid line, respectively) on the A5 and A6 scenarios. We observe, that the values depend about linearly on the penetration rate φ.

Figure 10
figure 10

Relative channel loads in the A5 and A6 scenarios. Simulated and approximated relative channel loads for the A5 (nlanes = 8) and the A6 (nlanes = 4) scenarios. Relative channel loads above the congestion control threshold are overestimated.

As mentioned before, our study is only valid for relative channel loads up to ρ = 25%. That value is reached in the A5 scenario for a penetration rate of φ = 40% and in the A6 scenario for a penetration rate of φ = 80%. For the A5 scenario, penetration rates φ of 10% and 20% lead to relative channel loads of 6.25% and 12.5%, respectively. The congestion control mechanism tries to mitigate channel congestion by adjusting several regulators like transmit power control, transmit rate control, transmit data rate control, and transmit access control. This effectively means that the transmission rate of a sender can be reduced which leads to message queuing, delay, and loss. Thus, CAM information may be outdated when it arrives at the receiver. To avoid such situations, the time between consecutive CAMs needs to be increased to generate them less frequently, which in turn decreases the surrounding awareness of the receiving vehicles. As we have not integrated congestion control in our simulative and analytical approximation, the relative channel loads larger than 25% are overestimated. From a relative load of 40% onwards, the wireless channel is even considered congested. We conclude that CAMs can fill the radio channel in the presence of moderate and high penetration rates in the future to such an extent that the available transmission capacity might not suffice to deliver all CAMs in time.

The solid line in Figure 10 shows the corresponding results approximated by Equations 9 and 3. We used T sent CAM =0.2 s according to our results from Section 4.4 and σ vehicle = 1 35 m for an average vehicle speed of v=72 km h according to the inter-vehicle distances described in Section 4.4.1. We observe that simulated and approximated results are in good accordance. This validates the simulation results. This also recommends the analytical approximation formula for parameter studies.

We determine under which conditions a certain relative channel load can be achieved. Figure 11 shows the penetration rate φ and the number of parallel lanes for which a relative channel load of 10%, 25%, and 40% is achieved. We consider very large highways of up to 20 parallel lanes; such highways exist, e.g., Highway 401 in Toronto, Canada, which has 10 lanes in each direction. As our channel model is valid only up to a channel load of ρ = 25%, the line for ρ = 40% is just a lower bound on the true values.

Figure 11
figure 11

Conditions leading to a certain relative channel load. Penetration rate φ and the number of parallel lanes nlanes determine the relative channel load ρ.

7 Estimation of received CAM rates

We use the presented channel model to estimate the received CAM rates for vehicles in various scenarios. Additionally, we estimate the number of CAMs a vehicle receives from other passing vehicles in the opposite direction. We use simulation and analytical approximation to obtain numerical results.

7.1 Simulative approximation of received CAM rates

Figure 12 depicts the used tool chain for the simulative approximation of received CAM rates. The triggered CAMs and the logged channel loads are input for a channel model function block which provides data for statistics.

Figure 12
figure 12

Tool chain to compute received CAM rates. The channel model computes a CAM reception probability with respect to the current channel load. It is used to simulate which of the generated CAMs are received by a vehicle. These data are gathered by statistics.

The simulation in Section 4 determines all CAMs that are triggered and sent in a particular time step of 100 ms. In Section 6, we derived the relative channel load at the position of each potential receiver. We compute the reception probability for each sender-receiver pair and for all logged CAMs. With this reception probability, we determine whether CAMs are successfully received by a vehicle. The corresponding CAM rate r rcvd CAM is computed by counting all received CAMs over 10 simulation steps which covers a duration of 1 s, which yields the number of CAMs received by each vehicle in one second.

7.2 Analytical approximation of received CAM rates

We assume that all sent CAMs are equally distributed within the communication range of a receiver. The reception probability decreases with increasing distance to the sender. We further assume that the width of a lane is small compared to the communication range d range comm and approximate the average reception probability for a CAM by

P ¯ combined success = 0 d range comm P combined success d d d range comm .
(10)

Multiplication with the CAM rate in the communication range of a receiver yields

r rcvd CAM = r ¯ sent cr · P ¯ combined success
(11)

as analytical approximation of the received CAM rate.

7.3 Numerical results

We first analyze the received CAM rates in the A5 and A6 scenarios depending on the penetration rate. Then, we study the relative channel load and received CAM rates of vehicles in the A5 scenario for given vehicle speeds and penetration rates. Finally, we characterize under which conditions certain rates of received CAMs can be expected.

7.3.1 Received CAM rates depending on penetration rates in the A5 and A6 scenarios

Figure 13 illustrates the rates of CAMs received by vehicles on the A5 and A6 scenarios depending on the penetration rate φ. Analytically approximated data are given by solid lines and simulated mean values by circles with error bars showing the standard deviation. Maximum simulated values are given by small rectangles. Note that standard deviations and maximum values depend on the time frame over which we calculated the received CAM rate r rcvd CAM ; it was 1 s in our study. The received CAM rates increase slightly less than linearly with the penetration rate for the same reason as discussed above. For CAM rates of up to 500 CAMs s , the channel model is sufficiently accurate due to the absence of congestion control. That CAM rate occurs in the A5 and the A6 scenarios for a penetration rate of φ = 40% and φ = 80%, respectively. Moreover, CAM rate peaks exceeding that boundary might appear even with congestion control being implemented because such a mechanism needs some time to take effect. We already observe high received CAM rates even for low penetration rates. In the A5 scenario, a penetration rate of 10% and 20% corresponds to relative channel loads of 6.25% and 12.5% which leads to up to 150 and 280 CAMs s , respectively.

Figure 13
figure 13

Rate of received CAMs in the A5 and A6 scenarios. Simulated and approximated received CAM rates for the A5 (nlanes = 8) and the A6 (nlanes = 4) scenarios. Received CAM rates above the congestion control threshold are overestimated.

7.3.2 Received CAM rates depending on vehicle speeds in the A5 scenario

We investigate the relative channel load and the received CAM rates for a penetration rate of φ{0.1,0.2,0.4,0.6} and for vehicle speeds of v=10 km h and v=72 km h in the A5 scenario (nlanes = 8). The x-axis in Figure 14 shows the obtained relative channel load, and the y-axis shows the received CAM rate for these data points. We first observe that the data points yield almost a line because the received CAM rate depends about linearly on the relative channel load. The red line indicates a straightly linear curve. However, the growth of the curve is less than linear for large relative channel loads ρ because an increase of the relative channel load reduces the reception probability of CAMs. Due to the limitations of our channel model, only the data points with a relative channel load of at most ρ = 25% are valid. The lowest data point corresponds to φ = 0.1 and the highest data point to φ = 0.6 for each vehicle speed. We observe that slow traffic (v=10 km h ) such as traffic jam leads to clearly lower channel load and received CAM rates than fast traffic (v=72 km h ) in similar scenarios. This is due to the fact that the CAM rate density is largest for speeds around v=72 km h which has been illustrated in Figure 6. The A5 scenario comprises nlanes = 8 lanes, while the A6 scenario comprises only nlanes = 4 lanes. Therefore, the A6 scenario yields the same data points for doubled values of the penetration rate φ. Therefore, we have omitted the results for the A6 scenario to avoid overlapping data points in the figure.

Figure 14
figure 14

Relation between relative channel load and received CAM rate in the A5 scenario. Data points are provided for the A5 scenarios with nlanes = 8 lanes and penetration rates of φ{0.1,0.2,0.4,0.6} and two different speeds. The lowest marker of each type corresponds to φ = 0.1, the highest one to φ = 0.6.

7.3.3 General parameter study for received CAM rates

We now evaluate under which conditions certain received CAM rates may be obtained. Figure 15 shows which penetration rates φ and which number of lanes nlanes may lead to received CAM rates of r rcvd CAM {125,250,500} CAMs s . On roads with only two lanes, 125 and 250 CAMs s are obtained only for a penetration rate of 33% and 70%, respectively, which is rather high. However, on highways with eight lanes, 125, 250, and 500 CAMs s are already reached for penetration rates of 8%, 18%, and 40%, a situation that may be faced in the next years.

Figure 15
figure 15

Conditions leading to a certain received CAM rate. Penetration rate φ and number of parallel lanes nlanes determine the received CAM rate r rcvd CAM .

We conclude that even for low penetration rates, series vehicles equipped with VANET technology according to current standardization have to handle several hundreds of messages per second under challenging conditions. Considering the usual restrictions for automotive hardware and software regarding robustness, size, and cost, there are two ways to deal with this challenge, with the option to combine both of them. First, the hardware capabilities are dimensioned sufficiently high which in turn leads to higher costs and potentially larger size. Second, the CAM processing chain is designed sufficiently smart. For instance, the CAM processing engine may serve most important CAMs preferably so that only least important CAMs are discarded. We proposed such an algorithm in [35].

7.4 Number of CAMs received from passing vehicles

The number of received CAMs received from specific vehicles depends on the sender’s and receiver’s trajectories. If both vehicles drive on the same lane in the same direction at the same speed, the number of CAMs transferred between them depends on how long they drive past each other. In contrast, if both vehicles pass each other in opposite direction, there is only a short time window within which they can exchange CAMs. In the following, we determine the number n rcvd passing of CAMs received by a vehicle from another vehicle passing in opposite direction depending on the speed of both vehicles. To reduce the parameter range, we assume constant and equal speed for both vehicles.

The time tpass during which a sender stays in the receiver’s communication range d range comm while passing by at an average vehicle speed v can be calculated by

t pass = d range comm 2 · v .
(12)

The number of received CAMs from a passing vehicle n rcvd passing can be approximated by

n rcvd passing = t pass T CAM inter · P ¯ combined success .
(13)

Figure 16 illustrates the number of CAMs n rcvd passing received from a single vehicle that is passing by in opposite direction. We assumed a four-lane scenario like in our example of the A6, and we considered average vehicle speeds v between 0 and 150 km h .

Figure 16
figure 16

Number of received CAMs per passing vehicle n rcvd passing . The number n rcvd passing of CAMs received from a single vehicle passing by in opposite direction depends on the average vehicle speed v. A highway with two lanes per direction was assumed for the analysis.

For speeds lower than 10 km h , very high numbers of CAMs are received from each passing vehicle. This results from a long passing time tpass in slow traffic with the maximum CAM inter-generation time of 1 s at low speed. For typical highway speeds, a vehicle exchanges between 40 and 80 CAMs while passing by. This range is relatively stable as the higher CAM generation rates compensate the lower communication window tpass while passing.

Not all CAMs from passing vehicles are of equal utility. It is obvious that for most applications, only the CAMs originating from positions ahead of the receiver contain useful information. As a consequence, only half of the received CAMs is of particular interest. During high-load conditions where not all CAMs can be processed, the CAMs originating from positions ahead of the receiver should be preferably processed.

8 Origin of received CAMs

From VANET applications point of view, the relevance of CAMs depends on distance and direction of their senders with regard to the receiver, and these relevances depend on the specific application. While crash avoidance applications need information about the near vicinity of the receiving car, traffic jam detection applications analyze an area a few hundred meters or kilometers ahead of the receiving car. For the design of these applications, the distribution of the origin of received CAMs relative to the receiver is useful input.

In this section, we characterize the distance of senders from which vehicles receive CAMs. We explain our simulation approach and derive analytical expressions for those data. Then, we discuss the results for a sample parameter set.

8.1 Simulative approximation of origin of received CAMs

We simulate the reception of CAMs and collect statistics about the distance of their sender and receiver. Therefore, we define distance intervals [d1,d2] of 100-m lengths which are the base for a histogram that provides the fraction of CAMs that originate from those distance intervals. For our evaluation, we rather use the cumulative histogram that accumulates the relative frequencies in the normal histogram up to a certain distance interval.

8.2 Analytical approximation of origin of received CAMs

The success probability P combined success (d,ρ) governs whether a vehicle receives a CAM that is generated by another vehicle which is d away while the vehicle experiences a relative channel load ρ. Thus, the distribution function of the distances of vehicles from which CAMs are received can be computed by

P(Dd,ρ)= 0 d P combined success ( d , ρ ) d d 0 d range comm P combined success ( d , ρ ) d d .
(14)

8.3 Numerical results

We study the distribution function of the origin of CAMs in the A5 and A6 scenarios. We collect data about CAMs received within the boxed areas in both scenarios that are depicted in Figures 3 and 4. Vehicles in this area receive CAMs only from vehicles ahead or behind them, but not from vehicles driving on other roads.

Figure 17 shows the analytical and empirical cumulative distribution of the origin of CAMs relative to the receiver. The curves are gained from simulation and analysis of the A5 and A6 scenarios assuming a penetration rate of φ = 40%. The analytical curves match the simulated curves quite well so that the analytical approach may be used for estimation of the percentage of received CAMs originating from within a specific distance.

Figure 17
figure 17

Origin of received CAMs. Comparison of the simulated cumulative histogram and the analytically computed distribution function; A5 scenario with nlanes = 8 lanes, φ = 40%; A6 scenario with nlanes = 4 lanes, φ = 40%.

We observe that the distribution functions for the A5 scenario approach large probabilities faster than those for the A6 scenario. This means that in the A5 scenario, a larger fraction of CAMs is received from the near vicinity than in the A6 scenario. While 90% of the CAMs are received from other vehicles within a distance of up to 600 m in the A5 scenario, this 90% quantile is about 650 m in the A6 scenario. The reason for the difference is the fact that the eight lanes in the A5 scenarios cause a larger channel load than the four lanes in the A6 scenario. As a result, CAMs from faraway senders in the A5 scenario have a clearly lower reception probability than in the A6 scenario.

The information that only a minority of CAMs comes from faraway vehicles is important for the design of VANET applications that use the local dynamic map (LDM). The LDM can only be precise for the area from which the most messages are received.

If the CAM processing unit is not able to process all received CAMs, some CAMs need to be discarded. Depending on the application, CAMs from nearby vehicles may be more important than CAMs from faraway vehicles or vice versa. If CAMs received from faraway vehicles are especially useful, most of them may be delivered to applications if CAMs from nearby vehicles are preferably dropped. If CAMs received from nearby vehicles are especially useful, dropping CAMs from faraway vehicles reduces the rate of received CAMs only slightly so that CAMs from nearby vehicles also need to be dropped.

9 Estimation of CAM inter-reception times

Information carried by CAMs will be merged with information from in-car sensors to enable (semi-) autonomous vehicular functions. In contrast to in-car sensors like radar and image recognition, VANETs cannot guarantee strictly regular CAM updates due to the unreliability of the wireless channel and its inherent message transmission failures. Information about average and bad-case CAM inter-reception times from specific vehicles is a crucial input for the design of data fusion algorithms which combine VANET data and in-car sensor information.

In this section, we first describe a simulative and an approximative analytical approach to derive CAM inter-reception times depending on the distance between sender and receiver. Then, we discuss numerical results which show among others that CAMs from faraway vehicles are received very rarely. This is important input for filter algorithms that select most important CAMs if the CAM processing unit is overloaded.

9.1 Simulative approximation of CAM inter-reception times

We simulate CAM inter-reception times T [ d 1 , d 2 ] inter depending on the distance between sender and receiver. To that end, we log for each receiver the last received CAM from any sender and the distance d to that sender so that inter-reception times can be computed at the reception of new CAMs. We collect statistics for inter-reception times depending on distance between sender and receiver. Again, we use distance intervals [d1,d2] of 100-m lengths for that purpose. We collect inter-reception times only if the distance between sender and receiver falls in the same distance interval for the currently and the previously received CAM.

9.2 Analytical approximation of CAM inter-reception times

We now determine average inter-reception times E[ T d inter ] using our statistical channel model for a given sender-receiver distance d.

The time between consecutive CAMs received from the same sender is a random variable that can be modeled by a geometric distribution with a shift of 1 (GEOM(1)):

P T d inter = i · T sent CAM = 1 - P combined success ( d , ρ ) ( i - 1 ) · P combined success ( d , ρ ) ,
(15)

where T sent CAM is the average time between two CAMs generated by the sender. The mean of the random variable T d inter is given by

E[ T d inter ]= i = 1 ∞i · T sent CAM · P ( T d inter = i · T sent CAM ) .
(16)

In contrast to the simulation, the analysis does not consider vehicle movements.

9.3 Numerical results

We investigate CAM inter-reception times for the A5 scenario and a penetration rate of φ=20%. Figure 18 illustrates analytical values according to Equation 16 depending on the distance between sender and receiver. It also shows simulated mean values of inter-reception times for each section together with 95% quantiles. We observe that mean inter-reception times stay near the minimum of one CAM inter-generation time T sent CAM up to a distance of 500 m between sender and receiver. That means, only a few messages are lost on the channel. For 500 m and above, the average inter-reception time increases clearly with distance and is about 8 s for senders which are 900 to 1,000 m away from the receiver. The analytical calculation fits the simulative results, which validates the simulation. The 95% quantiles of inter-reception times are close to the mean values for distances up to 200 m; beyond that distance, the 95% quantile of the inter-reception time is significantly higher than its mean value.

Figure 18
figure 18

Inter-reception times of CAMs. Inter-reception times of CAMs by distance between sender and receiver. Comparison of simulation (steps = mean values; circles = maximum values) and analytical results (A5 scenario, φ = 20%).

The results indicate that applications with interest in CAMs from nearby vehicles, e.g., collision mitigation applications, can expect to frequently receive CAMs from vehicles of interest. In contrast, applications with interest in CAMs from faraway vehicles must respect that they rarely receive CAMs from vehicles of interest. This may be taken into account for relevance estimation of CAMs in smart CAM processing engines: a CAM from a faraway vehicle may be considered more valuable than a CAM from a nearby vehicle.

Our analysis is based on continual traffic flows leading to almost constant CAM inter-generation times T sent CAM . If the traffic flow is less continual, other CAM inter-generation times may lead to other CAM inter-reception times. In our simulation, the traffic flow and channel model were chosen to produce high channels loads and received CAM rates. These parameters lead to rather low inter-reception times; inter-reception times are higher for pessimistic channel conditions and/or a curvy road networks with obstacles. If VANET applications require estimates of CAM inter-reception times, more results are needed for realistic or pessimistic conditions that may lead to larger values.Finally, we study how inter-reception times depend on the penetration rate. Figure 19 shows the inter-reception times for different sender-receiver distances and penetration rates. For small distances, there is hardly any difference in inter-reception time. However, for large distances, the inter-reception time increases with the penetration rate. Thus, applications leveraging information from faraway vehicles may work better in the beginning of VANET deployment than in stages with high penetration rate.

Figure 19
figure 19

Inter-reception times of CAMs. Inter-reception times of CAMs by distance between sender and receiver. Comparison of analytical results for different penetration rates in the A5 scenario.

10 Conclusions

In this paper, we studied the transmission of Cooperative Awareness Messages (CAM) in future VANETs. We used a newly developed simulation tool chain with a simplified channel model that is valid as long as congestion control in the access layer does not take effect.

We simulated two realistic road traffic scenarios to analyze rates of sent CAMs, relative channel loads, received CAM rates, the number of CAMs from a vehicle passing in opposite direction, the origin of received CAMs, and the frequency of CAMs from vehicles in a certain distance. We validated all simulation results with analytical approximation formulae that may also be used for parameter studies. In addition, we performed parameter studies based on the approximation formulae to understand under which conditions certain channel loads or CAM rates may appear.

The evaluation shows that the relative channel load can be large enough to cause congestion on the radio channel so that congestion mechanisms for CAM generation are required. This holds even for moderate penetration rates of VANET technology. The rate of received CAMs can easily reach 500 CAMs s which future series vehicles need to handle. This requires either costly hardware with sufficient processing power and expensive high-bandwidth, low-latency in-vehicle networks or a smart CAM processing engine that preferably treats most important CAMs and discards least important CAMs if processing capacity does not suffice in the presence of high received CAM rates. A vehicle receives about 40 to 100 CAMs from vehicles that pass by in opposite direction, but only half of them carry information of interest due to their location. Most received CAMs originate from senders within 600 m from the receiver. Therefore, the information density is high for low-distance regions around a receiver. As a consequence, the time between CAMs from a single sender may be very large for faraway senders.

References

  1. Sichitiu M, Kihl M: Inter-vehicle communication systems: a survey. IEEE Communications Surveys & Tutorials 2008, 10(2):88-105.

    Article  Google Scholar 

  2. Weiß C: V2X Communication in Europe – from research projects towards standardization and field testing of vehicle communication technology. Computer Networks 2011, 55(14):3103-3119. 10.1016/j.comnet.2011.03.016

    Article  Google Scholar 

  3. European Telecommunications Standards Institute (ETSI): Intelligent Transport Systems (ITS); Vehicular Communications; Basic Set of Applications; Part 3: Specifications of Decentralized Environmental Notification Basic Service. ETSI, Nice; 2010.

    Google Scholar 

  4. European Telecommunications Standards Institute (ETSI): Intelligent Transport Systems (ITS); Vehicular Communications; Basic Set of Applications; Part 2: Specification of Cooperative Awareness Basic Service. ETSI, Nice; 2011.

    Google Scholar 

  5. CAR 2 CAR Communication Consortium: Memorandum of understanding for OEMs within the CAR 2 CAR Communication Consortium on Deployment Strategy for Cooperative ITS in Europe. 2011.http://www.car-to-car.org/index.php?id=11 . Accessed 11 June 2014

    Google Scholar 

  6. ABI Research: V2V Penetration in New Vehicles to Reach 62% by 2027. 2013.http://www.abiresearch.com/press/v2v-penetration-in-new-vehicles-to-reach-62-by-202 . Accessed 11 June 2014

    Google Scholar 

  7. Kraftfahrt-Bundesamt: Fahrzeugzulassungen (FZ); Bestand an Kraftfahrzeugen und Kraftfahrzeuganhängern nach Fahrzeugalter; 1. Januar 2012. 2012.

    Google Scholar 

  8. Stubing H, Bechler M, Heussner D, May T, Radusch I, Rechner H, Vogel P: simTD: a car-to-X system architecture for field operational tests. IEEE Communications Magazine 2010, 48(5):148-154.

    Article  Google Scholar 

  9. Wilbrod J-H, Segarra G: Système Coopératif Routier Expérimental France. 2012.

    Google Scholar 

  10. Festag A, Le L, Goleva M: Field operational tests for cooperative systems: a tussle between research, standardization and deployment. Paper presented at the 8th ACM international workshop on vehicular inter-networking, Las Vegas, 19–23 Sept 2011 pp. 73–78

  11. Sommer C, German R, Dressler F: Bidirectionally coupled network and road traffic simulation for improved IVC analysis. IEEE Trans. Mobile Comput 2011, 10(1):3-15.

    Article  Google Scholar 

  12. Schünemann B: V2X simulation runtime infrastructure VSimRTI: an assessment tool to design smart traffic management systems. Computer Networks: The International Journal of Computer and Telecommunications Networking 2011, 55(14):3189-3198.

    Article  Google Scholar 

  13. SUMO Simulation of Urban MObility 2013.http://sumo.sourceforge.net/ . Accessed 11 June 2014

  14. Shivaldova V, Mecklenbräuker CF: Real-world measurements-based evaluation of IEEE 802.11p system performance. Paper presented at the 5th international symposium on wireless vehicular communications Dresden, 2–3 June 2013

  15. Taimoor A, Laura B, Thiel A, Mecklenbräuker CF, Tufvesson F: Measurements based channel characterization for vehicle-to-vehicle communications at merging lanes on highway. Paper presented at the 5th international symposium on wireless vehicular communications Dresden, 2–3 June 2013

  16. Killat M, Hartenstein H: An empirical model for probability of packet reception in vehicular ad hoc networks. EURASIP Journal on Wireless Communications and Networking 2009, 2009: 4-1412.

    Article  Google Scholar 

  17. Killat M, Schmidt-Eisenlohr F, Hartenstein H, Rössel C, Vortisch P, Assenmacher S, Busch F: Enabling efficient and accurate large-scale simulations of VANETs for vehicular traffic management. Paper presented at the 4th ACM international workshop on vehicular ad hoc networks Montreal, 10 Sept 2007

  18. Taliwal V, Jiang D, Mangold H, Chi C, Sengupta R: Empirical determination of channel characteristics for DSRC vehicle-to-vehicle communication. Paper presented at the 1st ACM international workshop on vehicular ad hoc networks Philadelphia 1 Oct 2004

  19. Brakemeier A: White paper on network design limits and VANET performance. (Car 2 Car Communication Consortium, Braunschweig, 2009)

  20. Torrent-Moreno M, Jiang D, Hartenstein H: Broadcast reception rates and effects of priority access in 802.11-based Vehicular Ad-hoc Networks. Paper presented at the 1st ACM international workshop on vehicular ad hoc networks, Philadelphia 1 Oct 2004

  21. Reinders R, van Eenennaam M, Karagiannis G, Heijenk G: Contention window analysis for beaconing in VANETs. Paper presented at the 7th IEEE international wireless communications and mobile computing conference, Istanbul 5–8 July 2011

  22. Lam K: Design of a medium access control protocol that exploits the structures of vehicular networks, Dissertation, Urbana-Champaign. 2011.

    Google Scholar 

  23. Bin Tariq A: vulnerable vehicles problem. Paper presented at the 11th conference of open innovations Association-Finnish-Russian University Cooperation in Telecommunications, St. Petersburg 23–27 April 2012

  24. European Telecommunications Standards Institute (ETSI): Intelligent Transport Systems (ITS); Harmonized Channel Specifications for Intelligent Transport Systems Operating in the 5 GHz Frequency Band. ETSI, Nice; 2012.

    Google Scholar 

  25. Car 2 Car Communication Consortium: The Handbook for Vehicle-to-X Cooperative Systems Simulation. (Car 2 Car Communication Consortium, Braunschweig, 2011)

  26. ‘TAPAS Cologne’ scenario 2011.http://sumo.sourceforge.net/doc/current/docs/userdoc/Data/Scenarios/TAPASCologne.html . Accessed 11 June 2014

  27. Wegener A, Piórkowski M, Raya M, Hellbrück H, Fischer S, Hubaux J-P: TraCI: An interface for coupling road traffic and network simulators. Paper presented at the 11th communications and networking simulation symposium Ottawa, 14–17 April 2008

  28. SUMO traffic modeler 2013.http://sourceforge.net/projects/trafficmodeler/ . Accessed 11 June 2014

  29. Filzek B: Abstandsverhalten Auf Autobahnen. Dissertation, TU Darmstadt; 2007.

    Google Scholar 

  30. European Telecommunications Standards Institute (ETSI): Intelligent Transport Systems (ITS); European Profile Standard for the Physical and Medium Access Control Layer of Intelligent Transport Systems Operating in the 5 GHz Frequency Band. ETSI, Nice; 2010.

    Google Scholar 

  31. Nakagami N: The m-distribution, a general formula for intensity distribution of rapid fading. In Statistical Methods in Radio Wave Propagation. Pergamon Press, Oxford; 1960-1960.

  32. Sommer C, Dressler F: Using the right two-ray model? A measurement based evaluation of PHY models in VANETs. Paper presented at the 17th ACM international conference on mobile computing and networking, Las Vegas 19–23 Sept 2011

  33. Rappaport TS: Wireless Communications: Principles and Practice (2nd Edition). Prentice Hall, Austin; 2001.

    Google Scholar 

  34. European Telecommunications Standards Institute (ETSI): Intelligent Transport Systems (ITS); Decentralized Congestion Control Mechanisms for Intelligent Transport Systems Operating in the 5 GHz Range; Access Layer Part. ETSI, Nice; 2011.

    Google Scholar 

  35. Breu J, Menth M: Relevance estimation of Cooperative Awareness Messages in VANETs. Paper presented at the 5th international symposium on wireless vehicular communications Dresden, 2–3 June 2013

Download references

Acknowledgements

We thank Christian Weiss and Wilfried Enkelmann for fruitful discussions and their support. We acknowledge support by the Deutsche Forschungsgemeinschaft and the Open Access Publishing Fund of Tuebingen University.

Disclosure

This journal version is an extension of our prior work ‘Analysis of Cooperative Awareness Message Rates in VANETs’ published in the Proceedings of the 13th International Conference on Intelligent Transportation Systems Telecommunications 2013.

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Jakob Breu.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ original submitted files for images

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Breu, J., Brakemeier, A. & Menth, M. A quantitative study of Cooperative Awareness Messages in production VANETs. J Wireless Com Network 2014, 98 (2014). https://doi.org/10.1186/1687-1499-2014-98

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1687-1499-2014-98

Keywords