## Estimation of Tire-Road Friction for Road Vehicles: a Time Delay Neural Network Approach

Alexandre M. Ribeiro · Alexandra Moutinho · Andr´ e R. Fioravanti · Ely C. de Paiva

Received: date / Accepted: date

Abstract The performance of vehicle active safety systems is dependent on the friction force arising from the contact of tires and the road surface. Therefore, an adequate knowledge of the tire-road friction coefficient is of great importance to achieve a good performance of different vehicle control systems. This paper deals with the tire-road friction coefficient estimation problem through the knowledge of lateral tire force. A time delay neural network (TDNN) is adopted for the proposed estimation design. The TDNN aims at detecting road friction coefficient under lateral force excitations avoiding the use of standard mathematical tire models, which may provide a more efficient method with robust results. Moreover, the approach is able to estimate the road friction at each wheel independently, instead of using lumped axle models simplifications. Simulations based on a realistic vehicle model are carried out on

Alexandre M. Ribeiro

Department of Computational Mechanics, School of Mechanical Engineering, Mendeleyev Street 200, 13083-860 Campinas, Brazil

E-mail: amribeiro@fem.unicamp.br

## Alexandra Moutinho

Institute of Mechanical Engineering - IDMEC, LAETA, Instituto Superior T´cnico, Universidade de Lisboa, Av. Rovisco e Pais, 1049-001 Lisbon, Portugal

E-mail: alexandra.moutinho@tecnico.ulisboa.pt

## Andr´ e R. Fioravanti

Department of Computational Mechanics, School of Mechanical Engineering, Mendeleyev Street 200, 13083-860 Campinas, Brazil

E-mail: fioravanti@fem.unicamp.br

Ely C. de Paiva

Department of Integrated Systems, School of Mechanical Engineering, Mendeleyev Street 200, 13083-860 Campinas,

Brazil

E-mail: elypaiva@fem.unicamp.br different road surfaces and driving maneuvers to verify the effectiveness of the proposed estimation method. The results are compared with a classical approach, a model-based method modeled as a nonlinear regression.

Keywords Road friction estimation · Artificial neural networks · Recursive least squares · Vehicle safety · Road vehicles

## 1 Introduction

One of the primary challenges of vehicle control is that the source of force generation is strongly limited by the available friction between the tire tread elements and the road. In order to better understand vehicle handling due to force generation mechanisms, several research activities related to vehicle dynamics and control fields are oriented towards estimation of all components of the tire-ground contact.

The knowledge of specific tire-road contact operation points, such as the saturation point where the tire generates the maximum force available from friction, could lead to a new range of applications in vehicle control. Moreover, current commercial vehicle safety systems, such as Anti-lock Brake Systems (ABS), Traction Control Systems (TCS) and Electronic Stability Control (ESC) could have a significant improvement in performance by the knowledge of the full vehicle states and operating conditions that are still limited by the lack of information [1]. Therefore, to reach this full potential the recognition of the tire's limit handling is indispensable. With this is mind, we emphasize the importance of estimating the vehicle road conditions, specifically the Tire Road Friction Coefficient (TRFC).

Friction estimation often relies on a model-based estimator using a well-defined and interpretable mathe-

matical model for the purpose of capturing the inherent friction effects under the tire dynamics (forces and moments). The most common model-based approaches use the steering system model [2,3], quarter-car model [4], four-wheel vehicle dynamic model [5], powertrain and wheel dynamics model [6].

For the estimation problem, in [7] the correlation between the self-aligning moment of the steering wheels and road friction was firstly examined. Lately, [8,9, 5,10] explored the use of a nonlinear Recursive Least Squares method employed as a mean for identification of tire-road friction through an observed data composed by the self-aligning moment and also expanded for a lateral dynamic force analysis.

The wheel dynamic model can also be utilized with a tire model to estimate the friction. In [11,12,13] the wheel rolling motion is used to detect the longitudinal force and longitudinal friction adopting the powertrain configuration and wheel drive engine. The estimator is built primarily exploring the force-slip ratio plane and its relationship with the road friction coefficient.

Another model-based approach discussed in literature is a slip-slope algorithm. This method is based on the assumption that the low slip-plane zone (linear region of the force-slip plane, characterizing normal driving conditions) can be used to estimate the tireroad friction. Distinct studies [14,15,16] have shown this methodology.

Despite the majority of model-based methods, a number of algorithms have been studied based on different concepts to estimate the surface condition. In [17, 18], an optical sensor is used as a tire sensor that can measure the road ahead and the tire carcass deflections which may be exploited in the estimation of friction potential. Cameras are also used to identify different surfaces. The detection is based on the light polarization changing when reflected from road surface [19]. Also, [20] proposed a method that merges weather data and road images taken by a camera on the vehicle. More recently, based on the hypothesis that the friction coefficient affects the natural frequency of the vehicle systems, such as in-wheel motor drive system or steering system, the road-friction is estimated through frequency analysis [21,22].

In the field of Machine Learning and Artificial Intelligence the work presented in [23] primarily designed a feedforward neural network optimizing its topology by means of Genetic Algorithms to determine the actual tire forces from the measured signals. The estimated values were shown to have potential of exploring the nuances about TRFC.

In [24], friction force estimation is presented in a stricted accelerating/decelerating maneuver. A two-layer feedforward neural network with linear output is used with the vehicle longitudinal dynamics. The proposed estimator is validated through a noiseless signal data.

In [25] and [26] a feedforward neural network is synthesized using the vehicle response to both longitudinal and lateral excitations. Therefore, the estimation is investigated under acceleration or brake maneuver while cornering.

Among the model-based methods that implement TRFC estimation using neural networks, some prior works also estimate friction through road conditions. It is the case of vision-based works used to estimate the road conditions ahead of the vehicle, where the task becomes a classification problem. In [27], an image dataset was used to train three machine learning models including logistic regression, support vector machine, and neural networks to predict the friction class. In a similar form [28] proposes a convolutional neural network model to learn region-specific features for road surface condition classification and how to infer the friction coefficient. Other works also implemented the classification by analyzing the road texture [29,30].

In this study, the presented estimation process focuses on the dynamic characteristics of a rear-motorizedwheels electric vehicle to achieve the tire road friction estimation and contributes in the following aspect: the estimator is developed by means of a time delay neural network (TDNN) as a way to identify the TRFC based exclusively on the lateral force information and the estimates are compared with a nonlinear least squares (NLS) estimator based on a moving data window.

Although TDNN have been used for diverse purpose such as speech recognition [31], movement behavior [32], joint angle estimation [33] and nonlinear behavior prediction of a time series [34], no other work has studied the TDNN as a reliable procedure to estimate or measure the effect of TRFC on a vehicle dynamic. Our main motivation for using TDNN is that the timedelay arrangement structure enables the network to effectively capture the temporal vehicle response due to a change in road friction.

This paper is organized as follows: Section 2 presents a vehicle theory development with mathematical models for the tire force models which are used in the estimation method. Section 3 details the least squares regression method. In Section 4, the TDNN estimation algorithm proposed is described. Simulation results are shown and analyzed in Section 5. Finally, this paper is concluded in Section 6.

## 2 Tire-Ground Contact Model

When sufficient excitations exist in the lateral direction, vehicle lateral dynamics can be used as the basis of the TRFC estimation. The most common tire friction models used in the literature are those of algebraic tire slip angle and force relationships. Although many approaches to the tire-road friction modeling can be found, for this work we selected three analytical models. These models were chosen for their clear and simple formulation. They have fewer tunning parameters and have a good representation of the tire forces nonlinearities.

As mentioned, the force generated between the tire and the road is related to the slip angle and it is of fundamental importance for the knowledge of how the lateral forces arise during a curve. The slip angle α is the angle between the orientation of the tire and the orientation of the velocity vector of the wheel, as depicted in Fig 1.

Fig. 1 Schematic diagram of the planar vehicle and tire slip angle representation

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-ac4e71aa-617f-43ef-bd49-a293c8900146.jpg)

The formal definition of slip angle can be derived via kinematic analysis of a planar four-wheel vehicle and is usually defined as:

$$\lambda _ { f l, f r } = & \arctan \left ( \frac { v + a r } { u \pm c r } \right ) - \delta _ { f l, f r }, & \text{and } t \epsilon \\ \alpha _ { r l, r r } = & \arctan \left ( \frac { v - b r } { u \pm c r } \right ), & [ 3 5 ], v \\ \text{where } u \text{ and } v \text{ are vehicle longitudinal and lateral ve-}$$

where u and v are vehicle longitudinal and lateral velocity components, r is the vehicle yaw rate, a and b are the distances from the vehicle center of gravity to front and rear axles, respectively, and c is half of the wheelbase distance. δ i stand for tire steering angles and the subscripts fl , fr , rl and rr denote quantities corresponding respectively to the front left, front right, rear left and rear right wheels. In the vehicle model sign convention, the steering angle is negative for left turns and positive for right turns.

## 2.1 Mathematical Formulation

Tire models express the relationship between tire forces and moments with slip ratio and slip angle.

Different mathematical tire models have been developed in the literature. The most widely used model is the semi-empirical tire model introduced by Pacejka [35], called Pacejka tire model or Magic formula . In a simplified form, the formulation of this tire model for lateral force is as follows:

$$F _ { y } = D \sin [ C \arctan \{ B \alpha - E ( B \alpha - \arctan B \alpha ) \} ] + S _ { v _ { y } }, \\ ( 2 )$$

where D, C, B, E are the Magic formula semi-empirical parameters based on tire measurement data, S v y is the vertical offset of the characteristic curve and α is the slip angle.

A second model, known as Dugoff's tire model, was developed in 1969 by Dugoff et al. [36]. In its simplest form, the lateral force is expressed as:

$$F _ { y } = - \, C _ { \alpha } \, \tan \alpha \, f ( \lambda ),$$

with

$$f ( \lambda ) & = \begin{cases} ( 2 - \lambda ) \ \lambda, & \text{if } \lambda < 1 \\ 1 & \text{otherwise} \end{cases} \\ \lambda & = \frac { \mu F _ { z } } { 2 C _ { \alpha } | \tan \alpha | }, \\ \text{where } F \text{ is to normal to two load } \text{ if } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{\ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text{ } \text` }$$

where F z is the normal tire load, µ is the friction coefficient and C α the cornering stiffness. Conceptually, cornering stiffness is a property of the tire that changes slowly with time due to tire wear, inflation pressure, and temperature fluctuations [8].

Finally, another widespread model is the Brush model [35], which defines the lateral force as follows:

$$\text{al ve} _ { \begin{array} { c } \text{al ve} \\ \text{and } b \end{array} } \quad F _ { y } = \begin{cases} - 3 \mu F _ { z } \theta _ { y } \sigma _ { y } \{ 1 - | \theta _ { y } \sigma _ { y } | + \frac { 1 } { 3 } ( \theta _ { y } \sigma _ { y } ) ^ { 2 } \}, & | \alpha | < \alpha _ { s l } \\ - \mu F _ { z } \text{sign} ( \alpha ) & o / w \\ \text{of the } \end{cases} } \quad ( 4 )$$

where

$$\theta _ { y } = \frac { C _ { \alpha } } { 3 u F _ { \gamma } }.$$

$$& \theta _ { y } = \frac { C _ { \alpha } } { 3 \mu F _ { z } }, \\ & \sigma _ { y } = \tan \alpha, \\ & \alpha _ { s l } = \arctan \left ( ^ { 1 / \theta _ { y } } \right ).$$

Although this article only introduces the most popular and widely used approaches in tire-road friction estimation, there are many valuable studies that have tried to develop new friction models. This subject is addressed in broader texts and books about ground vehicle dynamics such as [35,37]

The lateral force characteristic curve for each of the presented models is shown in Fig. 2 for several friction coefficients. Initially, the lateral forces increase linearly with the slip angle until it reaches saturation, which represents the tire force limits.

Fig. 2 Tire lateral force characteristic curve for each model, varying normal force F z and three levels of friction µ

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-5328fd77-21d1-4d80-a230-371bf9bcd5cc.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-ee95646a-62e4-471a-9d60-09b72bc51190.jpg)

These models show similar behaviors when the slip angle is small. However, they may deviate from each other when high values of vertical force F z and friction µ are available. These characteristics suggest that, in the estimation processes, these models could lead to errors due to model discrepancy.

## 3 Tire-road Friction Identification Through Parametric Regression

As seen in the previous section, the lateral force can be characterized by three fundamental parameters: tire slip angle α , normal force F z and tire-road friction µ .

When a sufficiently large lateral excitation is detected during a vehicle maneuver, the of road friction estimation can be achieved using the measured signals and the analytical models (2)-(4). This methodology can be seen as a problem of fitting experimental data to a nonlinear analytical function, as addressed in [8,9,5, 10]. The method allows the formulation of the problem as one of unconstrained nonlinear least-squares (NLS) optimization.

In other words, we desire to investigate how well we can identify our lateral tire parameters using lateral force information. This requires a good measurement of the lateral tire forces, as well as the knowledge of individual tires. However, if unavailable, the use of an estimate of the axle forces (lumped forces) may hold a lumped friction estimate.

The nonlinear curve-fitting in a least-squares problem consists of finding decision variables x that solve the problem:

$$x ^ { * } = \arg \min _ { x } \left \| F ( x ) - \overline { F } \right \| _ { 2 } ^ { 2 },$$

$$= \arg \min _ { x } \sum _ { k } ^ { N } \left ( F ( x ) - \overline { F } _ { k = 1 } \right ) ^ { 2 },$$

where x ∗ is the optimum value that minimizes the objective function, with F x ( ) the parametric function and F representing the measured data.

Assuming that the tire analytical models are a good representation of the lateral tire force behavior, they can be used as a parametric function of the NLS method with N sets of observed data (in this case, groups of F y and α ).

Despite the promising results of this approach [9, 10], the NLS method has some drawbacks. It requires a long computation time and sometimes this process fails to converge to the true optimal values. The estimator based on NLS generally shows stable estimation results, but does not always guarantee stability and it is difficult to quantify the stability and convergence [5]. Furthermore, a critical drawback of the NLS is that it is computationally heavy. In a low-speed microprocessor, it may not sustain the same level of performance.

As an alternative to this methodology, we propose solving the problem using neural networks. The theme is approached in a similar form, with the same window of N observable data applied in a time-delayed neural network.

## 4 Estimation of Tire-road Friction Coefficient Using Neural Networks

This section proposes a time delay neural network to detect the TRFC. Two main benefits are expected from this method: firstly, a TDNN can establish network connections and the relationship between input and output instead of storing an entire complex tire model in the controller, which can significantly reduce the computations, guarantee the real time performance and avoid model errors due to model discrepancy; secondly, because the TDNN is trained by measured data, it is able to create a mapping from input parameters to the friction coefficient and accurately capture the temporal structure hidden in the data [26].

As the analytical models (2)-(4) show, the lateral force is dependent of α F , z and F y and these are therefore the parameters selected to feed the neural network. Fig. 3 shows the overall structure used for the TRFC estimation.

Fig. 3 Block diagram of the proposed hierarchical estimator

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-26222a5a-e4bc-49b4-bc28-70d536955935.jpg)

Although the existence of tire force sensors, the forces are still hard to measure and the sensors are very expensive. As solution, a Kalman filter variant is used for tire force estimation. Here, we use the approach presented in [38,39] to estimate F y and F z using ordinary vehicle sensors, such as GPS, inertial measurement unit (IMU) and encoders.

The observers are developed based on nonlinear vehicle dynamic models with the Extended Kalman Filter (EKF) algorithm. Three estimators are used in a cascade structure to decouple the forces dependency. For vertical forces a 3D vehicle model is used to create a 12-states nonlinear system. For longitudinal and lateral forces the planar vehicle model is used to create two 7states nonlinear systems. Compromising precision and simplicity, the Dugoff tire model is chosen as the analytical model.

All measures needed for the estimation process are listed in Table 1.

The aforementioned works about the filter and observer showed that the overall EKF forces estimator is robust against TRFC variations. It turns out that the update stage uses inertial measurements (acceleration) and is capable to correct the forces errors induced

Table 1 Signals and description of measures

| Signal          | Description                                                  |
|-----------------|--------------------------------------------------------------|
| a x , a y , a z | Vehicle longitudinal, lateral and vertical accelerations     |
| u , v , w       | Vehicle longitudinal, lateral and vertical linear velocities |
| p , q , r       | Vehicle roll, pitch and yaw angular rates                    |
| h z ij          | Suspension deflection                                        |
| δ ij            | Tire steering angle                                          |

by prediction stage. The intuition behind this is that Newton's second law equations prediction is efficiently corrected by a proper acceleration measurement. Therefore, a constant µ = 0 8 is applied for the EKF forces . estimation.

With this approach the forces are detected individually, which holds the potential of detecting the TRFC independently for each tire. The wheel slip angle α is calculated straightforward using (1).

Also, a supplementary consideration should be taken to ensure the algorithm outputs reasonable estimates. Due to sensors noise and the inherent perturbation on lateral forces, and specially on slip angle calculation, the TDNN inputs should be low-pass filtered to prevent the high frequency disturbances from being propagated to the estimate. A unit gain 5 Hz low-pass filter is applied to the estimated forces and slip angle, as shown in Fig. 3.

Before advancing into the learning process of the proposed neural network, it is important to make one addition to the model. When considering the correlation between friction and each tire measure, the correlation coefficient between the normalized lateral force F y / F z is significantly higher if compared with each force separately, as listed in Table 2. According to (1), the slip angle α is determined by vehicle velocities and normal force F z is mainly affected by the roll over effect. These measures are only affected indirectly by friction, thereby, a low correlation is expected.

Table 2 Correlation coefficients between the specified variables

| α          |    F y | F z        |   F y / F z |
|------------|--------|------------|-------------|
| 1.681e - 7 | 0.2955 | 1.186e - 8 |      0.4076 |

Given this fact, the normalized forces F y / F z should be selected as one input to feed the neural network instead of F y and F z separately. The basis for this choice also lies on the friction circle concept in which the maximum value of the resultant force is determined along a circle

(directly influenced by friction), and this value can be decomposed into the limits of the normalized forces [40].

It is important to note that a positive correlation was observed for positive lateral forces (data obtained from a right hand maneuver). A negative correlation with similar magnitude is expected for negatives forces. The signal, thus, is a consequence of the reference frame.

The TDNN architecture is depicted in Fig. 4. Two inputs were selected: a normalized lateral force F /F y z , obtained from the kalman estimator, and the calculated slip angle.

Fig. 4 Time-delayed neural network architecture with a single hidden layer

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-d500faef-d1ea-47d5-8f6b-d19487b6f882.jpg)

The configuration of the proposed TDNN for TRFC is as follows (see Fig. 4): 2 inputs with 50 samplings delay (observation window of size N = 50) and one single hidden layer with 50 neurons. The neurons differentiable transfer function is nonlinear, properly selected as a Tan-Sigmoid transfer function.

In the neural network data collecting stage, about 200,000 original data are obtained from simulation with a 100 Hz sampling rate. The range of variation of the network input parameters to the tire model is bounded as described in Table 3. The friction coefficient is set with different levels and the vehicle response (data of α F , y and F z ) is obtained.

Table 3 Data training parameters and space dimension

| Input parameter        | Variation                      |
|------------------------|--------------------------------|
| Friction coefficient µ | 0.3 to 1.2 at intervals of 0.1 |
| Slip angle α           | [-0.12 0.12] rad               |
| Lateral Force F y      | [-2.8 2.8] kN                  |
| Normal force F z       | [2 4.4] kN                     |

The observation window size was chosen based on the nature of our system. The rise time response due to a change in friction is shown in Fig. 5. The slip angle response (and consequently lateral tire forces, see Fig. 2) shows an average rise time of 0.2 s. In an attempt to capture the vehicle behavior during these transitions, we choose the window size to be approximately double the rising time. Therefore, it is defined N = 50 that corresponds to an observation window of 0.5 seconds.

Fig. 5 Rise time due to a change in friction. At instant 60 s friction changes from 0.8 to 0.6 and at instant 80 s from 0.6 to 0.9. Rise time is 0.21 s and 0.19 s for left and right plot, respectively.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-d3a978f9-52dd-4d44-95ab-55231be01e23.jpg)

As in the classical Neural Network, the Time Delay Neural Network also has a training phase. Training was achieved using Matlab Neural Network Toolbox. The Levenberg-Marquardt algorithm is used with 1000 epochs of training iterations with 70% of the collected data randomly taken as the training set, 15% used for validation set and 15% as the test set.

Training phase and further evaluations were carried out on a desktop architecture which features a fourcore 4.00 GHz Intel Core i7-6700K Processor, NVIDIA GeForce GTX 950, 32GB of RAM and Ubuntu 16 LTS OS. The system took 7002 seconds to train the aforementioned dataset.

Fig. 6 shows the error residuals of the trained neural network. About 88% of the total data are distributed around zero.

The correlation coefficient (R-value), which is a linear regression between the TDNN predicted values and the targets, and the mean squared error (mse) are shown in Table 4. With R values around 0.94 and 0.95, suggests that the models has a considerable potential of matching the network response to the friction change patterns. Notice also that both R and mse values are close for Training, Validation and Test dataset, which indicates that the network is not overfitting the data.

Fig. 6 Error histogram of the TDNN dataset

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-476ef812-182b-4285-af8c-df6a93745055.jpg)

Table 4 Correlation coefficient R-value and mse error. Values of R closer to 1 indicate better agreement between targets and predicted values

|            |       R | mse         |
|------------|---------|-------------|
| Training   | 0.94355 | 1.0680e - 3 |
| Validation | 0.94123 | 1.2597e - 3 |
| Test       | 0.94059 | 1.3500e - 3 |
| Total      | 0.94276 | 1.1391e - 3 |

## 5 Results

The simulation results presented in this section are obtained using Matlab/Simulink. A representative and realistic full-vehicle multibody dynamics model (including a steering system, powertrain system, suspension system and the Pacejka tire model for tire ground interactions), was used consisting of the following motions:

- -Longitudinal, lateral and vertical body motion;
- -Wheels rotation;
- -Unsprung masses motion;
- -Pitch, roll and yaw body rotation.

The physical parameters of the car used in this study are listed in Table 5. All values are extracted from [41] where a complete vehicle modeling and data validation are given. The simulator dynamics is formulated as a 32-states model. The vehicle is configured to simulate a independent rear wheel drive vehicle, providing references of a vehicle state and measured signals. Gaussian noises are added (according to the commercial MTi Xsens sensor specifications (MTi-G-700)) in the simulated measurements to realistically reproduce a real application.

The simulation results of three representative maneuvers are presented here. Table 6 gives the details and purpose of each maneuver. Fig. 7 provides the physical representation of each proposed scenario where the color designates the friction coefficient. The change in

Table 5 List of vehicle main physical parameters [41]

| Parameter name                   | Value          |
|----------------------------------|----------------|
| Vehicle mass                     | 1100 kg        |
| Yaw inertia moment               | 1350 kg / m 2  |
| Roll inertia moment              | 337.5 kg / m 2 |
| Pitch inertia moment             | 1350 kg / m 2  |
| Distance from CG to front wheels | 1.5 m          |
| Distance from CG to rear wheels  | 1.9 m          |
| Wheelbase                        | 1.8 m          |
| Wheel rotational inertia         | 1 kg / m 2     |
| Wheel radius                     | 0.25 m         |
| Height of CG                     | 0.5 m          |

friction is time-dependent and occurs at successive time intervals.

During simulation, the system is set on an equilibrium point with constant longitudinal velocity. It is achieved by a PID cruise controller [42]. In fact, with constant longitudinal speed, the longitudinal tire forces are reactive with low magnitude and would not have significant impact on lateral forces due coupling effect [43].

Each case was performed on a different theoretical surface, where a theoretical µ = 1.0 surface roughly corresponds to driving on a dry pavement, µ = 0.8 on a wet pavement and µ = 0.6 corresponds to driving on gravel [44].

Fig. 7 Schematic road layout with time-dependent changing of friction coefficient

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-4124a0e6-43e0-4317-aff4-5a3e81cec78b.jpg)

It is valid to remark that, even though our training and test sets included both left and right turns, due to the symmetry of the system, right turns have a mirror response of left turns that is also included in the network as the result of a data augmentation process.

## 5.1 Ramp Steer Maneuver

Fig. 8 displays the data resulting from the simulation of a left-hand ramp steer maneuver. The steering angle δ goes linearly from 0 to -18 degrees at the roadwheels reference.

To ensure that there is enough data to be meaningful for the NLS fit and the TDNN approach, first the

Table 6 Details and investigative purpose of each simulated maneuver

| Simulated Maneuver                                                               | Test Surface                                                                                          | Purpose                                                                                                                                                           |
|----------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------|-------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| Ramp steer with constant friction coefficient (Fig. 7a)                          | Constant dry pavement ( µ = 0.8)                                                                      | Investigate the early friction sensing ability of the estimator. During the maneuver, lateral forces are gradually increasing, eventually reaching saturation.    |
| Constant steer - case 1: step varying µ for all tires (Fig. 7b)                  | Five levels of TRFC with unequal steep sizes ( µ = 1.0 to 0.6)                                        | Determine the estimator response to a quick change in road surface. Friction coefficient is varied at five new levels.                                            |
| Constant steer - case 2: different step varying µ for left/right tires (Fig. 7c) | Each wheel is subjected simultaneously to two different frictions ( µ FL = 0.9, 0.8, µ FR = 0.8, 0.7) | Validate the TRFC detection under small friction variations. Also, each wheel is exposed to different surfaces at the same time (distinct µ for FL and FR tires). |

Fig. 8 Front right lateral force and slip angle for a ramp steer maneuver

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-137cba77-0207-4310-af68-b66d149a1200.jpg)

process is initialized by placing a slip angle threshold α thres . The slip angle data must exceed α thres before the estimation begins, otherwise the fitting optimization may not guarantee a reliable solution.

The TDNN estimator will be here compared with the NLS approach. To show the dependency of the NLS fit with the mathematical model, the regression is performed choosing the Dugoff and Brush models as a parametric function of the nonlinear regression. The window is selected with size N = 50 and will be used in all cases showed from here on.

Using the estimation algorithm with α thres = 1 degree, the NLS and TDNN algorithm waits until the front tire slip angle exceeds α thres at t = 12 s before fitting the force-slip data (see Fig. 9). The estimated value ˆ is µ the optimum solution x ∗ of the optimiza- tion problem (6) and before instant 12 s the estimation simply holds ˆ at initial value µ µ 0 = 0 5. .

Fig. 9 Friction estimates from ( F y , α ) data for different approaches

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-ded3bb34-ad45-4a98-a0c9-6fd306f28758.jpg)

The slight increase in the friction estimate as the maneuver progresses is expected. Initially, during linear tire regime operation, lateral forces measurements have yet to reach their peak value and both methods underestimate the friction coefficient. As more lateral force measurements become available, the peak force limit is reached and the friction estimate reaches a final estimate. Therefore, adequately large slip angles are required for stable and accurate estimation in both TDNNandNLSmethods and the slip angle data threshold is indispensable.

The model error also becomes apparent on the NLS fit, where Brush and Dugoff models show different convergence values due to model discrepancy. This divergence arises due to the difference between Pacejka model, used to generate the data, with the models used on the estimators (as discussed in section 2).

## 5.2 Constant Steer: Case 1

In this setup, the tire-road friction coefficient is set at five levels, varying randomly from 1.0 to 0.6. The tran-

sitions occur during successive equal time intervals of 10 seconds. The vehicle is set on an equilibrium point in a constant left turn maneuver. The steering angle of the front left and right tires is set to -18.36 and -15.82 degrees. These values follow the steering Ackerman Geometry. As a consequence, the inner-turn wheel reaches higher tire side slip and lateral force if compared to the outer-turn wheel, as shown in Fig. 10. Also, vertical force is higher on the right tire due to the load transfer. This response appears as a result of the roll over effect measured as a change in vehicle center of mass location relative to the wheels.

Fig. 10 Slip angle, vertical and lateral forces of the tires: Constant steer case 1

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-a0953c66-5469-4038-9913-e1e3869f12c2.jpg)

The TRFC estimation results are shown in Fig. 11. One can note the front left estimative is more accurate and less oscillating than the front right estimative. A necessary condition for good estimation results, as shown previously, is a large lateral excitation (high slip angle).

Fig. 11 Front left and front right friction estimates in a time varying friction scenario

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-07c9c673-aa59-48b2-8f1a-53753e180689.jpg)

This scenario highlights the dependency of the NLS to the parametric function. The NLS final estimates of each interval show a constant error bias while the TDNN produces a solid and concise estimative. Naturally, there are discrepancies between the dynamic behavior of the real tire system and the derived mathematical model (see Fig. 2). Therefore, a constant error bias should be expected on the NLS model-based approach.

Table 7 displays the root mean square (RMS) error of the estimates of the front left and right tires. Although very similar, a high overall estimation accuracy is achieved for both techniques and it shows great promise for a real implementation.

Table 7 RMS error of the estimated friction - case 1

| Methodology   |   µ fl |   µ fr |
|---------------|--------|--------|
| TDNN          | 0.0346 | 0.035  |
| NLS Dugoff    | 0.0421 | 0.0357 |
| NLS Brush     | 0.0546 | 0.0395 |

Moreover, the rate of convergence is slightly higher on the TDNN approach. Fig. 12 highlights this response by zooming in Fig. 11a on three intervals of friction transitions. The TDNN estimates converges to a more accurate values with faster responses than the NLS estimates. This behavior lies in the fact that the relationship between input and output was correctly mapped

on the database and therefore can be observed on the following results.

Fig. 12 Friction estimates rate of convergence comparison

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-acaec8ad-6279-4c7c-9aa2-90a0f7338167.jpg)

## 5.3 Constant Steer: Case 2

While case 1 showed an equal change for both wheels, here, the tire-road friction coefficient is set at two different levels for each tire. The transition occur during an equal time interval of 10 seconds. Left wheel friction undergoes a transition from 0.9 to 0.8 while right TRFC goes from 0.8 to 0.7.

The vehicle is set on an equilibrium point in a constant left turn maneuver. The knowledge of forces and friction of individual tires is desirable and would offer stability control systems with most needed information. Thus, this change maneuver is conducted to verify that the estimator can identify the friction for each tire individually and certify that the estimation is indeed independent for each wheel.

Fig. 13 displays the simulated slip angle, lateral and vertical forces from the proposed right-hand steer maneuver. At instant 10 s, the road surface adhesion coefficient decreases to a different value for each tire. Again, vertical forces are maintained constant due to the maneuver nature, with the changing in friction mostly affecting lateral forces and slip angle.

Fig. 14 shows the estimation results. With the TDNN approach, the individual wheel friction is confidently estimated with high accuracy. Since slip angles are larger than for the case 1 scenario, it satisfies the required large lateral forces excitation and gives very accurate estimates. On the NLS estimation results, however, a constant error are still apparent and can be seen during the transitions. This characteristic should be considered when the estimated result is used for control purposes.

The TDNN shows a slightly better estimation quality, as seen in the RMS error listed in Table 8. Note that the regression based method still exhibits the hindsight bias caused by the inevitable model differences.

Fig. 13 Slip angle, vertical and lateral forces of the tires: Constant steer case 2

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-eb5ec0b6-caa2-4e93-9b0c-be94dacf665e.jpg)

Table 8 RMS error of the estimated friction - case 2

| Methodology   |   µ fl |   µ fr |
|---------------|--------|--------|
| TDNN          | 0.0638 | 0.0477 |
| NLS Dugoff    | 0.0652 | 0.0493 |
| NLS Brush     | 0.0666 | 0.0486 |

A significant difference in processing time is found when comparing performance and computational efficiency. Fig. 15 shows the normalized histogram of the computation time for both techniques. These values, computed at each time instant, were obtained from 14000 data signals.

It is clear that the computation time of TDNN algorithm is lower than NLS. In summary, TDNN averages 0.594 milliseconds to process the signal (corresponding to one iteration) compared to 3.379 milliseconds of the

Fig. 14 Front left and front right friction estimates in a time varying friction scenario with different friction for each wheel

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-55829f70-e8c6-40c3-bf86-ecb411a1814f.jpg)

NLS. This has the potential to allow a higher sample frequency of the complete system.

Fig. 15 Normalized histogram of computational time for NLS and TDNN methods

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00452v2-figure-8e2eb84e-9d3a-48f9-8796-c7ad252682cc.jpg)

## 6 Conclusions

In this study, we presented a hierarchical TRFC estimation method based on a time delay neural network and compared it with a classical nonlinear regression approach, using the same data observation window. The overall estimation algorithm was evaluated on varying road surfaces with three different scenarios. A highfidelity and realistic full-vehicle multibody dynamics model for Matlab/Simulink platform was used in the simulations.

Although road-friction was accurately identified using both algorithms, there is a primary shortcoming in the presented lateral-force based friction estimation: it requires sufficient levels of lateral excitation for the correct friction identification. An earlier knowledge of the TRFC is desirable, however, both approaches showed a similar behavior: a necessary waiting time for the tire slip angle to fulfill the observation window satisfying the specified excitation threshold.

Nonetheless, as an algebraic methods, the NLS method relies more heavily on an accurate model which may be a source for estimation errors. Indeed, the NLS needs a prespecified parametric function for precise tunning parameters and, as a consequence, stationary estimation errors may be expected if the given function is not adequate.

On the other hand, the TDNN method is independent of any mathematical tire model, however, requires a sufficient and representative database. In this study, the TDNN was also able to provide estimates with lower RMS errors compared with the classical regression approach. It also demands less computation time at each time instant and may be the best alternative for a real time implementation in embedded systems.

Since the proposed method is only analyzed theoretically and validated via simulation, an actual benchmark or field test is needed in the subsequent work to verify the proposed approach. Future works may also include the design of a time delay neural network containing not only lateral information but also longitudinal forces, slip ratio and self-moment align.

Acknowledgements This work was supported by FCT Portugal, through IDMEC under projects LAETA (UID/EMS/ 50022/2019). The mobility of A. Ribeiro has been possible with the Erasmus Mundus SMART 2 support (Project Reference: 552042-EM-1-2014-1-FR-ERA MUNDUS-EMA2) coordinated by CENTRALESUPELEC. The authors also acknowledge the support of FAPESP through Regular project AutoVERDE N. 2018/04905-1, Ph.D. FAPESP 2018/05712-2 and CNPq grant 305600/2017-6.

## References

- 1. Kanwar Bharat Singh and Saied Taheri. Estimation of tire-road friction coefficient and its application in chassis control systems. Systems Science &amp; Control Engineering , 3(1):39-61, December 2014.

- 2. Liang Shao, Chi Jin, Cornelia Lex, and Arno Eichberger. Robust road friction estimation during vehicle steering. Vehicle System Dynamics , 57(4):493-519, 2019.
- 3. Yung-Hsiang J Hsu, Shad Laws, Christopher D Gadda, and J Christian Gerdes. A method to estimate the friction coefficient and tire slip angle using steering torque. In ASME 2006 International Mechanical Engineering Congress and Exposition , pages 515-524. American Society of Mechanical Engineers, 2006.
- 4. Ali I. H. Al-Zughaibi. Experimental and analytical investigations of friction at lubricant bearings in passive suspension systems. Nonlinear Dynamics , 94(2):1227-1242, Oct 2018.
- 5. Chang Sun Ahn. Robust estimation of road friction coefficient for vehicle active safety systems . PhD thesis, University of Michigan, 2011.
- 6. R. de Castro, R. E. Araujo, J. S. Cardoso, and D. Freitas. A new linear parametrization for peak friction coefficient estimation in real time. In 2010 IEEE Vehicle Power and Propulsion Conference , pages 1-6, Sep. 2010.
- 7. W. R. Pasterkamp and H. B. Pacejka. The tyre as a sensor to estimate friction. Vehicle System Dynamics , 27(5-6):409-422, jun 1997.
- 8. Yung-Hsiang Judy Hsu. Estimation and control of lateral tire forces using steering torque . PhD thesis, Stanford University, 2009.
- 9. Y.-H Judy Hsu, Shad M. Laws, and J Christian Gerdes. Estimation of tire slip angle and friction limits using steering torque. 18:896 - 907, 08 2010.
- 10. Changsun Ahn, Huei Peng, and Hongtei Eric Tseng. Robust estimation of road frictional coefficient. IEEE Transactions on Control Systems Technology , 21(1):113, 2013.
- 11. Steffen M¨ller, Michael Uchanski, and Karl Hedrick. Esu timation of the maximum tire-road friction coefficient. Journal of Dynamic Systems, Measurement, and Control , 125(4):607, 2003.
- 12. T. Hsiao, N. C. Liu, and S. Y. Chen. Robust estimation of the friction forces generated by each tire of a vehicle. In Proceedings of the 2011 American Control Conference , pages 5261-5266, June 2011.
- 13. R. Rajamani, G. Phanomchoeng, D. Piyabongkarn, and J. Y. Lew. Algorithms for real-time estimation of individual wheel tire-road friction coefficients. IEEE/ASME Transactions on Mechatronics , 17(6):1183-1195, Dec 2012.
- 14. K Li, J A Misener, and K Hedrick. On-board road condition monitoring system using slip-based tyre-road friction estimation and wheel speed signal analysis. Proceedings of the Institution of Mechanical Engineers, Part K: Journal of Multi-body Dynamics , 221(1):129-146, 2007.

15.

- Zhiquan Qi, Saied Taheri, Baofeng Wang, and Hongxiao Yu. Estimation of the tyreroad maximum friction coefficient and slip slope based on a novel tyre model. Vehicle System Dynamics , 53(4):506-525, 2015.

16.

17.

18.

- X. Xia, L. Xiong, K. Sun, and Z. P. Yu. Estimation of maximum road friction coefficient based on lyapunov method. International Journal of Automotive Technology , 17(6):991-1002, Dec 2016.
- J. Casselgren, M. Sjodahl, S. Woxneryd, and M. Sanfridsson. Classification of road conditions - to improve safety. In 11th International Forum on Advanced Microsystems for Automotive Applications , pages 47-59. Springer Science Business Media, 2007.
- A.J; Tuononen. Optical position detection to measure tyre carcass deflections. Vehicle System Dynamics , 46(6):471-481, 2008.
- 19. M. Jokela, M. Kutila, and L. Le. Road condition monitoring system based on a stereo camera. In 2009 IEEE 5th International Conference on Intelligent Computer Communication and Processing , pages 423-428, Aug 2009.
- 20. Patrik Jonsson. Classification of road conditions: From camera images and weather data. In International Conference on Computational Intelligence for Measurement Systems and Applications (CIMSA) Proceedings . Institute of Electrical and Electronics Engineers (IEEE), sep 2011.
- 21. Long Chen, Mingyuan Bian, Yugong Luo, Zhaobo Qin, and Keqiang Li. Tire-road friction coefficient estimation based on the resonance frequency of in-wheel motor drive system. Vehicle System Dynamics , 54(1), nov 2015.
- 22. Long Chen, Yugong Luo, Mingyuan Bian, Zhaobo Qin, Jian Luo, and Keqiang Li. Estimation of tire-road friction coefficient based on frequency domain data fusion. Mechanical Systems and Signal Processing , 85:177-192, aug 2016.
- 23. W.R. Pasterkamp and H.B. Pacejka. Optimal design of neural networks for estimation of tyre/road friction. Vehicle System Dynamics , 29(sup1):312-321, jan 1998.
- 24. Jadranko Matuˇ sko, Ivan Petrovi´, and Nedjeljko Peri´. c c Neural network based tire/road friction force estimation. Engineering Applications of Artificial Intelligence , 21(3):442-456, April 2008.
- 25. Arash Zareian, Shahram Azadi, and Reza Kazemi. Estimation of road friction coefficient using extended kalman filter, recursive least square, and neural network. Proceedings of the Institution of Mechanical Engineers, Part K: Journal of Multi-body Dynamics , 230(1):52-68, May 2015.
- 26. Xudong Zhang and Dietmar G¨ ohlich. A hierarchical estimator development for estimation of tire-road friction coefficient. PLOS ONE , 12(2):e0171085, feb 2017.
- 27. G. Panahandeh, E. Ek, and N. Mohammadiha. Road friction estimation for connected vehicles using supervised machine learning. In 2017 IEEE Intelligent Vehicles Symposium (IV) , pages 1262-1267, June 2017.
- 28. Sohini Roychowdhury, Minming Zhao, Andreas Wallin, Niklas Ohlsson, and Mats Jonasson. Machine learning models for road surface and friction estimation using front-camera images. In 2018 International Joint Conference on Neural Networks (IJCNN) . IEEE, July 2018.
- 29. Guangwei Yang, Qiang Joshua Li, You Zhan, Yue Fei, and Aonan Zhang. Convolutional neural network-based friction model using pavement texture data. Journal of Computing in Civil Engineering , 32(6):04018052, November 2018.
- 30. Yuchuan Du, Chenglong Liu, Yang Song, Yishun Li, and Yu Shen. Rapid estimation of road friction for anti-skid autonomous driving. IEEE Transactions on Intelligent Transportation Systems , pages 1-10, 2019.
- 31. Fei Wu, Leibny Paola Garca-Perera, Daniel Povey, and Sanjeev Khudanpur. Advances in automatic speech recognition for child speech using factored time delay neural network. In Proc. Interspeech 2019 , pages 1-5, 2019.
- 32. Sarah A Saruchi, Mohd HM Ariff, Hairi Zamzuri, Nurhaffizah Hassan, and Nurbaiti Wahid. Modeling of occupants head movement behavior in motion sickness study via time delay neural network. SIMULATION , 2019.
- 33. Triwiyanto, O. Wahyunggoro, H. A. Nugroho, and Herianto. Time delay neural network to estimate the elbow joint angle based on electromyography. In 2018 2nd International Conference on Biomedical Engineering (IBIOMED) , pages 100-105, July 2018.

- 34. N. Ashwini, M. Rajshekar Patil, and Manoj Kumar Singh. Computational intelligence based chaotic time series prediction using evolved neural network. In Vikrant Bhateja, Carlos A. Coello Coello, Suresh Chandra Satapathy, and Prasant Kumar Pattnaik, editors, Intelligent Engineering Informatics , pages 383-396. Springer, 2018.
- 35. Hans B. Pacejka. Tyre and vehicle dynamics . Butterworth-Heinemann, Oxford, second edition, 2006.
- 36. Howard Dugoff, Paul S Fancher, and Leonard Segel. Tire performance characteristics affecting vehicle response to steering and braking control inputs. Technical Report Contract CST-460, Office of Vehicle Systems Research, August 1969.
- 37. Jo Yung Wong. Theory of Ground Vehicles . Wiley, Hoboken, N.J, third edition, 2008.
- 38. Rafael A. Cordeiro, Alessandro C. Victorino, Paulo A.V. Ferreira, Ely C. de Paiva, and Samuel S. Bueno. Tireground forces estimation in a 4-wheel vehicle using a delayed interconnected cascade-observer structure. IFACPapersOnLine , 49(15):139-144, 2016.
- 39. Rafael A. Cordeiro, Alexandre M. Ribeiro, Joze R. Oliveira, Alessandro C. Victorino, Paulo A.V. Ferreira, Ely C. de Paiva, and Samuel S. Bueno. Road grades and tire forces estimation using two-stage extended kalman filter in a delayed interconnected cascade structure. IEEE Intelligent Vehicles Symposium , 2017.
- 40. G. Gim and P. E. Nikravesh. An analytical model of pneumatic tyres for vehicle dynamic simulations. part 2: Comprehensive slips. International Journal of Vehicle Design , 12(1):19-39, 1991.
- 41. Rafael de Angelis Cordeiro. Track control of a four-wheel robotic vehicle in adverse terrain conditions . PhD thesis, Universidade Estadual de Campinas, 2017.
- 42. K. Osman, M. F. Rahmat, and M. A. Ahmad. Modelling and controller design for a cruise control system. In 2009 5th International Colloquium on Signal Processing Its Applications , pages 254-258, March 2009.
- 43. Rami Y. Hindiyeh and J. Christian Gerdes. Equilibrium analysis of drifting vehicles for control design. volume ASME 2009 Dynamic Systems and Control Conference, Volume 1 of Dynamic Systems and Control Conference , pages 181-188, 2009.
- 44. Junmin Wang, Lee Alexander, and Rajesh Rajamani. Friction estimation on highway vehicles using longitudinal measurements. Journal of Dynamic Systems, Measurement, and Control , 126(2):265, 2004.
Alexandre M. Ribeiro Alexandra Moutinho André R. Fioravanti Ely C. de Paiva
Estimation of Tire-Road Friction for Road Vehicles: a Time Delay Neural Network Approach
The performance of vehicle active safety systems is dependent on the friction
force arising from the contact of tires and the road surface. Therefore, an
adequate knowledge of the tire-road friction coefficient is of great importance
to achieve a good performance of different vehicle control systems. This paper
deals with the tire-road friction coefficient estimation problem through the
knowledge of lateral tire force. A time delay neural network (TDNN) is adopted
for the proposed estimation design. The TDNN aims at detecting road friction
coefficient under lateral force excitations avoiding the use of standard
mathematical tire models, which may provide a more efficient method with robust
results. Moreover, the approach is able to estimate the road friction at each
wheel independently, instead of using lumped axle models simplifications.
Simulations based on a realistic vehicle model are carried out on different
road surfaces and driving maneuvers to verify the effectiveness of the proposed
estimation method. The results are compared with a classical approach, a
model-based method modeled as a nonlinear regression.