An advanced scheme of compressed sensing of acceleration data for telemonintoring of human gait
Jianning Wu1 &
Haidong Xu1
The compressed sensing (CS) of acceleration data has been drawing increasing attention in gait telemonitoring application. In such application, there still exist some challenging issues including high energy consumption of body-worn device for acceleration data acquisition and the poor reconstruction performance due to nonsparsity of acceleration data. Thus, the novel scheme of compressive sensing of acceleration data is needed urgently for solutions that are found to these issues.
In our scheme, the sparse binary matrix is firstly designed as an optimal measurement matrix only containing a smallest number of nonzero entries. And then the block sparse Bayesian learning (BSBL) algorithm is introduced to reconstruct acceleration data with high fidelity by exploiting block sparsity. Finally, some commonly used gait classification models such as multilayer perceptron (MLP), support vector machine (SVM) and KStar are applied to further validate the feasibility of our scheme for gait telemonitoring application.
The acceleration data were selected from open Human Activity Dataset of Southern California University (USC-HAD). The optimal sparse binary matrix (a smallest number of nonzero entries is 8) is as strong as the full optimal measurement matrix such as Gaussian random matrix. Moreover, BSBL algorithm significantly outperforms existing conventional CS reconstruction algorithms, and reaches the maximal signal-to-noise ratio value (70 dB). In comparison, MLP is best for gait classification, and it can classify upstairs and downstairs patterns with best accuracy of 95 % and seven gait patterns with maximal accuracy of 92 %, respectively.
These results show that sparse binary matrix and BSBL algorithm are feasibly applied in compressive sensing of acceleration data to achieve the perfect compression and reconstruction performance, which has a great potential for gait telemonitoring application.
In recent 10 years, the telemonitoring of human gait has been drawing increasing attention in clinical application such as the early identification of at-risk gait of elderly, the assessment of gait during rehabilitation, and so on [1–3]. It is advantageous to easily real-time monitor gait function change of people at home or outdoor environment, and people don't often need to visit hospital. In most of gait telemonitoring system, the body-worn device equipped with accelerometer is usually served as data acquisition module, and the acquired acceleration data is transmitted, via internet, to remote terminal where further data processing such as gait classification is performed for gait telemonitoring [4–6]. Currently, acceleration data has been widely applied in the field of study on gait monitoring. In gait telemonitoring application, there still exist some challenging issues: energy constrains in body-worn device due to the limited battle life and the poor fidelity of receiving acceleration data at remote terminal [7–9]. Most of pervious studies mainly focused on searching for the technology solutions of energy constraint by designing wireless communication protocol with low energy consumption. Although previous studies can save energy by regulating the data packet size to be sent, they don't greatly reduce a larger amount of data (i.e. the dominant source of energy waste) during transmission [7, 8]. Recently, some researchers tried to introduce CS method (a novel data compression methodology including compression and reconstruction algorithm) to address existing issues [10–12]. Their basic idea is that in view of gait telemonitoring system, acceleration data processing is divided into two different stages. In the first stage, acceleration data before transmission on body-worn device is compressed at far below Nyquist sampling frequency. In the second stage, reconstruction of acceleration data is performed at remote terminal. For instance, Akimura et al. demonstrated that compressed sensing of acceleration data is feasible in human activity telemonitoring application [10]. In their study, Gaussian measurement matrix and conventional reconstruction algorithm were applied to compress and reconstruct acceleration data, respectively. However, they don't investigate the effect of nonsparsity of acceleration data on CS reconstruction performance. As we know, acceleration data is characterized by complex dynamic with long-range correlation, and its time series is usually non-stationary and nonlinear [13–15]. Moreover, acceleration data is non-sparse enough in time domain or the transformed domain. So, the nonsparsity of acceleration data must be taken into count in CS reconstruction algorithm that mainly depends on the sparsity of data [16], otherwise reconstruction data with poor fidelity is possibly produced, which largely deteriorates the quality of gait monitoring. Thus, it is need to find the advanced CS reconstruction algorithm for acceleration data with nonsparsity.
Theoretically, acceleration data has the rich data structure such as block structure [17–19], and it is possible to perfectly reconstruct acceleration data by exploiting block sparsity. Recent studies showed that block sparse Bayesian learning (BSBL) algorithm has superior ability to reconstruct non-sparse data by exploiting block sparsity even if data has no distinct block structure [18, 19]. Successful examples include reconstruction of EEG and fetal ECG in telemonitoring setting [20, 21]. To date, no study has been reported that BSBL is used to reconstruct acceleration data. It motivates us to investigate the practicality of application of BSBL for reconstruction of acceleration data with high fidelity.
In CS scheme, the design of measurement matrix is very important to improve CS performance. Currently, the most used measurement matrix mainly includes Gaussian matrix, Bernoulli matrix and sparse binary matrix. In comparison, Gaussian matrix and Bernoulli matrix are theoretically superior to sparse binary matrix. However, they have to be implemented in hardware with high energy consumption [22, 23]. For example, Gaussian random matrix can be generated only when Gaussian random generator is integrated in hardware, thus increasing the hardware complexity and high-computational complexity [22, 23]. In contrast, sparse binary matrix, derived from sub-Gaussian random matrices that is formed by the entries of 0 and 1, has advantages that the efficient implementation of the large matrix multiplication in CS is performed during a short execution time [20, 23]. More importantly, sparse binary matrix can be optimally designed as measurement matrix that only includes a smallest number of nonzero entries. These advantages are greatly contributes to be easily implemented in hardware design for saving more energy. So far, no study has been published that sparse binary matrix is feasibly applied for compressive sensing of acceleration data. Therefore, we try to investigate the feasibility of application of sparse binary matrix in compressive sensing of acceleration data.
So, in this study, we proposed a novel scheme of compressive sensing of acceleration data for gait telemonitoring. That is, sparse binary matrix is designed as an optimal measurement matrix only containing a smallest number of nonzero entries. And BSBL algorithm is introduced to reconstruct nonsparse acceleration data with high fidelity. The acceleration data were selected from an open human activity dataset of University of Southern California (USC-HAD) [24], in order to validate the feasibility of our CS scheme. In addition, three commonly used gait classification models such as support vector machine (SVM) [25], multilayer perceptron (MLP) [26] and KStar [27] are utilized to further test the reconstructed acceleration data with high fidelity for gait monitoring.
The rest of paper is organized as follows. Firstly, we describe the novel CS scheme of acceleration data for gait classification. Secondly, we present the simulation experiment that is made to validate the feasibility of our proposed CS scheme by using the selected USC-HAD data. Thirdly, we further discuss the effectiveness of our CS scheme in gait telemonitoring application according to experimental results. Lastly, the conclusion is presented.
The novel CS scheme of acceleration data for gait classification
Compressive sensing theory is proposed by Donoho, and its basic idea is that the best CS performance is achieved by exploring data sparsity. The conventional CS scheme mainly includes sparse representation of data, design of measurement matrix and reconstruction algorithm [11]. In our proposed CS scheme for gait telemonitoring, as shown in Fig. 1, sparse binary matrix is optimally designed as a measurement matrix for acceleration data compression on body-worn device. And BSBL algorithm is introduced to reconstruct acceleration data with high fidelity at remote terminal. This greatly contributes to gait classification with high quality in gait telemonitoring application. The detail of our CS scheme is presented as follows.
Block diagram of compressive sensing of acceleration data for gait telemonitoring
Design of the optimal measurement matrix
According to the CS theory, the raw acceleration data X ∊ R N × 1 (N denotes the length of data) on body-worn device can be greatly compressed by
$$Y = \Phi X$$
where measurement matrix Φ ∊ R M × N (M ≤ N) and compressed data Y ∊ R M × 1 (M is data length). Here, sparse binary matrix, as shown in Eq. (2), is selected to be optimally designed as a measurement matrix that contains a smallest amount of nonzero entries, in order to greatly reduce lots of computational resources on body-worn device. For comparison, Gaussian random matrix and Bernoulli random matrix are both selected to further validate the best CS performance from our scheme for acceleration data.
$$\Phi = \left( \begin{aligned} 1{ 0 1 0 } \cdots { 1} \hfill \\ 0 { 1 1 0 } \cdots { 0} \hfill \\ \vdots \, \vdots \, \vdots \, \vdots \, \cdots \, \vdots \hfill \\ 1 { 0 0 1 } \cdots { 0} \hfill \\ \end{aligned} \right)$$
BSBL algorithm for reconstructing acceleration data
In conventional CS reconstruction algorithm, data must satisfy sparse enough in time domain or the transformed domain [11]. That is, data X is sparsely represented as X = ψα, where ψ ∊ R N × N is sparse basis, and α is the corresponding sparse representation coefficient. And according to Eq. (1), compressed data Y = ΦX = Φψα. In CS theory, the estimation of sparse coefficient α can be obtained by solving the following l 1 optimization problem
$$\hbox{min} \left\| \upalpha \right\|_{1} {\text{subject}}\,{\text{to}}\,Y = \Phi \uppsi \upalpha$$
Therefore, the reconstruction of data \(\hat{X}\) can be achieved by the estimated α, i.e.\(\hat{X} = \Psi \upalpha \approx X\). The detailed procedure of solution is found in [11].
Unlike the above reconstruction algorithm, BSBL algorithm accurately reconstructs nonsparse data by exploiting block sparsity [17–19]. In this study, acceleration data Xis considered as a concatenation of a number of blocks, that is, \(X = \underbrace {{[x_{1} , \ldots ,x_{{h_{1} }} }}_{{x_{1}^{T} }}, \ldots ,\underbrace {{x_{{h_{l - 1} + 1}} , \ldots ,x_{{h_{l} }} ]^{T} }}_{{x_{l}^{T} }}\) where l is a number of the randomly partitioned blocks, and h i denotes the partitioned block size. In BSBL algorithm for reconstructing acceleration data, each partition block X j ∊ R l × 1 satisfies the parameterized multivariate Gaussian distribution:
$$p\left( {X_{j} ;\uplambda_{j} ,b_{j} } \right) \sim N\left( {0,\uplambda_{j} b_{j} } \right),\quad j = 1,2, \ldots ,l$$
where the unknown positive parameters λ j is used to capture block sparsity, and λ j = 0 means that the j-th block is zero. The unknown parameter \(b_{j} \in R^{{d_{j} \times d_{j} }}\) is a positive definite matrix, and it describes the correlation among elements within the j-th block. Here, all partitioned block are assumed to satisfy mutual uncorrelated, and the prior density of X is defined as
$$p\left( {X;\left\{ {\uplambda_{j} ,b_{j} } \right\}} \right) \sim N\left( {0,\sum_{x} } \right) \quad where\,\sum\nolimits_{x} { = \left\{ \begin{aligned} \uplambda_{1} b_{1} ,0, \ldots \ldots ,0 \hfill \\ 0,\uplambda_{2} b_{2} ,0, \ldots ,0 \hfill \\ \ldots \ldots \ldots \ldots \ldots \ldots \hfill \\ 0,0, \ldots \ldots \ldots ,\uplambda_{l} b_{l} \hfill \\ \end{aligned} \right\}}$$
In view of acceleration data contaminated by noise, compressed data Y ∊ R M × 1 is defined as
$$Y = \Phi X + Z$$
where Z ∊ R M × 1 denotes noise, and it satisfies Gaussian distribution of N(0, ρI)where ρ is a positive scalar and I ∊ R M × 1is an identity matrix. Based on Y ∊ R M × 1, the posterior density of X is defined as Gaussian distribution
$$p\left( {{X \mathord{\left/ {\vphantom {X {Y;\uprho ,\left\{ {\uplambda_{j} ,b_{j} } \right\}_{j = 1}^{l} }}} \right. \kern-0pt} {Y;\uprho ,\left\{ {\uplambda_{j} ,b_{j} } \right\}_{j = 1}^{l} }}} \right) = {\rm N}\left( {\upmu_{\Uptheta } ,\sum\nolimits_{\Uptheta } {} } \right)$$
where the mean value \(\upmu_{\Uptheta } = \sum\nolimits_{x} {\Phi^{T} \left( {\uprho I + \Phi \sum\nolimits_{x} {\Phi^{T} } } \right)^{ - 1} Y}\), and the value of covariance matrix \(\sum\nolimits_{\Uptheta } = \left( {\sum\nolimits_{x}^{ - 1} {} + \frac{1}{\uprho }\Phi^{T} \Phi } \right)^{ - 1}\).
So, reconstruction of acceleration data \(\hat{X}\) is achieved when all parameters (ρ, λ j , b j ) are available, i.e. \(\hat{X} \approx \upmu_{\Uptheta }\). In BSBL framework, all parameters (ρ, λ j , b j ) are obtained by optimal learning algorithms [18, 19]. In this study, we select the bound-optimization BSBL algorithm (i.e. BSBL-BO) due to its faster convergence speed. The detail procedure for solution is presented in Appendix 1.
For comparison, some conventional CS reconstruction algorithms were selected to validate superior ability of BSBL algorithm for reconstructing acceleration data. These selected algorithms include: (1) algorithms without block structure such as orthogonal matching pursuit (OMP) [28], basis pursuit (BP) [29], subspace pursuit (SP) [30], smoothed l 0-norm (SL0) [31]; (2) algorithms with block structure such as dynamic group sparsity (DGS) [32], structured orthogonal matching pursuit (SOMP) [33], Group Lasso [34], and these algorithms only consider the prior knowledge of block partition.
Evaluation criteria for the proposed CS scheme
In this study, the assessment of performance of our scheme is implemented according to the following common criteria [18, 20, 22, 23]:
Compression ratio (CR): it is used to quantitatively evaluate the ability of compression of acceleration data, and is defined as
$$CR = \frac{N}{M} \times 100 \, \%$$
Normalized mean square error (NMSE): it is employed to assess the performance of reconstruction of acceleration data, and is defined as
$$NMSE(X,\hat{X}) = \frac{{\left\| {X - \hat{X}} \right\|_{2}^{2} }}{{\left\| X \right\|_{2}^{2} }}$$
Signal-to-noise ratio (SNR): it is only used to measure the ability of the reconstruction of acceleration data, and is defined as
$$SNR = 10\log_{10} \frac{{\sum\nolimits_{n = 1}^{N} {X^{2} (n)} }}{{\sum\nolimits_{n = 1}^{N} {(X(n) - \hat{X}(n))^{2} } }}$$
Pearson correlation coefficient: it is also used to evaluate the reconstruction performance by testing the similarity difference between the raw data and the reconstruction data, and is defined as
$$R = \frac{{\sum\nolimits_{i = 1}^{N} {\left( {X_{i} - \bar{X}} \right)\left( {\hat{X}_{i} - \bar{\hat{X}}} \right)} }}{{\sqrt {\sum\nolimits_{i = 1}^{N} {\left( {X_{i} - \bar{X}} \right)^{2} } } \sqrt {\sum\nolimits_{i = 1}^{N} {\left( {\hat{X}_{i} - \bar{\hat{X}}} \right)^{2} } } }} \quad i = 1,2, \ldots ,N$$
where \(\bar{\hat{X}}\) denotes the mean value.
Gait classification models based on the reconstructed acceleration data
Three commonly used gait classification models such as SVM, MLP, and KStar were selected to further test the reconstructed acceleration data with high fidelity for gait monitoring. SVM classification model is derived from the Vapnik–Chervonenkis theory and structural risk minimization [25]. Its basic idea is that the data to be classified can be firstly mapped into the high-dimensional feature space via kernel function, and then an optimal separating hyperplane is constructed between the classes in the mapped space. The multilayer perceptron is also an effective classification model based on artificial neural networks, and it usually uses the back propagation algorithm to construct classification model [26]. KStar is a common classification model based on k-nearest neighbors framework, and its basic idea is to measure the difference between input sample by using entropy-based distance [27]. A detailed description of these classification algorithms are found in [25–27], respectively.
In order to improve classification performance, some good gait features containing more separate information are selected from the reconstructed acceleration data according to some common statistical parameters [5, 9, 10, 13, 14]: Standard deviation (SD), Skewness, Kurtosis and Pearson correlation coefficient. These selected parameters are defined as follows:
$$SD = \sqrt {\frac{1}{N}\sum\limits_{i = 1}^{N} {\left( {\hat{X}_{i} - \bar{\hat{X}}_{i} } \right)}^{2} }$$
$$Skewness = \frac{{N\sum\nolimits_{i = 1}^{N} {\left( {\hat{X}_{i} - \bar{\hat{X}}_{i} } \right)^{3} } }}{{\left( {N - 1} \right)\left( {N - 2} \right)SD^{3} }}$$
$$Kurtosis = \left( {\frac{{N\left( {N + 1} \right)}}{{\left( {N - 1} \right)\left( {N - 2} \right)\left( {N - 3} \right)}}\frac{{\sum\nolimits_{i = 1}^{N} {\left( {\hat{X}_{i} - \bar{\hat{X}}_{i} } \right)^{4} } }}{{SD^{4} }}} \right) - \frac{{3\left( {N - 1} \right)^{2} }}{{\left( {N - 2} \right)\left( {N - 3} \right)}}$$
In addition, Pearson correlation coefficient is defined in Eq. (11).
Also, the prediction ability of gait classification model is evaluated according to three statistical measures [16, 35]: Accuracy (Acc), Sensitivity (Sen), and Specificity (Spe). The above measures are defined as follows:
$$Accuracy = \frac{TP + TN}{TP + FP + TN + FN} \times 100 \, \%$$
$$Sensitivity = \frac{TP}{TP + FN} \times 100 \, \%$$
$$Specificity = \frac{TN}{TN + FP} \times 100 \, \%$$
where TP refers to the number of true positive; FP is the number of false positive; TN denotes the number of true negative; FN is the number of false negative.
Acceleration data dataset
In this study, the acceleration data from an open USC-HAD (http://www-scf.usc.edu/~mizhang/datasets.htm) [24] were selected to validate the feasibility of our proposed CS scheme. The USC-HAD includes acceleration data of 14 subjects with 12 low-level activities such as walk forward, walk left, walk right, go upstairs, go downstairs, run forward, jump up and down, sit and fidget, stand, sleep, elevator up, and elevator down. Each activity was asked to perform on different days at various indoor and outdoor locations for capturing more information related to day-to-day activity variations. The acceleration data was acquired by a MotionNode (e.g. a high-performance factory-calibrated inertial sensing device) which integrates a 3-axis accelerometer (±6 g) and a 3-axis gyroscope (±500 dps). MotionNode was asked to wear on the front right hip of each subject and the sample ratio was set to 100 Hz. For each activity, each participant was asked to perform 5 trials.
Evaluation of sparse binary matrix for CS of acceleration data
Firstly, we evaluate the effect of sparse binary measurement matrix containing the smallest number of nonzero entries on CS performance. In the experiment, sparse binary matrix only includes d nonzero entries in each column, and the smallest number of nonzero entriesdis determined according to the best CS performance while compression ratios are varied. The acceleration data length is set to 512 points (i.e. N = 512). BSBL-BO and NMSE are used as reconstruction algorithm and evaluation criterion, respectively. The results are shown in Fig. 2, and it is obviously that while compression ratios are varied, NMSE varies with the value of d. When compression ratio is less than 30 %, NMSE slightly changes during the increase of the value of d. In contrast, when compression ratio reaches 50 %, NMSE increases with the value of d. Especially, when the number of d exceeds 8, NMSE still keeps lower and stable. These results illustrate that sparse binary matrix containing a small number of nonzero entries is feasible for compressive sensing of acceleration data. In addition, when compression ratio is more than 80 %, NMSE significantly grows, suggesting that higher compression ratios possibly destroy CS performance.
Results of NMSE versus d for different CRs
For comparison, Gaussian random matrix and Bernoulli random matrix are performed in the experiment. Both selected matrices satisfy independent identically distributed, and the entries of each matrix are obtained by sampling its corresponding distribution. The comparative results are shown in Fig. 3. It is apparent that NMSE from three matrices all increase with compression ratios. In comparison, NMSE from our designed sparse binary matrix is lower when compression ratio is less than 60 %. Especially, while compression ratio is close to 40 %, NMSE from three matrices is almost same. These results show that our designed sparse binary matrix is as strong as the full random matrices in compressive sensing of acceleration data.
Results of NMSE versus CRs for three different measurement matrices
Evaluation of the performance of BSBL reconstruction algorithm
Next, we evaluate the reconstruction performance of BSBL algorithm. In this experiment, acceleration data length is fixed to 500 (i.e. N = 500), and it is divided into 25 blocks, each block containing 20 points. Our designed sparse binary matrix and discrete cosine group dictionary are used as measurement matrix and sparse basis ψ, respectively. For comparison, some conventional CS reconstruction algorithms such as OMP, BP, SP, SL0, DGS, SOMP, and Group Lasso are performed. Pearson correlation coefficient and signal-to-noise ratio (SNR) are selected as evaluation criteria, respectively. Each reconstruction algorithm is repeated for 20 times. The comparative results are shown in Figs. 4 and 5, respectively. As shown in Fig. 4, SNR from most of algorithms increases with the value ofM, except that SNR from OMP, BP and DGS decrease. In comparison, SNR from BSBL-BO algorithm is maximal. Similarly, as shown in Fig. 5, it is obviously that Pearson correlation coefficient values from all reconstruction algorithms increase with the value ofM. In comparison, Pearson correlation coefficient from BSBL-BO is higher when the value of M is less than 350. Especially, from Fig. 4 and 5, it is apparent that when a number of Mis close to 250, the reconstruction performance of BSBL-BO algorithm is best. In addition, Table 1 also presents that the comparative results among all reconstruction algorithms when compression ratio is set to 50 %. As shown in Table 1, BSBL-BO algorithm reaches the maximal SNR value of 70 dB while its execution time is higher. This is because BSBL algorithm needs a large number of iterations for finding fewer sparse blocks hidden in acceleration data. In conclusion, these results illustrate that BSBL algorithm feasibly reconstruct acceleration data with high fidelity by exploiting block sparsity.
Results of SNR versus M
Results of Pearson correlation coefficient versus M
Table 1 Performance comparison between different reconstruction algorithms
Evaluation of the effect of our proposed CS scheme on gait classification
With the reconstructed data, different gait classification models based on SVM, MLP and KStar were implemented to evaluate the effectiveness of our CS scheme in gait telemonitoring application. In the experiment, the acceleration data from all subjects in USC-HAD dataset were selected. The window was set to be length N = 512 with 50 % overlap [16], and 10 windows were randomly extracted from each subject' data. That is, for each pattern, sample data size of each subjects are 10, and each sample data length is fixed to 512 (i.e. N = 512). Based on four statistical parameters from each axis data, a gait pattern is defined as 12 dimensions feature vector. In this experiment, MLP with momentum back propagation algorithm is used, and SVM containing sequential minimal optimization algorithm with the polynomial kernel function is employed. All classification algorithm programs are developed in Matlab 7.0 using WEKA [36], and they are performed on computer with Intel(R) Core(TM) i5-3470 3.20 GHz CPU, 4.00 GB RAM and Windows 7 operating system.
Firstly, we select two gait patterns such as up-stairs and down-stairs for testing classification performance. To effectively evaluate the generalization ability across subjects, 10 subjects' data patterns including 100 upstairs and 100 downstairs were randomly selected as training set. In the process of training classification model, a tenfold cross validation scheme was implemented due to the limited data size. That is, the selected 200 gait patterns data were randomly divided into 10 subsets, each subset including 10 upstairs data and 10 downstairs data. 9 subsets were arbitrarily selected as training set while the remaining one was used to test. The above step is repeated until each subset was employed to test. After classification model was obtained, the remaining 4 subjects' data including 40 upstairs and 40 downstairs were used to test its generalization ability. It is noted that the remaining 4 subjects' data are not included in training set.
Table 2 presents the best results from three selected classification models. As shown in Table 2, it is apparent that all generalization performance from three selected models are higher while BSBL algorithm is performed. In comparison, classification performance of MLP is best, and it reaches same maximum value of accuracy (95 %), sensitivity (95 %), and specificity (95 %), suggesting that MLP with momentum back propagation algorithm can capture more additional discriminatory information regarding gait patterns. These results illustrate that BSBL algorithm has superior ability to reconstruct acceleration data with high fidelity for gait classification with high quality.
Table 2 The best prediction results from classification models with all reconstruction algorithms
In addition, the selection of optimal parameters is important for best classification performance. Here, the optimal parameters are determined according to the best performance because the optimal value of each parameter varies with different values of other parameters in each classification model. The optimal parameters selected in each model are presented as follows. In MLP, the number of learning epochs is 600. The learning rate is 0.3, and the momentum factor is 0.5. In SVM, the regularization parameter is 1 and the degree of polynomial is 2. In KStar, the parameter for global blending is 20. A detail description of these parameters can be found in [36].
Next, we employ the above optimal MLP model to classify seven different gait patterns such as walk forward, walk left, walk right, go upstairs, go downstairs, run forward, sitting, in order to further evaluate the practicability of our scheme for gait monitoring. In this experiment, to effectively evaluate the generalization ability across subjects, the gait pattern data from 13 subjects are randomly selected as training set containing all sample size of 910 (i.e. 130 walk forward data, 130 walk left data, 130 walk right data, 130 upstairs, 130 downstairs, 130 run data and 130 sitting data). In the process of training model, a tenfold cross validation scheme was implemented, that is, the selected data is randomly divided into 10 subsets, each subset containing 13 walk forward data, 13 walk left data, 13 walk right data, 13 upstairs data, 13 downstairs data, 13 run data and 13 sitting data. 9 subsets were randomly selected to train while the remaining one was used to test. The above step was repeated until each subset was used to test. After the classification model was obtained, the remaining one subject data including all sample size of 70 (i.e. 10 walk forward data, 10 walk left data, 10 walk right data, 10 upstairs, 10 downstairs, 10 run data and 10 sitting data) was used to test the generalization ability. Here, each subject data has to be used to test generalization ability. Finally, the whole averaged classification result is obtained for all subjects. Table 3 gives the confusion table for classification of seven gait patterns. Here, it is noted that the entry in the ith row and jth column refers to the count of gait pattern belonging to class i that is classified as class j. As shown in Table 3, the whole averaged classification accuracy across all gait patterns reaches 92 %, suggesting that gait classification performance is superior. In term of individual patterns, sitting pattern can gain the maximal precision and recall value of 99 %, and sitting pattern is classified accurately. For upstairs pattern, it is noticed that its precision is near to 91 % whereas its recall is only 83 %. The possible reason is that some samples of upstairs are easily misclassified as walk forward, but some samples of walk forward is not misclassified as upstairs. In conclusion, these results show that our proposed CS scheme can provide more valuable information regarding gait pattern change for gait classification with higher quality.
Table 3 The confusion table for classification of seven different gait patterns
Currently, the novel scheme of compressive sensing of acceleration data is needed urgently for addressing some challenging issues such as energy constraint and poor reconstruction performance in gait telemonitoring application. In the present study, in view of energy constraint on body-worn device, we investigate the feasibility of sparse binary matrix in compressive sensing of acceleration data. As shown in Figs. 2 and 3, our designed sparse binary matrix containing few nonzero entries can feasibly produce the almost same best CS performance as some common used full optimal random matrices such as Gaussian matrix. This greatly contributes to saving more computational resources for hardware design of body-worn device. Besides, we also find that higher compression ratio possibly destroy the proposed CS performance. The possible reason is that higher compression ratio worsen the maximal incoherent measurement between sparse binary measurement matrix Φ and the sparse basis ψ [11].
In addition, in view of acceleration data with nonsparsity, we also investigate the practicability of BSBL algorithm for reconstructing acceleration data with high fidelity by exploiting block sparsity. As seen from Figs. 4, 5 and Table 1, BSBL-BO algorithm significantly outperform existing CS reconstruction algorithms such as OMP, BP, SP, SL0, DGS, SOMP and Group Lasso. This is because BSBL algorithm has superior ability to capture few unknown nonzero blocks by exploiting intra-block correlation in acceleration data. In contrast, existing CS reconstruction algorithms only rely on the priori knowledge of data block partition, not to provide valuable insight into specific types of possible intra-block information [18, 37, 38]. Similar results of study on EEG telemonitoring have been found in [20].
In this study, with the reconstructed acceleration data, we further evaluate the effectiveness of our proposed CS scheme in gait telemonitoring application by using gait classification. As shown in Tables 2 3, all selected gait classification models can produce superior generalization performance. This is because BSBL algorithm takes advantage of exploring intra-block correlation in acceleration data to gain more valuable information associated with the spatial, temporal and dynamic correlations of human gait, which greatly contribute to improving gait classification performance. In addition, this study shows that MLP is best in all gait classification models. The possible reason is that MLP with back propagation algorithm can significantly improve the learning speed of optimization algorithm for acceleration data, thus avoiding the local optimal solution of classification algorithm. Similar finding has been reported in [35].
In this study, we propose a novel scheme of compressive sensing of acceleration data for gait telemonitoring. In such scheme, sparse binary matrix is feasibly designed as measurement matrix only containing few nonzero entries, which greatly contribute to saving lots of computational resources on body-worn device. Also, BSBL algorithm is feasibly applied to reconstruct acceleration data with high fidelity by exploiting block sparsity, which is very helpful for gait classification with high quality. This study has a great potential for gait telemonitoring application. More effort should be exerted to find the effective method that can significantly improve the ability of compressive sensing of acceleration data while compressed ratio is higher.
Scanaill CN, Carew S, Barralon P, Noury N, Lyons D, Lyons GM. A review of approaches to mobility telemonitoring of the elderly in their living environment. Ann Biomed Eng. 2006;34:547–63.
Mackey AH, Stott NS, Walt SE. Reliability and validity of an activity monitor (IDEEA) in the determination of temporal-spatial gait parameters in individuals with cerebral palsy. Gait Posture. 2008;28:634–9.
Roy SH, Cheng MS, Chang SS, et al. A combined sEMG and accelerometer system for monitoring functional activity in stroke. IEEE Trans Neural Systems and Rehabil Eng. 2009;17(6):585–94.
Dean M, Michael R, Narayanan M, Nigel H, Branko G. Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring. IEEE Trans Inf Technol Biomed. 2006;10:156–67.
Senden R, Grimm B, Heyliger IC, Savelberg H, Meijer K. Acceleration-based gait test for healthy subjects: reliabillity and reference data. Gait Posture. 2009;30:192–6.
David H, Louis O, Chou L. Monitoring recovery of gait balance control following concussion using an accelerometer. J Biomech. 2015;48(18):3364–8.
Mo LF, Liu SP, Gao RX, John D, Staudenmayer JW, Freedson PS. Wireless design of a multisensor system for physical activity monitoring. IEEE Trans Biomed Eng. 2012;59:3230–7.
Abdelkrim H, Marion S. Wireless sensor networks for rehabilitation applications: challenges and opportunities. J Netw Comput Appl. 2013;36:1–15.
Piyush G, Tim D. Feature selection and activity recognition system using a single tri-axial accelerometer. IEEE Trans Biomed Eng. 2014;61(6):1780–6.
Akimura D, Kawahara Y, Asami T. Compressed sensing method for human activity sensing using mobile phone accelerometers. Ninth International Conference on Networked Sensing Systems (INSS); 2012. p 1–4.
Donoho D. Compressed sensing. IEEE Trans Inf Theory. 2006;52:1289–306.
Jeevan K, Sridhar K. Compressive sensing of foot gait signals and its application for the estimation of clinical relevant time series. IEEE Trans Biomed Eng. 2015; in press.
Popivanov D, Mineva A. Testing procedures for non-stationarity and non-linearity in physiological signals. Math Biosci. 1999;157:303–20.
Chou T. A review of analytical techniques for gait data. Part 1: fuzzy, statistical and fractal methods. Gait Posture. 2001;13:49–66.
Machado IP, Gomes AL, Gamboa H, Paixão V, Costa RM. Human activity data discovery from triaxial accelerometer sensor: non-supervised learning sensitivity to feature extraction parameterization. Inf Process Manage. 2015;51:204–14.
Zhang M, Sawchuk AA. Human daily activity recognition with sparse representation using wearable sensors. IEEE J Biomed Health Inform. 2013;17:553–60.
Eldar YC, Kuppinger P, Bolcskei H. Block-sparse signals: uncertainty relations and efficient recovery. IEEE Trans Signal Process. 2010;58:3042–54.
Zhang Z, Rao B. Extension of SBL algorithm for the recovery of block sparse signal with intra-block correlation. IEEE Trans Signal Process. 2012;61(8):2009–15.
Zhang Z, Rao B. Sparse signal recovery with temporally correlated source vector using sparse Bayesian learning. IEEE J Sel Top Signal Process. 2011;5(5):912–26.
Zhang Z, Jung T, Makeig S, Rao B. Compressed sensing of EEG for wireless telemonitoring with low energy consumption and inexpensive hardware. IEEE Trans Biomed Eng. 2013;60:221–4.
Zhang Z, Jung TP, Scott M, Rao B. Compressed sensing for energy-efficient wireless telemonitoring of noninvasive fetal ECG via block sparse Bayesian learning. IEEE Trans Biomed Eng. 2013;60(2):300–9.
Fauvel S, Ward RK. An energy efficient compressed sensing for the compression of electroencephalogram signals. Sensors. 2014;14:1474–96.
Mamaghanian H, Khaled N, Atienza D, et al. Compressed sensing for real-time energy-efficient ECG compression on wireless body sensor nodes. IEEE Trans Biomed Eng. 2011;58:2456–66.
Zhang M, Sawchunk AA. USC-HAD: a daily activity dataset for ubiquitous activity recognition using wearable sensors, ACM International Conference on Ubiquitous Computing (UbiComp) Workshop on Situation, Activity and Goal Awareness (SAGAware), Pittsburgh; 2012.
Vapnik VN. Statistical learning theory. New York: John Wiley and Sons Inc; 1998.
Bernard I. Multilayer perceptron and uppercase handwritten characters recognition. Proceedings of the Second International Conference on Document Analysis and Recognition; 1993. p. 935-8.
Cleary JG, Trigg LE. K*: an instance-based learner using an entropic distance measure, Proceedings of the Twelfth International Conference on Machine Learning; 1995. p. 108–14.
Tropp JA, Gilbert AC. Signal recovery from random measurements via orthogonal matching pursuit. IEEE Trans Inf Theory. 2007;53:4655–66.
Den E, Friedlander M. Probing the pareto frontier for basis pursuit solutions. SIAM J Sci Comput. 2008;31:890–912.
Dai W, Milenkovic O. Subspace pursuit for compressive sensing: closing the gap between performance and complexity. IEEE Trans Inf Theory. 2009;55:2230–49.
Mohimani H, Babaie M, Jutten C. A fast approach for over complete sparse decomposition based on smoothed-norm. IEEE Trans Signal Process. 2009;57:289–301.
Huang J, Huang X, Dimitris M. Learning with Dynamic Group Sparsity. The 12th International Conference on Computer Vision, Kyoto; 2009.
Huang J, Zhang T, Metaxas D. Learning with structured sparsity. In Proceedings of the 26th Annual International Conference on Machine Learning; 2009. p. 417–24.
Yuan M, Lin Y. Model selection and estimation in regression with grouped variables. J R Stat Soc (B). 2006;68:49–67.
Chan H, Yang M, Zheng H, Wang H, Sterritt R, Sally M and Mayagoitia RE. Machine learning and statistical approaches to assessing gait patterns of younger and older healthy adults climbing stairs. Seventh International Conference on Natural Computation; 2011. p.588–92.
Bouckaert RR, Frank E, Hall MA, Holmes G, Pfahringer B, Reutemann P, Witten IH. WEKA-experiences with a java open source project. J Mach Learn Res. 2010; 11:2533–41. http://www.csie.waikato.ac.nz/ml/weka/.
Figueiredo M, Nowak R, Wright S. Gradient projection for sparse reconstruction: application to compressed sensing and other inverse problems. IEEE J Sel Top Sign Proces. 2007;1(4):586–97.
Kim S, Koh K, Lustig M, Boyd S, Gorinevsky D. An interior-point method for large-scalel1-regularized least squares. IEEE J Sel Top Sign Proces. 2008;1(4):606–17.
JW conceived the original idea of the study, and a corresponding author. He participated in the design of the algorithm and drafted the manuscript. HX participated in the realization of the algorithm and analyzed data. All authors read and approved the submitted manuscript.
The authors wish to acknowledge the Human Activity Dataset from University of Southern California (USC-HAD) and the support of the natural science fund project from Fujian Province (No.2013J01220).
The authors declare that they have no competing interesting.
School of Mathematics and Computer Science, Fujian Normal University, Fuzhou, 350007, Fujian, China
Jianning Wu & Haidong Xu
Jianning Wu
Haidong Xu
Correspondence to Jianning Wu.
In BSBL framework, all unknown parameters (ρ, λj, b j) is estimated by maximum likelihood procedure that minimizes the following cost function
$$L\left( {\uprho ,\left\{ {\uplambda_{j} ,b_{j} } \right\}} \right) = \log \left| {\uprho I + \Phi \sum\nolimits_{x} {} \Phi^{T} } \right| + Y^{T} \left( {\uprho I + \Phi \sum\nolimits_{x} {} \Phi^{T} } \right)^{ - 1} Y$$
In BSBL-BO algorithm, the learning rules for parameters (ρ, λj, b j) is defined as follows:
$$\uprho \leftarrow \frac{{\left\| {Y - \Phi \upmu_{\Uptheta } } \right\|_{2}^{2} + Tr\left( {\sum\nolimits_{\Uptheta } {\Phi^{T} \Phi } } \right)}}{M}$$
$$\uplambda_{j} \leftarrow \sqrt {\frac{{X_{j}^{T} b_{j}^{ - 1} X_{j} }}{{Tr((\Phi^{j} )^{T} (\varSigma_{Y}^{*} )^{ - 1} \Phi^{j} b^{j} )}}} \quad \text{where} \quad \sum\nolimits_{Y}^{*} { = \uplambda I + \Phi \sum\nolimits_{x}^{*} {\Phi^{T} } }$$
$$b_{j} \leftarrow \frac{1}{l}\sum\limits_{i = 1}^{l} {\frac{{\varSigma_{\Uptheta }^{j} + u_{\Uptheta }^{j} (u_{\Uptheta }^{j} )^{T} }}{{\uplambda_{j} }}}$$
And then, the optimal parameters (ρ, λj, bj) are solved according to the defined learning rules. So, reconstruction of acceleration data \(\hat{X}\) is obtained by calculating
$$\hat{X} = \upmu_{\Uptheta } = \sum\nolimits_{x} {} \Phi^{T} \left( {\uprho I + \Phi \sum\nolimits_{x} {} \Phi^{T} } \right)^{ - 1} Y$$
Wu, J., Xu, H. An advanced scheme of compressed sensing of acceleration data for telemonintoring of human gait. BioMed Eng OnLine 15, 27 (2016). https://doi.org/10.1186/s12938-016-0142-9
Acceleration data
Gait classification
Gait monitoring and assessment