## A RobustICA-Based Algorithm for Blind Separation of Convolutive Mixtures

Zaid Albataineh and Fathi M. Salem

Circuits, Systems, And Neural Networks (CSANN) Laboratory Department of Electrical and Computer Engineering, Michigan State University, East Lansing, Michigan 48824-1226, U.S.A. Email: albatain@msu.edu, salemf@msu.edu



Abstract -We  propose  a  frequency-domain  method  based  on robust  independent  component  analysis  (RICA)  to  address  the multichannel Blind Source Separation (BSS) problem of convolutive  speech  mixtures  in  highly  reverberant  environments. We  impose  regularization  processes  to  tackle  the  ill-conditioning problem of the covariance matrix and to mitigate the performance degradation  in  the  frequency  domain.  We  apply  an  algorithm  to separate the source signals in adverse conditions, i.e. high reverberation conditions when short observation signals are available. Furthermore, we study the impact of several parameters on  the  performance  of  separation,  e.g.  overlapping  ratio  and window type  of  the  frequency  domain  method.    We  also  compare different  techniques  to  solve  the  frequency-domain  permutation ambiguity.  Through  simulations  and  real-world  experiments,  we verify the superiority of the presented convolutive algorithm among other  BSS  algorithms,  including  recursive  regularized  ICA  (RRICA), independent vector analysis (IVA).

Index  Terms -Blind  Source  Separation  (BSS),  Independent Component Analysis (ICA), Robust Independent Component Analysis  (RobustICA),  highly  reverberant  environments,  gradient descent algorithms, Recursive Regularized ICA (RR-ICA), Independent Vector Analysis (IVA).

## I. INTRODUCTION

Blind  Source  Separation  (BSS)  [1]  has  a  solid  theoretical foundation and many potential applications. In fact, BSS has remained a very important topic of research and development for a long time in many areas, such as biomedical engineering, image processing, communication systems, speech enhancement,  remote  sensing,  etc.  BSS  techniques  do  not require any prior knowledge about a mixing matrix or source signals and do not require any training data.

Independent Component Analysis (ICA) is a powerful tool in  BSS  and  Multichannel  Blind  Deconvolution  (MBD)  [1], [2].  ICA  is  a  key  factor  of  BSS  and  unsupervised  learning algorithms. ICA  techniques  do  not  assume  full a priori knowledge about the mixing environment, source signals, etc. Also, ICA is related to Principle Component Analysis (PCA) and  Factor  Analysis  (FA)  in  multivariate  analysis  and  data mining.    This  is  especially  the  case  when  corresponding  to second order methods in which the components or factors are in the form of a Gaussian distribution [1], [2], [6].

Nevertheless,  ICA  is  a  statistical technique  that  includes higher order statistics (HOS), where the goal is to represent a set of random variables as a linear transformation of statistically independent components [1].

ICA  methods  usually  assume  certain  properties  of  the sources  or  mixing  system  in  order  to  exploit  a  separation criterion which imposes the same properties on their estimates. In ICA  of  speech  signals,  several  approaches  have  been proposed in a simple case of instantaneous linear mixtures [615].  However,  convolutive  linear  mixtures  are  considered more suitable in real-world applications [1-3]. Several convolutive  ICA  approaches  have  been  proposed  for  time domain  [3], [4], [42-43] and frequency domain  [32-40] methods.  Refer  to  [3],  [22]  for more  details  of  existing convolutive ICA methods.

One  can  exploit  the  inherent  non-stationary  attribute  of natural  speech  signals  by  using  the  second  order  statistics (SOS) method [2]. Mixing environments are considered to be stationary environments and, even in a short period, one can exploit  the  higher  order  statistics  e.g.  Joint  Approximation Diagonalization (JAD) problem as in [9], [10].  According to [42], [46], online BSS algorithms can be adapted in the time domain  under  non-stationary  conditions.  However,  the  time domain  approach  suffers  from  slow  convergence,  lack  of stability and high computational complexity [22].

Alternatively, a block online frequency domain BSS algorithm is proposed in [22], [28].  In this case, one can apply the separation processes on individual blocks of the input data over  time.        Furthermore,  one  can  assume  that  the  mixing environment is stationary in short time windows.  This means that the source signals don't change their location during this interval of time. This requires choosing the right time frame to guarantee that  the  separation  algorithms  are  accurate  enough with  this  given  observed  data  within  this  window.  For  more details, refer to [43], in which there is a recent ICA algorithm based on the time domain framework for the short mixtures.

The  proposed  recursive  regularized  ICA  [40]  algorithms allow  estimating  a  large  number  of  demixing  matrices  even with a short amount of data. Despite the good performance of the  aforementioned  algorithms,  it  is  considered  to  be  semiblind since it is based on prior knowledge about the acoustic source signals, i.e.:  the acoustic propagation and the spectral

characteristic  of  the  source  signals.  In  [22],  [31],  Authors studied the relationship between the number of frames of the STFT  analysis  and  the  BSS  algorithms  based  on  frequency framework.  They  argued  the  BSS  algorithms  in  frequency domain are significantly affected by the number of the mixing matrices.  Also  in  [22],  [31],  Authors  proposed  a  method  of applying the ICA adaptation to a group of frequencies in order to leave the size of the STFT large enough to achieve accurate separation  processes.  This  method  assumed  that  the  acoustic propagation approximated is based on an anechoic model, i.e. as the DRR decreases.

There  are  several  drawbacks  for  separating  the  acoustic sources based on frequency domain methods [22], [40]. First of  all,  when  we  have  a  high  reverberation  environment,  this requires  us  to  increase  the  number  of  demixing  matrices  to ensure an efficient estimation for the source signals. However, this  requirement  is  not  easy  to  satisfy,  especially  if  we  have short  observation  signals  of  the  source  signals.  Therefore, inspired  by  the  works  of  V.  Zarzoso,P.  Comon  [5],  [6],  this paper considers several challenges for the convolutive mixtures  in  the  frequency  domain  in  order  to  carry  out  the RobustICA-based algorithm in the frequency domain. We can summarize these challenges as follows.

-  Increasing  the  immunity  of  the  BSS  algorithm towards  the  outlets,  e.g.  signals'  length,  additive noise, reverberation time and source moving etc.
-  Implementing  should  be  optimized  to  be  suitable for  the  real-time  operation  [42]  in order to  make the real-time DSP processor handle the computational cost without interruptions or distortions.
-  Effectively  treating  the  scaling  and  permutation problems in the frequency domain.
-  Reducing the computational complexity of the ICA algorithms based on the frequency framework.
-  Controlling  the  accuracy  of  the  ICA  algorithm especially  when  short  mixtures  are  available  and the demixing matrices are not constrained by any anechoic model.

Regarding  the  paper's  notation  of  matrix  computation,  a matrix is denoted as a bold capital letter such as , is  the matrix transpose of ,  its Frobenius norm is marked by , an  identity  matrix  of  size  n  is  denoted  as , a  vector  is denoted as bold small letter such as , and scalars are denoted as a small letter such as .

The remainder of the paper is organized as follows. Section II provides a brief description of convolutive mixtures and the problem statement. Section III presents the RobustICA-based method in the  frequency domain. In Section IV,  we perform solving  the  ambiguities  in  the  ICA  algorithm  based  on  the frequency domain. The comparative experiments' results and conclusions are given in Section V and Section VI, respectively.

## II. CONVOLUTIVE MIXTURES

A convolutive mixture can be considered a natural extension  of  the  instantaneous  BSS  problem.  Assume  an -dimensional  vector  of  received  discrete  time  signals is to be produced at time from an -dimensional vector of source signals , where , by using a stable mixture model [2]:

1.0

$$\mathbf x ( k ) = \Sigma _ { p = - } ^ { \infty }$$

2.0

$$\text{with } \Sigma _ { - \infty } ^ { \infty } \left \| \mathbf H _ { p } \right \| \leq \infty \text{ \quad \ } ( 1 )$$

where represents the linear convolution operator and is an ( ) matrix of mixing coefficients at time-lag .

## A. Problem Definition

Assume  that  elements denote  the  coefficients  of  the Finite Impulse Response (FIR) filter and is the maximum unknown  channel  length.  Then,  the  noise-free  convolutive model is written as follows:

$$\mathbf x ( k ) = \Sigma _ { p = 0 } ^ { L - 1 } \mathbf H _ { p } \mathbf s ( k - p ) \text{ \quad \ \ } ( 2 )$$

Thus, one can find an approximate inverse channel matrix in order to recover the source signals such that

$$\mathcal { H } _ { q } * \mathbf x ( \mathbf k ) = \sum _ { q = - 0 } ^ { Q - 1 } \mathbf W _ { q } \mathbf x ( \mathbf k - q ) = \hat { \mathbf s } ( \mathbf k ) \quad ( 3 )$$

where is  the  length  of  the  inverse  of  the  channel  impulse response. There are two approaches to solve this problem and recover the source signals.

Time domain approaches have  several  general  drawbacks; for example, should  be  selected  at  least  equal  to  the unknown true  channel .  Therefore,  for  a  long  mixing  filter, which means long transfer functions, the computation will be too expensive [2], [14], [22].  Using the IIR  filter  instead of the long FIR filter to overcome this problem causes increased instability  and  might  require  inversion  of  the  non-minimum phase  filters  [2],  [3],  [22].    Moreover,  time  approaches  are sensitive  to  channel  order  mismatch  [3].  That  said,  time domain  methods  are  suitable  and  very  efficient  for  small mixing filters such as in a communication channel [2], [12].

Because of all these limitations to time domain approaches, we focus our study on frequency domain approaches to solve the BSS problem. The main advantage of a frequency domain BSS approach is the ability to apply the set of any instantaneous  ICA  algorithms  to  solve  the  convolutive  BSS problem. On the other hand, the main challenges of BSS in the frequency  domain  are  permutation  and  scaling  ambiguities. Refer to [1], [3], [22] for a recent survey. However, one can re-map  the  aforementioned  BSS  models  into  the  frequency domain by applying the Discrete Fourier Transform (DFT) on the  observed  signals in  order  to  transform  it  to  the instantaneous mixtures problem as follows:

$$( 4 )$$

where is a frequency index, is a frame index, and .  The  previous  equation  is  considered  to  be  valid only  for  periodic  signals .  However,  it  is  approximately valid  if  the  time-convolution  is  circular.  Therefore,  ensuring that  the  time  convolution  is  circular  [1]  requires  making  the Fourier Transform length significantly larger than the maximum length of the mixing channels [6].  In  [28],  [40], researchers imposed the spectral smoothing approach in order to  mitigate  the  circularity  effect  in  frequency  domain  BSS methods.  In  practice,  to  avoid  the  convergence  into  local minima during the separation processes, one can separate the observed  signal  at  each  frequency  bin.  Thus,  the  sampled observed  signals are sampled  at the discrete time instant using  the  sampling  frequency . Then  one  can transform  the  sampled  signals  into  time-frequency  domain using the short time Fourier transform (STFT) applied to overlapped  samples  of  the  observed  signals.  However, one  can  express  the  time-frequency  of  the mth sensor  at frame as follows

$$\mathbf x ( q, w ) = & \sum _ { n _ { s } } \mathbf x _ { s } ( n _ { s } ) \mathbf w \sin \left ( \frac { n _ { s } - q. \text{shift} } { f _ { s } } \right ) e ^ { - j 2 \pi w \frac { n _ { s } } { f _ { s } } } \quad \text{detect} \\ & \forall \, w = \frac { t } { T } f _ { s } \,, q \in \, [ 0, \dots, T - 1 ] \quad \text{(5)} \quad N \, x \, N \, \mathbf c \quad \text{can be}$$

Where denotes  the  windowing  function,  here,  we usually  use  the  Hanning  window  since  it  is  typically  for acoustic signals. The Hanning window [17] is given by

$$\mathbb { m } = \frac { 1 } { 2 } \left ( 1 + \cos \left ( \frac { z \pi n _ { s } } { T } \right ) \right ) \quad \quad ( 6 )$$

In a real-world scenario, we use the reverberation time to  approximately  define  the  length  of  the  impulse response, since the impulse response functions are theoretically  infinite.      The  reverberation  time is  the required  time  that  reduces  the  energy  of  sounds  into where  the  sound  signal  becomes  no  longer  active  or  'dies away'. Therefore, the convolutive ICA model can be approximated into a series of the instantaneous ICA model as follows:

$$( 7 )$$

Where represents  the  frequency  bin, denotes the time domain  frame,  e.g.  in  a  short  time  frequency  transform, is a column  vector of the observed signals in frequency domain, is  a  column  vector of the original source  signals and is an mixing  matrix  in frequency domain.

For the sake of simplicity, let us assume that the number of source  signals is equal  to  the  number  of  the  observed signals , i.e., . Thus, by applying the ICA algorithm to the at each  frequency  bin,  one  can  recover  the estimated source signals as follows:

$$( 8 )$$

where is  the  demixing  matrix  at frequency  bin. Also, due to the well-known symmetry property of the Fourier Transform, one can simply find demixing matrices ( ) as a  half  of  the  frequency  bins ,  and  then  use  the symmetry property to find the others.

## III. THE PRESENTED METHOD BASED ON THE ROBUSTICA FRAMEWORK

In  this  section,  a  new  strategy  is  proposed,  based  on  the RobustICA  method  of  the  kurtosis  framework.  Here,  one needs  to  first  recall  the  time-frequency  representation  of  the observed vector equation (2),

$$( 1 6 )$$

The  aim  of  this  study  is  to  estimate  the  demixing  matrix from the observed vector under  the  assumption  that  the impulse  response  of  all  mixing  filters  is  assumed  constant during the recording. The estimated source vector is given as the following at each frequency bin:

$$( 1 7 )$$

## A. Step1: Preprocessing (Data Whitening)

In the preprocessing step, the demixing matrices are detected  up  to  a  unitary  matrix using  the  second  order statistic (SOS). This step was used to reduce the noise and to eliminate  redundancy  in  the  data  at  each  frequency  bin.  The covariance matrix ( ) of the noise-free observed signals can be expressed by

$$\frac { \iota } { \xi } - ( 1 8 )$$

By substituting in (16), one gets as follows

$$( 1 9 )$$

By  imposing  Tikhonov  regularization  techniques  [47]  to avoid  the  ill-posed  problem,  where  it  is  well-known  that regularization is an effective way to avoid the ill-conditioned matrix, the equation (19) becomes as follows:

$$( 2 0 )$$

Where is an identity matrix, and (  (       )) it is regularization parameter with is a positive constant and is a trace operator  of the estimation covariance matrix . Note that the regularization method here just adds energy constraint in order to boost the covariance matrix to be a well-conditioned matrix. Therefore, the can be decomposed as

$$( w ) \quad \quad ( 2 1 )$$

where is a matrix satisfying

$$\colon \mathbf I _ { \mathbf N } \, \quad \ \ ( 2 2 )$$

and is  an diagonal  matrix.  So,  from  (22),  the matrix will be

$$( 2 3 )$$

where is  a full  rank  unitary  matrix  and . However, the whitening step obtained matrix so that

the whitened  data  vector has  covariance  of identity matrix , which  can  be  obtained  as follows:

$$\mathfrak { l }, w ) \quad \quad \ \ ( 2 4 ) \quad \mathfrak { k } _ { \mu }$$

$$( 2 5 ) = \frac { 1 } { 2 }$$

The estimated source signals can be recovered with a linear Zero-Forcing (ZF) equalizer.  Then the estimated source vector is

$$\mathfrak { l }, w )$$

After  the  preprocessing  step,  the  estimation  of  the  source signals reduces to determining the unitary matrix (rotation matrix).

## B. Step 2: Determining the rotation matrix (unitary matrix) .

One  way  of  finding  the  rotational  matrix is by maximizing  the  normalized  fourth-order  marginal  cumulant (Kurtosis contrast) of the whitened data in (25). To estimate in  (26),  this  paper  exploits  the  statistical  independence of  the  equalized  source  vector.  More  precisely,  the  unitary matrix will  be  estimated  by  utilizing  the  independent property of the estimated source vector at each frequency bin in  the  normalized  fourth-order  marginal  cumulant of whitened data as follows:

$$\underset { \mu \nu } { \alpha }, w ) = \frac { E [ | y ( q, w ) | ^ { 4 } ] - 2 E ^ { 2 } [ | y ( q, w ) | ^ { 2 } ] - | E [ y ( q, w ) ^ { 2 } ] | ^ { 2 } } { E ^ { 2 } [ | y ( q, w ) | ^ { 2 } ] } \underset { \mu \nu } { \alpha } \quad ( 2 7 )$$

where represents  the  expectation  operator.  Based  on  the deflation  approach  to  ICA  [30],  one  can  estimate  the nth source signal as follows

$$( 2 8 )$$

where represents the conjugate-transpose operator, is  the nth column  vector  of  the  demixing  matrix and is nth source  signal  at  each th frequency  bin  and qth frame  time.  According  to  [1],  [2],  the  column  vector of the demixing matrix can be estimated for all users due to the batch adaptation by a gradient decent method as follows

$$( 2 9 )$$

where denotes  the  iteration  index, is  the nth column vector of the demixing matrix at iteration and is the gradient of the contrast measure that updates the demixing vector in  the  demixing  matrix .  Gradient  function depends  on  the  cost  function  that  ICA  would  maximize /minimize in order to extract the source signal [5]. Herein, this paper  refers  to  the  use  of  the  ICA  techniques  based  on  the kurtosis criterion, which is given in (27), as follows:

$$\eta, w \Big | _ { \begin{array} { c } \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots\\ \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cd.. \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cd: \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cd. \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cd> \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cdots \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd>: \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd< \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd>. \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd>< \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd: \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd>] \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd; \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd... \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd=== \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd} \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cdjs \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd> \\ \cd>$$

Having  the  RobustICA's  search-method  of  the  kurtosis criterion in (30) in order to choose the optimal step size [6] as follows:

$$\ r g _ { \ \mu } ^ { \max } | K ( y ( q, w ) + \mu g ( q, w ) ) | \quad ( 3 1 )$$

where is  the  gradient  of  Kurtosis  contrast .  One  can easily choose the optimal step size based on one of the algebraic methods instead of using the exact line search as in [13], [14] to avoid  the intensive computation  and  other limitations  as  in  [6].  Therefore,  it  is  easy  to  find  the  global optimum step size for the criteria that can be expressed as a  polynomial  function  of due  to  its  roots,  e.g.  the  criteria kurtosis [6], the constant modulus [13] and the constant power [2].  Therefore,  the  RobustICA  performs  an  optimal  step-size of estimating the nth source signal, based on optimization, for lth iteration, th frequency bin, and th frame as follows:

- o Step1) initialize value for the weight vector
- o Step2)  Compute  the  optimal  step  size  polynomial coefficients.  For  Kurtosis  contrast,  the  optimal  step size polynomial is given by

$$\mu _ { \mu } \mu _ { \mu } ^ { n } \mu _ { \mu } ^ { n }$$

where the coefficients can be obtained at each iteration by the observed signal block and the current values of and . Details can be found in [6].

- o Step  3)  Extract  the  optimal  step  size  polynomial root . The  root  can  be  obtained  by  using  the Ferrari's formula as in [48].
- o Step  4)  Select  the  optimal  step  size  polynomial  root as follows

$$\stackrel {. } { g } \stackrel { m a x } { \mu } | K \left ( y _ { n } ^ { l } ( q, w ) + \mu g _ { n } ^ { l } ( q, w ) \right ) | \ ( 3 3 )$$

- o Step 5) Find the updated weighed vector

$$( 3 4 )$$

where is the nth gradient of Kurtosis contrast at lth iteration.

- o Step 6) Normalize and update the weight vector

$$\underset { \ell \,. } { \overset { l + 1 } { n } } = \frac { u _ { n } \nu } { \| u _ { n } ^ { l + 1 } \| } \underset { \ell } { \overset { l + 1 } { n } }$$

where is a norm of .

- o Step 7) Go back to step 2 until the convergence.

To prevent  locking  onto  a  previously  extracted  source,  or when  the  old  and  new  vectors are  in  the  same direction, the learning converges  and  their absolute dotproduct value reaches close to 1. Thus, owning the deflation method proposed in [30] avoids different vectors from converging  at  the  same  maxima.  However,  each  vector  of { } needs  to  be  orthogonalized  before  each iteration.  Based  on  the  Gram-Schmidt  orthogonalization,  the deflation  scheme  estimates  each  independent  component  at each iteration step. Gram-Schmidt orthogonalization of component can be expressed as follows

$$\coloneqq u _ { n + 1 } ^ { l } - \sum _ { n = 1 } ^ { N } \left ( { \boldsymbol u } _ { n + 1 } ^ { l } { \boldsymbol u } _ { n } ^ { l } \right ) { \boldsymbol u } _ { n } ^ { l } \text{ \quad \ \ } ( 3 6 )$$

$$\stackrel { + 1 } { i + 1 } = \frac { u _ { n + 1 } ; \stackrel { \cdot } { i } } { \| u _ { n + 1 } ^ { 1 + 1 } \| }$$

where a new weight vector is obtained by subtracting the vector projected from the old weight vector.

The  following  steps  summarize  the  presented  algorithm procedure:

- o Start
- o Perform the time-frequency representation as in (4).
- o For each frequency bin
- o Pre-processing  of  the  observed  data and imposing  the  Tikhonov  regularization  parameter  to avoid the ill-conditioning problem of the covariance matrix and to mitigate the performance degradation.

(38) where is  a  positive  constant  and represents the  trace  of  the  estimation  covariance  matrix  of  the observation signals.

- o Initialize matrix (equals identify matrix ), where N is the number of sources.
- o For each user
- o Initialize column vector of the  demixing matrix
- o While loop
- o Evaluate in (13)
- o Select  the  optimal  step  size  polynomial  root in (33)
- o Update weighed vector in (34)
- o Do the  orthogonalization  and  normalization  in  (36) and (37), respectively
- o Find nth users:

$$( 3 9 )$$

- o Do deflation by subtracting the estimated nth source contribution to the as follows [30]:

(40)

Where is  the  symbol  direction  estimated  via  least squares, and it is given by

$$( 4 1 )$$

- o Check the convergence point. if so, End while loop , otherwise, go back until the convergence.
- o Save in the .
- o End for loop

.

- o Save the demixing matrix
- o End loop .

## IV. SCALING AND PERMUTATION AMBIGUITIES

Assume is  the  rotational  matrix  that  is  computed  at each  bin.  The  least  square  estimation  of  the  mixing  matrix is given by

$$( 4 2 )$$

where

$$( 4 3 )$$

However,  one  can  express  the  estimated  mixing  matrix in terms  of  the  perfect mixing  matrix as follows:

$$( 4 4 )$$

where is  an  unknown  diagonal  matrix  and is  an unknown permutation matrix. Therefore, we have to estimate and matrices to solve the scaling and permutation ambiguities.

## A. Estimation of the diagonal matrix

Several  methods  to  compensate  the  scale  ambiguity  have been proposed in the literature.  Thus,  we  choose  to  estimate the diagonal matrix using the minimal distortion principle [3], [22]. The is given in [3] as

$$( 4 5 )$$

(46) where is a matrix in which all its entries are / , and where is  the  number of observations whereas is  the number of sources, and returns a matrix that contains the  diagonal  elements  of  matrix and  sets  the  other  nondiagonal elements of matrix zeros.

The interpretation of (46), in a sense of perfect separation, is that each estimated source averages along the sensors in the sense of all other sources have turned off. In other words, the Minimal  Distortion  Principle  assumes  that  the nth source  is scaled  with respect to the image at the  nth  microphone [40]. Therefore,  the  rescaled  source  signals  can  be  expressed  as follows:

$$( 4 7 )$$

$$( 4 8 )$$

## B. Estimation of the permutation matrix

Despite the fact that this section estimates the permutation matrix proposed in several current works in the literature, estimating the permutation matrix is still considered a very challenging problem  that needs  to be addressed. Assume that we have source signals which are presented in the BSS problem; then there are factorial times the possible permutations at each bin, which yields a complex combinational problem.

There are several previously mentioned techniques used to solve  the  permutation  problem  in  the  literature  [3],  [22].  In this  paper,  we  will  review  and  evaluate  them  in  terms  of computational complexity and performance.

One  can  divide  these  methods  into  two  main  solution groups, which solve the permutation ambiguity in the frequency domain as follows:

-  Group based on geometric information, such as Time Direction of Arrivals (TDOA) and Direction of Arrivals (DOA) [3], [21], [22], [40].
-  Group based on clustering-based techniques [22], [31], [32], [35].

Many of these techniques are based on geometric information,  such  as  estimation  of  the  direction  of  arrival (DOA)  and  Time  difference  of  Arrival  (TDOA)  as  in  [22], [27].    Other  techniques  depend  on  the  coherence  of  the  unmixing  filter  coefficients.  In  other  words,  these  techniques take advantage of some prior knowledge about mixing filters and  restrict  the  mixing  matrix to  be  continuous  in frequency domain. Furthermore, in [34], Parra imposes smoothness  to  the  de-mixing  filter  values  in  the  frequency domain. Also, a restriction is made with the frequency domain update rule so that it is associated with the limited length filter in the time domain. Such a restriction may not be considered sophisticated, especially in a case of reverberant environment, since  it  is  necessary  to  have  a  long  length  filter  to  cover  all reverberations. Although it can be avoided by choosing a large frame size, it still causes more overall complexity, especially, when  the short mixtures are available. In terms of the properties  of  speech,  there  are  other  categories,  which  have been proposed in literature, to estimate the permutation matrix and make the spectral alignment.

The most common is based on the inter-frequency correlation of speech envelopes [33], [36]. The inter-frequency correlation technique exploits the nature of speech production, where  it's  known  that  all  spectral  components  of  speech signals  increase  as  the  talker  speaks  louder.  In  that  sense, several  weighted  techniques  and  criteria  have  been  proposed to impose the frequency-coupling between the adjacent frequency bins. For more details, see [3], [22]. Although these techniques  perform  well  in  the  simulations,  they  are  not sophisticated when they are applied to a real recording room. They suffer from propagation error or delays. For example, if an error occurs at a certain frequency bin, it may increase the possibility that it  will occur again at the following frequency bins.  Therefore,  in  the  literature  [3],  [22],  [32],  researchers avoid propagation error by estimating a frequencyindependent reference profile, which is called a centroid, due to using a clustering-based method for each separated source. They then structure the frequency-dependent profiles such that they are all matched with a different frequencyindependent reference profile at each frequency bin.

The main steps of the clustering-based techniques are as follows:

-  Define the quantities that are used in the clustering, such  as  the  signal  envelopes  of  the  source  profiles, the log-power of the source profiles, etc.
-  Choose  the  measure  that  is  used  to  determine  the matching level between the centroids and the profiles, such as correlation, distance, etc.
-  Choose the cluster technique.

In [21], [28], the profile of a separated signal is chosen  as  the  envelope  of  the  separated  source where |        | .  In  [22],  Authors  are  chosen  for  the profile of  a  separated  signal to  be  a  certain dominance measure. Whereas, in [38], the profile of a  separated  signal is  defined  to  be  its  centered  log-power spectral density where  the  log-power  profile  is  given  as follows:

$$\Psi _ { n } ( q, w ) = \log \left [ U _ { n, \colon } ( w ) \mathbf R _ { x x } ( q, w ) U _ { n, \colon } ^ { H } ( w ) \right ] \quad ( 4 9 ) \quad f o l l o w \cdot$$

In clustering-based approaches, the length of the profiles is also an important parameter in terms of accuracy, especially for short signals. This work is essentially going to set up the profiles  for  the  overlapping  frames  over  the  whole  signal. Once we construct the profiles of the separated signals, then we compute the centroids in  order to perform the clustering. The  clustering-based  technique  is  essentially  based  on  the assumption  that  profiles  coming  from  the  same  source  at different frequency bins still have more match level than those coming  from  other  sources.  Actually, the most  common methods to associate each source profile to a centroid at each frequency bin are based on 1) maximizing correlation measures  [69],  [70]  and  2)  minimizing  distance  measures across  the factorial  times  of  the  possible  permutations  at each frequency bin [38]. However, authors employ the iterative techniques to update the centroids and the permutation matrices. In other words, they update the centroids  first,  and  then  they  permute  the  source  profiles  to each  desired  centroid  and  match  them  together  using  one  of the two previous measures, i.e. distance [38] or correlation in [21], [28] and [31].

In spite of the fact that the aforementioned iterative methods perform well, they tend to be significantly more expensive in terms  of  cost  and  computational  complexity  since  they  have the factorial  times  of  the  possible  permutations  at  each frequency bin. To avoid this drawback in the aforementioned iterative methods in [32], Nion et al. propose a more efficient modification of the clustering strategy, which is updating the whole permutation  matrices and centroids simultaneously.  In other  words,  the  update  of  the  centroids  and  permutation matrices  are  not  interleaved.  Thus,  their  modification  has improved  these  iterative  methods  in  terms  of  computational complexity.

Their methods can be summarized as follows:

Step 1. Determine the centroids and compute them.

Consider the matrix that is structured from the profiles .  One  can  extend  the matrix to the matrix by concatenating the matrices . In order  to  enforce  the profile points in matrix varying smoothly with time, we have to encounter the computation of the profiles for overlapping  frames.  Hereafter,  we  just  need  to  classify  these profile  points  into clusters  due  to  applying  the  k-mean algorithm on the matrix to carry out a frequency-independent centroid matrix [ ] . The centroid matrix is structured by summing all the points within a cluster, which have attained a minimum distance regarding the centroid cluster.

## Step 2. Estimate the permutation matrices.

In the previous step, we reduced the computational processes  to  find  that  the permutation  matrix , subject to , matches  the  frequency-independent centroid matrix at each frequency bin. Therefore, one can  choose  to  minimize  the  distance  that  is  given  in  [38]  as follows

$$( 5 0 )$$

Or one can chose the correlation criteria that is given by [21],

[22] [31] as follows

∑ 〈                  〉 (51) where 〈    〉 is the correlation coefficient.

In  terms  of  performance,  the  first  group  generally  does better  than  the  second  group,  especially  at  the  small  data sample  available.  But  it  is  not  optimal  in  a  practical  sense, since  we don't  usually  have  geometric information about the real environmental conditions. In that sense, the second group performed better than first group, especially if we have a large sample set of data, because they are based on the clusteringbased techniques (i.e.: correlation, distance, etc.) and they are more robust to real-world scenarios. For more details, refer to [3] [22].

## V. EXPERIMENTS' RESULTS

In this section, Monte Carlo Simulations are carried out. It

is assumed that the number of sources is equal to the number of  observation  'sensors'. The experiments  have been carried out using the MATLAB software on an Intel Core i5 CPU 2.4GHz processor and 4G MB  RAM. We examine the performance of the RobustICA-based algorithm developed in this paper. The time-frequency representation of the observed data is computed as explained in section II due to the ShortTime-Fourier-Transform.  Then,  for  each  frequency  bin,  we find the demixing matrix.We will solve the scale and permutation ambiguities based on the aforementioned techniques.

To  help  explain  this  process,  we  divided  this  section  into two  subsections.  First,  we  illustrate  the  performance  of  the RobustICA-based algorithm with different permutation methods in the literature [3], [22]. We study the effect of the type  of  the  windows  on  the  performance  of  the  presented algorithm  as  well  as  the  effect  of  overlapping  parameter. Second, we provide the performance of the presented algorithm  in  two  real-world  scenarios  that  are  generated  in adverse conditions by F. Nesta, in [40], and compare it with other state-of-the-arts in [40], [20], and [34] and [38], labeled as  'RR-ICA',  'IVA',  'Parra',  and  'Pham',  respectively.  In this  paper,  we  evaluate  the  performance  of  the  presented algorithm due to the BSS\_EVAL toolbox, which is proposed in [49]. We use time-invariant filters of 1024 taps to represent the  signal-to-interference  ratio  (SIR)  and  source-to-distortion ratio (SDR).

## A. Section 1

In  this  subsection,  we  study  the  computational  complexity and  the  performance  of  the  presented  algorithm  based  on several criteria to solve the scale and permutation ambiguities in the frequency domain BSS problem.

Let's define these criteria as follows:

-  Method  1  is  the  RobustICA-based  algorithm  with clustering of envelope profiles with a distance measure iterative procedure [22], [31].
-  Method  2  is  the  RobustICA-based  algorithm  with clustering  of  log-power  profiles  with  a  correlation measure iterative procedure [22], [50].
-  Method  3  is  the  RobustICA-based  algorithm  with clustering of envelope profiles with a distance measure kmeans procedure [35], [32].
-  Method  4  is  the  RobustICA-based  algorithm  with clustering  of  log-power  profiles  with  a  correlation measure kmeans procedure [22], [32].
-  Method  5  is  the  RobustICA-based  algorithm  with clustering  of  dominance-profiles  with  a  correlation measure iterative procedure [22].
-  Method6  is the RobustICA-based  algorithm  with clustering  of  dominance-profiles  with  a  correlation measure iterative kmeans procedure [22], [32].

Fig. 1. Configuration of the two experimental setups that were conducted by Francesco Nesta1 in [40]:, a) room is characterized for Test1, b) classroom is characterized for Test2

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-9d7a4ff3-b54d-4a92-9e8d-6b1f669cc136.jpg)

In  this  section,  we  have  used  real  world  recordings,  drawn from  the  experiments  which  were  conducted  in  [40]  named Test1. We would like to thank the authors who provided these recordings on their website 'http://bssnesta.webatu.com/testhscma.html'. The two sources were recorded at with  two  microphones  spaced apart  to  avoid  spatial  aliasing.  The  chosen  room was characterized by a moderate reverberant time of . The room had dimensions of as shown in Fig. 1. The signal duration was fixed at 9 sec.

Fig. 2. Results obtained in Test1 experiments. The SIR performance of the presented algorithm with various permutation solvers

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-0f775634-ed81-4c9d-bc5a-3b2f4cc3813b.jpg)

In fig. 2 and  fig.3, we  show  the  performance  of  the RobustICA-based algorithm with various aforementioned techniques  of  permutation  solvers  in  terms  of  the  SIR  and SDR,  respectively. In comparison, we notice that the dominance-profiles  provide  more  robustness  in  terms  of  the signal's length, although the envelope  profiles are more sensitive  to  the  signal's  length  than  the  log-power  profiles. Moreover, the dominance-profiles' approach with the iterative procedure  has  the  same  performance  as  with  the  kmean procedure. Also, Fig.4 shows the corresponding CPU time of each  permutation  method  that  need  to  solve  the  permutation ambiguity.

Fig. 3. Results obtained in Test1 experiments. The SDR performance of the presented algorithm with various permutation solvers

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-a98bc907-eaca-4737-b9b5-57b79defb7f6.jpg)

Based on these observations, we use the dominance-profiles approach with  the  iterative  procedure  after  the  RobustICAbased algorithm in the rest of these experiments. In Fig. 5, we illustrate the impact of the window's types on the performance of the proposed algorithm in terms of SIR and SDR respectively.  And,  we  test  the  performance  of  the  presented algorithm versus the overlapping parameter as shown in Fig 6.

The  best  performance  of the presented algorithm was achieved during the certain range of the overlapping percentage. Therefore, based on these results, we use the 0.65 overlapping parameters with Hamming window type .

Fig. 4. Corresponding CPU time for each method.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-c4bfe733-50cc-41bf-b857-8b4b9f61c480.jpg)

Fig. 5. Results obtained in Test2 experiments. The SIR performance of the presented algorithm with various window types

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-016156ab-3938-4f02-88d5-bb5425639ab9.jpg)

## B. Section 2

In this section, we  perform  the  separation  of  the  two mixture  observations  that  consist  of  two  sources.  We  have used  the  two  tests 'Test1  and  Test2'  of  the  real  world recordings,  drawn  from the experiments  that  were conducted in  [40]  (see  Fig.  1).  Test2  uses  the  real  world  recordings  of adverse  reverberant  conditions,  as  in  Fig  1.  The  room  is  a reverberant class-room with dimensions 4.75 m Length x 5.92 m Width x 4.5 m Height . The reverberation time is around 700 milliseconds .  The  signal  duration  was  fixed  to be  9  sec.  After  we  got  the  demixing  matrix for  each frequency  bin,  we  used  the  Inverse  Fourier  Transform  to obtain the mixing matrix in the time domain.

-  The independent vector analysis IVA [14] used with step size 0.1 and number of iterations is 1000.
-  Parra's method [34], used with number of iterations is 1000.
-  Pham's  algorithm  [35]  and  [38],  used  with  FFT overlapping, equals and a window size equal to 5.
-  RR-ICA algorithm reported in [40].

Fig. 6. Results obtained in Test2 experiments. The SIR performance of the presented algorithm with various overlap ratios

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-99b3ee51-e593-42da-8673-e958b376c70e.jpg)

Fig. 7. Results obtained in the Test1 experiments. Best performance is reported in terms of SIR, by applying the given algorithms with different signal lengths

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-825a1646-6225-439e-b260-583c1d081e59.jpg)

Fig 7 &amp; 8 and 9 &amp; 10, show the summary analysis of the presented algorithm versus other algorithms for the Test1 and Test2  configurations,  respectively.  These  graphs  report  the best performance  of each algorithm over the FFT  size. Obviously,  the  RobustICA-based  algorithm  outperforms  the other  algorithms  for  any  signal  length  in  terms  of  SIR  and SDR.

Moreover, in  Fig.  11,  we  illustrate  the  impact  of  the  FFT length on the performance of the proposed algorithm in terms of SIR. Clearly, the presented algorithm performs well, especially  during  reasonable  FFT  length  in  regard  to  other corresponding algorithms as shown in Fig.11.

Based  on  these  results,  one  can  show  that  the  presented algorithm is stable in terms of the high reverberation environment  and  variations  of  the  observations'  parameters. Furthermore, the presented algorithm performs  well in terms of  stability  and  speed  convergence. Owning  the optimal step size, deflation and regularization techniques makes the presented algorithm more robust and allows it to perform well even in adverse conditions.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-fb14fe4a-e07d-4ebe-bd31-a44be5b2f488.jpg)

Fig. 8. Results obtained in the Test1 experiments. Best performance is reported in terms of SDR, by applying the given algorithms with different signal lengths

Fig. 9. Results obtained in the Test2 experiments. Best performance is reported in terms of SIR, by applying the given algorithms with different signal lengths

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-0006b407-7e72-44c6-a98b-b7dbc825eff9.jpg)

Fig. 10. Results obtained in the Test2 experiments. Best performance is reported in terms of SDR, by applying the given algorithms with different signal lengths

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-d5c285ad-d8d6-4fa0-81cf-50e2e9a3171c.jpg)

## VI. CONCLUSION

This  paper  presented  the  RobustICA-based  algorithm  to solve  the  frequency-domain  BSS  problem  for  convolutive acoustic  mixtures  in  several  adverse  conditions.  Through  the real-world experiments, we  show the superiority of the presented  algorithm  among  other  popular  algorithms  in  the literature in terms of the performance and complexity computation.  Moreover,  we  compared  several  permutation solvers in terms of computation complexity and performance to  provide  the  RobustICA-based  algorithm  with  an  efficient frequency-dependent permutation scheme. Finally, we studied the effect of several parameters on the separation performance of the presented algorithm. We also presented the effect of the type of the window on the separation performance and we also showed  that  the  performance  improves  at  a  certain  range  of overlapping  between  the  signals.    Lastly,  in  this  paper,  we showed the performance of a system that can work efficiently with around 0.5-10 seconds of input data, which is close to the real-time implementation. Accordingly, the presented algorithm is optimized to be suitable for the real-time operation.  As  a  result,  it  is  suitable  for  a  large  number  of applications to ensure the real-time implementation.

Fig. 11. Impact of FFT length, 2-by-2 case, Results obtained in the Test2 experiments.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1408.0193v1-figure-c957cc54-fa0d-4e35-926b-34159278a5b8.jpg)

## REFERENCES

- [1] P.  Comon,  C.  Jutten  (eds.),  'Handbook  of  Blind  Source  Separation Independent Component Analysis and Applications.' (Academic Press, Oxford, 2010).
- [2] A. Cichocki, S.-I. Amari, Adaptive Blind Signal and Image Processing : Learning Algorithms and Applications, John Wiley &amp; Sons, Inc., 2002.
- [3] M.  S.  Pedersen,  J.  Larsen,  U.  Kjems,  and  L.  C.  Parra,  'A  survey  of convolutive blind source separation methods,' in Springer Handbook of Speech Processing. New York: Springer, 2007.
- [4] A.  Cichocki,  R.  Zdunek,  S.-I.  Amari,  Nonnegative  matrix  and  tensor factorizations: applications to exploratory multi-way analysis and Blind Source Separation, John Wiley &amp; Sons, Inc., 2009.
- [5] P. COMON, ``Independent Component Analysis, a new concept,'' Signal Processing,  Elsevier,  36(3):287--314,  April  1994PDF  Special  issue  on Higher-Order Statistics.
- [6] V.  Zarzoso  and  P.  Comon,  'Robust  Independent  Component  Analysis by  Iterative  Maximization  of  the  Kurtosis  Contrast  with  Algebraic Optimal Step Size,' IEEE Transactions on Neural Networks, vol. 21, no. 2, pp. 248-261, 2010.
- [7] Hyvarinen.  A,  "Fast  and  robust  fixed-point  algorithm  for  independent component  analysis".  IEEE  Transactions  on  Neural  Network,  vol.  10, no. 3, pp. 626-634, May 1999.
- [8] Hyvarinen.  A.  E.Oja,  "A  fast  fixed-point  algorithm  for  independent component analysis,' Neural Computation, vol. 9, no. 7, pp. 1483-1492, 1997.
- [9] F. Cardoso. On  the performance  of orthogonal source separation algorithms. In Proc. EUSIPCO, pages 776-779, 1994a.
- [10] Jean-François Cardoso, 'High-order contrasts for independent component analysis,' Neural Computation, vol. 11, no 1, pp. 157-192, Jan. 1999.
- [11] A.  Bell,  T.  J.  Sejnowski,  'An  information-maximization  approach  to blind separation and blind deconvolution', Neural Computation, 7:11291159, 1995.
- [12] K. Waheed  and  F. Salem, 'Blind information-theoretic multiuser detection algorithms for DS-CDMA and WCDMA downlink systems,' IEEE Trans. Neural Netw., vol. 16, no. 4, pp. 937-948, Jul. 2005.
- [13] A.-J.  van  der  Veen  and  A.  Paulraj,  'An  analytical  constant  modulus algorithm,' IEEE Trans. Signal Process., vol. 44, pp. 1136- 1155, 1996.
- [14] D. T. Pham and P. Garat, 'Blind separation of mixture of independent sources  through  a  quasi-maximum  likelihood  approach,'  IEEE  Trans. Signal Process, vol. 45, no. 7, pp. 1712-1725, Jul. 1997.
- [15] B. A. Pearlmutter and L. C. Parra, 'Maximum likelihood blind source separation: A context-sensitive generalization of ICA,' Adv. Neural Inf. Process. Syst., pp. 613-619, Dec. 1996.
- [16] Fujisawa, H. and Eguchi, S. (2008). Robust parameter estimation with a small bias against heavy contamination. J. Multivariate Anal. 99 20532081.
- [17] S.C.Douglas, X.Sun, "Convolutive blind separation of speech mixtures using the natural gradient," Speech commun, vol. 39. pp. 65-78, (2002).
- [18] Yoshioka, Takuya Nakatani, Tomohiro Miyoshi, Masato Okuno, Hiroshi G. "Blind Separation and Dereverberation of Speech Mixtures by Joint Optimization,'  IEEE  Transactions  on  Audio  Speech  and  Language Processing, Volume. 19, Issue. 1, pp. 69, 2011.
- [19] A.  Cichocki,  R.  Zdunek,  S.  Amari,  G.  Hori  and  K.  Umeno,  'Blind Signal Separation Method and System Using Modular and HierarchicalMultilayer Processing for Blind Multidimensional Decomposition, Identification,  Separation  or  Extraction,'  Patent  pending,  No.  2006124167, RIKEN, Japan, March 2006.
- [20] Intae Lee,  Taesu Kim,  and Te-Won Lee. Independent vector analysis for  convolutive  blind  speech  separation.  In  Blind  Speech  Separation. Springer, September 2007.
- [21] Solvang, Hiroko Kato Nagahara, Yuichi Araki, Shoko Sawada, Hiroshi Makino,  Shoji  "Frequency-Domain  Pearson  Distribution  Approach  for Independent  Component  Analysis  (FD-Pearson-ICA)  in  Blind  Source Separation,' IEEE Transactions on Audio Speech and Language Processing, Volume 17, Issue. 4, pp. 639, 2009.
- [22] H.  Sawada,  S.  Araki,  and  S.  Makino.  Frequency-domain  blind  source separation.  In Blind Speech Separation. Springer, September 2007.
- [23] Saruwatari, H. Kawamura, T. Nishikawa, T. Lee, A. Shikano, K. "Blind source separation based on a fast-convergence algorithm combining ICA and beamforming,' IEEE Transactions on Audio Speech and Language Processing, Volume 14, Issue 2, pp. 666, 2006.
- [24] Low, S.Y. Nordholm, S. Togneri, R. "Convolutive Blind Signal Separation  With  Post-Processing,'  IEEE  Transactions  on  Speech  and Audio Processing, Volume 12, Issue 5, pp. 539, 2004.
- [25] F. Nest,  P.  Svaizer  and  M.  Omologo  'Convolutive  BSS  of  short mixturesby ICA recursively regularized across frequencies", IEEETrans. Audio, Speech, Lang. Process.,  vol. 19,  no. 3,  pp.624 -639 2011
- [26] S.  C.  Douglas  and  M.  Gupta   "Scaled  natural  gradient  algorithms  for instantaneous and convolutive blind source separation", Proc. ICASSP,  vol. II,  pp.637 -640 2007
- [27] T.  S.  Wada  and  B.-H.  Juang   "Acoustic  echo  cancellation  based  on independent component analysis and integrated residual echo enhancement",  Proc. WASPAA,  pp.205 -208 2009
- [28] H.  Sawada ,  S.  Araki  ,  R.  Mukai and  S. Makino   "Blind  extraction  of dominant target sources using ICA and time-frequency masking",  IEEE Trans.  Audio,  Speech,  Lang.  Process.,   vol.  14,   no.  6,   pp.2165  -2173 2006
- [29] S. Araki , S. Makino , T. Nishikawa and H. Saruwatari  "Fundamental limitation of frequency domain blind source separation for convolutive mixture of speech",  Proc. ICASSP,  pp.2737 -2740 2001
- [30] E.  Ollila  "The  deflation-based  fastICA  estimator:  Statistical  analysis revisited",  IEEE  Trans.  Signal  Process.,  vol.  58,  no.  3,  pp.1527  -1541 2010
- [31] H. Sawada, R. Mukai, S. Araki, and S. Makino, 'A robust and precise method for solving the permutation problem of frequency-domainblind source separation,' IEEE Trans. Speech Audio Process., vol. 12, no. 5, pp. 530-538, Sep. 2004.
- [32] D. Nion , K. N. Mokios , N. D. Sidiropoulos and A. Potamianos  "Batch and adaptive PARAFAC-based blind separation of convolutive speech mixtures",   IEEE  Trans.  Audio,  Speech  Lang.  Process.,   vol.  18,   no. 6,  pp.1193 -1207 2010
- [33] K.  Rahbar  and  J.-P.  Reilly   "A  frequency  domain  method  for  blind source separation of convolutive audio mixtures",  IEEE Trans. Speech Audio Process.,  vol. 13,  no. 5,  pp.832 -844 2005  [online] Available: http://www.ece.mcmaster.ca/~reilly/kamran/id18.htm
- [34] L. Parra and C. Spence  "Convolutive blind separation of non-stationary sources",  IEEE Trans. Speech Audio Process.,  vol. 8,  no. 3,  pp.320 327 2000 [online] Available: http://ida.first.fhg.de/~harmeli/download/download\_convbss.html
- [35] C. Serviegrave;re and D.-T. Pham 'Permutation correction in the frequency domain in blind separation of speech mixtures",  EURASIP J. Appl. Signal Process.,  no. 1,  pp.1 -16 2006
- [36] N. Mitianoudis and M. Davies'Audio source separation of convolutive mixtures", IEEE Trans. Speech Audio Process., vol. 11,  no. 5,  pp.489 497 2003
- [37] A.  Westner  and  J.  V.  M.  Bove 'Blind  separation  of  real  world  audio signals using overdetermined mixtures", Proc. ICA\'99,  1999  [online] Available: http://sound.media.mit.edu/ica-bench
- [38] D.-T. Pham, C. Servi&amp;egrave;re and H. Boumaraf  "Blind separation of convolutive audio mixtures using nonstationarity",  Proc. Int. Workshop Indep. Compon. Anal. Blind Signal Separation (ICA\'03),  pp.981 -986 2003

- [39] F.  Nesta,  'Techniques  for  robust  source  separation  and  localization  in adverse environment', PhD thesis, University of Trento, April, 2010.
- [40] F.  Nesta  ,  P.  Svaizer  and  M.  Omologo    "Convolutive  BSS  of  short mixturesby ICA recursively regularized across frequencies", IEEETrans. Audio, Speech, Lang. Process.,  vol. 19,  no. 3,  pp.624 -639 2011 http://bssnesta.webatu.com/testhscma.html
- [41] Herbert Buchner, Robert Aichner, and Walter Kellermann. TRINICON:    A  versatile  framework  for  multichannel  blind  signal processing.          In  Proceedings  of  IEEE  International  Conference  on Acoustics,  Speech  and  Signal  Processing,  volume  3,  pages  889-892, Montreal, Canada, May 17-21 2004.
- [42] Robert Aichner, Herbert Buchner, Fei Yan, and Walter Kellermann.  A real-time blind source separation scheme and its application to reverberant and noisy acoustic environments. Signal Process. 86(6):1260-1277, 2006.
- [43] Z. Koldovsky  and  P.  Tichavsky.  Time-domain  blind  audio  source separation using advanced component clustering and reconstruction.  In Proceedings of HSCMA, Trento, Italy, May 2008.
- [44] J.-T.  Chien  and  H.-L.  Hsieh  'Nonstationary  source  separation  using sequential and variational Bayesian learning", IEEE Trans. Neural Netw. Learn, Syst.,  vol. 24,  no. 5,  pp.681 -694 2013
- [45] E.  Vincent,  S.  Araki,  and  P.  Bofill. The  2008  signal  separation evaluation campaign: A  community-based  approach  to large-scale evaluation. In ICA '09: Proceedings of the 8th International Conference on Independent Component Analysis and Signal Separation, pages 734741, Berlin, Heidelberg, 2009. Springer-Verlag.
- [46] Takahashi, Yu. Saruwatari, H., Shikano, K., "Real-time implementation of  blind  spatial  subtraction  array  for  hands-free  robot  spoken  dialogue system,'  Intelligent Robots and Systems, 2008. IROS 2008. IEEE/RSJ International Conference on, On page(s): 1687-1692.
- [47] V.  V.  Vasin,  'Some  tendencies  in  the  Tikhonov  regularization  of  illposed problems,' J. Inverse and Ill-Posed Problems, vol. 14, no. 8, pp. 813-840, Dec. 2006.
- [48] W.  H.  Press,  S.  A.  Teukolsky,  W.  T.  Vetterling,  and  B.  P.  Flannery, Numerical  Recipes  in  C. The  Art  of Scientific Computing,  2nd. Cambridge, UK: Cambridge University Press, 1992.
- [49] E. Vincent, C. Fevotte, and R. Gribonval. Performance measurement in blind audio source separation. IEEE Trans. Audio, Speech and Language Processing, 14(4):1462-1469, 2006.
- [50] M. Zibulevsky, 'Blind source separation with relative Newton method,' in Proc. ICA 2003, 2003, pp. 897-902.
Zaid Albataineh Fathi M. Salem
A RobustICA Based Algorithm for Blind Separation of Convolutive Mixtures
We propose a frequency domain method based on robust independent component
analysis (RICA) to address the multichannel Blind Source Separation (BSS)
problem of convolutive speech mixtures in highly reverberant environments. We
impose regularization processes to tackle the ill-conditioning problem of the
covariance matrix and to mitigate the performance degradation in the frequency
domain. We apply an algorithm to separate the source signals in adverse
conditions, i.e. high reverberation conditions when short observation signals
are available. Furthermore, we study the impact of several parameters on the
performance of separation, e.g. overlapping ratio and window type of the
frequency domain method. We also compare different techniques to solve the
frequency-domain permutation ambiguity. Through simulations and real world
experiments, we verify the superiority of the presented convolutive algorithm
among other BSS algorithms, including recursive regularized ICA (RR ICA),
independent vector analysis (IVA).