NI Jin-gen(倪錦根)
(School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China)
?
Subband adaptive filter with variable reusing order of coefficient vectors
NI Jin-gen(倪錦根)
(School of Electronic and Information Engineering, Soochow University, Suzhou 215006, China)
To increase the convergence rate of the improved normalized subband adaptive filter, a simple but effective method is presented to change the reusing order of coefficient vectors of the adaptive filter. At the beginning of adaptation the algorithm just uses its current coefficient vector to update the adaptive filter to maintain fast convergence rate, while in steady state it employs several most recent coefficient vectors to update the adaptive filter to reduce misalignment. Simulation results show that the proposed algorithm can obtain both fast convergence rate and small steady-state misalignment.
adaptive filtering; subband adaptive filter; reusing coefficient vector; misalignment
Subband adaptive filtering algorithms can increase convergence rate for correlated input signals and/or reduce computational cost as compared to the well-known least-mean-square (LMS) and normalized LMS (NLMS) algorithms. Due to these advantages, subband adaptive filters (SAFs) have been widely used in system identification, network and acoustic echo cancellation, active noise control, and so on[1]. In the conventional SAF[2], each subband uses an individual adaptive sub-filter in its own adaptation loop, and thus their convergence rate is decreased by aliasing and band-edge effects[3]. This SAF aims to obtain low computational cost.
To address the problem of aliasing and band-edge effects in the conventional SAF, two weighted SAFs have been proposed from different points of view in Ref. [4] and Ref. [5], respectively. Based on the principle of minimum disturbance, Lee and Gan proposed a new SAF, called the normalized SAF (NSAF)[6], which can be viewed as a subband generalization of the NLMS. Its central idea is to employ the subband input signals, normalized by their respective subband input variances, to update the coefficient vectors of the adaptive filter. If the normalization term in theith subband, i.e., the squaredl2-norm of theith subband input vector, is replaced by the power of theith subband input vector, then the update equation of the NSAF coincides with the two weighted SAFs[7].
Similar to the NLMS, however, if the step-size (regularization parameter) of the NSAF is set to a large (small) value to obtain fast convergence rate, its steady-state misalignment is large[8]. Inspired by the NLMS with reusing coefficient vectors (NLMS-RC)[9], an improved NSAF (INSAF) has been proposed in Refs.[10-11] to reduce steady-state misalignment, which is derived by minimizing the sum of the squaredl2-norms of the differences between the updated coefficient vector and the past coefficient vectors, subject to constraints on the updated coefficient vector. It has been shown that the steady-state misalignment of the INSAF can be largely reduced, but its convergence rate decreases as the reusing order of coefficient vectors increases.
In this paper, a method for the INSAF to change the reusing order of coefficient vectors to address the above problem is presented. The concept of changing the reusing order of coefficient vectors was first proposed for the NLMS with reusing coefficient vector (NLMS-RC) in Ref. [12]. The proposed method in this paper is different from that one. Simulation results show that the proposed algorithm can obtain both fast convergence rate and small steady-state misalignment.
1.1 Signal model
Fig.1 Structure of the NSAF and INSAF
Consider the desired response which arises from the modeld(n)=uT(n)wo+η(n),wherenisthetimeindex, (·)Tstandsfortransposition,u(n)=[u(n),u(n-1),…,u(n-M+1)]TrepresentstheinputvectoroflengthM,whichconsistsoftheMmostrecentinputsamples,wodenotesthecoefficientvectoroftheunknownsystemWo(z),andη(n)isthesystemnoisewhichisusuallyassumedtobezero-meanandindependentandidenticaldistributed.
1.2INSAF
(1)
subject to
(2)
whereRis the reusing order of coefficient vectors. Using the method of Lagrange multipliers, we can obtain the update equation of the INSAF
(3)
whereμisthestep-size, δistheregularizationparameter,and
(4)
IfRis set to 1, then Eq.(3) reduces to the classical NSAF in Ref. [6].
2.1 Derivation of the proposed algorithm
As presented earlier, the steady-state misalignment of the INSAF decreases, but its convergence rate also decreases, as the reusing order of coefficientvectors increases. If the filter is expected to obtain both fast convergence and small steady-state misalignment, a reasonable method is to change the reusing order of coefficient vectors of the adaptive filter according to the adaptation phase. At the beginning of adaptation, the adaptive filter just uses the current coefficient vector to maintain fast convergence rate, while in steady state the adaptive filter uses several most recent coefficient vectors to reduce misalignment. To this end, we modify Eq.(3) and Eq.(4), respectively, as
(5)
and
(6)
Itisknownthatthemeansquareerror(MSE)canbeusedtoindicatetheadaptationphase.Thesteady-stateexcessMSE(EMSE)oftheINSAFwithR=1 (i.e., NSAF) can be written as[13]
(7)
(8)
WhentheMSEreachitssteady-statevalueJss(k), the filter operates in steady state. According to the statement at the beginning of this subsection, we set the reusing order of coefficient vectors to
(9)
(10)
and
(11)
(12)
(13)
ri(k)=λri(k-1)+(1-λ)ui(k)ei,D(k)
(14)
and
(15)
BycomparingtheproposedINSAFwithvariablereusingorderofcoefficientvectors(INSAF-VRC)totheNLMS-RCwithvariablereusingorderofcoefficientvectors(NLMS-VRC)inRef. [12],itcanbeseenthatthemethodsforvaryingthereusingorderaredifferentfromeachother.First,theNLMS-VRCvariesthereusingorderintherangebetween1andthemaximumreusingorder,whiletheINSAF-VRCjustswitchesitbetween1andthemaximumreusingorder,whichcanreducetheimplementationcomplexity.Second,theNLMS-VRCdeterminesthereusingorderbycomparingtheerrorsignaltothesteady-stateMSE,whiletheINSAF-VRCdeterminesitbycomparingthepoweroftheerrorsignaltothesteady-stateMSE,whichavoidstheeffectoferrorsignalfluctuationswhendeterminingthereusingorder.Third,theNLMS-VRCassumesthesystemnoisepowertobeknown,whiletheINSAF-VRCnotonlytakesintoaccountthesystemnoisepowerestimationbutalsoconsiderstheperiodicupdateofthereusingorder,whichwillbepresentedinthenextsubsection.
2.2Periodicupdateofthereusingorder
ThereusingorderoftheproposedINSAF-VRCisnotverysensitivetotheupdatedelaycausedbyestimationofpowersofthesubbandsystemnoisesinsteadystate,andthereforewecanusethemethodproposedinRef. [17]toestimatethepowersperiodically,i.e.,
(16)
where
(17)
ri(k)=
(18)
andβ(k)=mod(k, P)withPapositiveinteger,whichwecallupdateperiod.
R(k)=
(19)
Ithasbeenshownthatthecomputationalcostofestimatingthepowersofallsubbandsystemnoisesisabout3Mmultiplications[16], while the computational cost of the INSAF is about 4Mmultiplications. Using the periodic update method, the computational cost of estimating the powers of all subband system noises reduces to about 3M/P, which can be ignored as compared to the computational cost of the INSAF ifP>4, and therefore the computational cost of the INSAF-VRC is approximately equal to that of the INSAF.
Fig.2 Impulse response of the unknown system to be estimated
Fig.3comparestheperformanceoftheNLMS-VRCandINSAF-VRC.Forthesakeoffairness,weassumethatthepowerofthesystemnoiseisknownforbothalgorithms[12].ThemaximumreusingordersoftheNLMS-VRCandINSAF-VRCarebothsettoRmax=6.TheforgettingfactorandmodifiedfactoroftheINSAF-VRC, λandφ,aresetto0.98and1.1,respectively.OnecanseethattheINSAF-VRCconvergesfasterthantheNLMS-VRCiftheirsteady-statemisalignmentissettothesamevalue.
Fig.3 Misalignment curves of the NLMS-VRC and INSAF-VRC
Fig.4comparestheperformanceoftheNSAF,INSAF,andINSAF-VRC.Allstep-sizesofsimulatedalgorithmsaresetto0.5,thereusingorderoftheINSAFandthemaximumreusingorderoftheINSAF-VRC,RandRmax,aresetto6,respectively.Theparametersλandφaresetto0.993and1.1,respectively.ItisseenthattheNSAFsuffersfromlargesteady-statemisalignmentandtheINSAFsuffersfromslowconvergencerate,whiletheINSAF-VRCwithupdateperiod1≤P≤4canobtainbothfastconvergencerateandsmallsteady-statemisalignment.
Fig.4 Misalignment curves of the INSAF-VRC with different update periods 1≤P≤4
Thispaperproposedanimprovedsubbandadaptivefilterwithvariablereusingorderofcoefficientvectors.Atthebeginningofadaptation,theproposedalgorithmjustutilizesthemostrecentcoefficientvectoroftheadaptivefiltertomaintainfastconvergencerate,whileinsteady-stateitemploysseveralrecentcoefficientvectorstoreducemisalignment.Thus,theproposedalgorithmswitchesbetweentheNSAFandINSAFtoobtainbothfastconvergencerateandsmallsteady-statemisalignment.Moreover,aperiodicupdateofthereusingorderwasalsodiscussedtoreducecomputationalcost.Simulationresultsweregiventoverifythesuperiorperformanceoftheproposedalgorithm.
[1] Haykin S. Adaptive filter theory[M]. 4th ed. Upper Saddle River, NJ: Prentice- Hall, 2002.
[2] Gilloire A, Vetterli M. Adaptive filtering in subbands with critical sampling: analysis, experiments, and application to acoustic echo cancellation [J]. IEEE Transactions on Signal Processing, 1992, 40(8): 1862-1875.
[3] Lee K A, Gan W S, Kuo S M. Subband adaptive filtering: theory and implementation [M] Chichester, UK: John Wiley & Sons, 2009.
[4] Courville M de, Duhamel P. Adaptive filtering in subbands using a weighted criterion [J]. IEEE Transactions on Signal Processing, 1998, 46(9): 2359-2371.
[5] Pradhan S S, Reddy V U. A new approach to subband adaptive filtering [J]. IEEE Transactions on Signal Processing, 1999, 47(3): 655-664.
[6] Lee K A, Gan W S. Improving convergence of the NLMS algorithm using constrained subband updates [J]. IEEE Signal Processing Letters, 2004, 11(9): 736-739.
[7] Lee K A, Gan W S. Inherent decorrelating and least perturbation properties of the normalized subband adaptive filter [J]. IEEE Transactions on Signal Processing, 2006, 54(11): 4475-4480.
[8] Ni J, Chen X. steady-state mean-square error analysis of regularized normalized subband adaptive filters [J]. Signal Processing, 2013, 93(9): 2648-2652.
[9] Cho H, Lee C W, Kim S W. Derivation of a new normalized least mean squares algorithm with modified minimization criterion [J]. Signal Processing, 2009, 89(4): 692-695.
[10] Ni J. Improved normalised subband adaptive filter [J]. Electronics Letters, 2012, 48(6): 320-321.
[11] Choi Y S, Kim S E, Song W J. Noise-robust normalised subband adaptive filtering [J]. Electronics Letters, 2012, 48(8): 432-434.
[12] Kim S E, Lee J W, Song W J. Steady-state analysis of the NLMS algorithm with reusing coefficient vector and a method for improving its performance [C]∥Proceedings of the International Conference on Acoustics, Speech, and Signal Processing, Dallas, Texas: IEEE, 2011: 1882-1885.
[13] Lee K A, Gan W S, Kuo S M. Mean-square performance analysis of the normalized subband adaptive filter [C]∥Proceedings of the Asilomar Conference on Signals, Systems and Computers, Pacific Grove, California: IEEE, 2006: 248-252.
[14] Petraglia M R, Batalheiro P B. Nonuniform subband adaptive filtering with critical sampling [J]. IEEE Transactions on Signal Processing, 2008, 56(2): 565-575.
[15] Ni J, Li F. A variable regularization matrix normalized subband adaptive filter [J]. IEEE Signal Processing Letters, 2009, 16(2): 105-108.
[16] Ni J, Li F. A variable step-size matrix normalized subband adaptive filter [J]. IEEE Transactions on Audio, Speech, and Language Processing, 2010, 18(6): 1290-1299.
[17] Ni J, Li F. Periodic update based estimates of subband system noise powers for subband adaptive filtering [C]∥Proceedings of the International Conference on Information Science and Engineering, Hangzhou, China: IEEE, 2010: 3866-3868.
[18] Sayed A H. Adaptive Filters [M]. Hoboken, NJ: John Wiley & Sons, 2008.
(Edited by Cai Jianying)
10.15918/j.jbit1004-0579.201524.0314
TN 911.72 Document code: A Article ID: 1004- 0579(2015)03- 0375- 06
Received 2015- 01- 20
Supported by the National Natural Science Foundation of China (61471251; 61101217); the Natural Science Foundation of Jiangsu Province of China (BK20131164)
E-mail: jni@suda.edu.cn
Journal of Beijing Institute of Technology2015年3期