Banglin ZHANGVijay TALLAPRAGADAFuzhong WENGJason SIPPELand Zaizhong MA

1I.M.System Group,Inc.,College Park,MD 20740,USA

2NOAA NCEP Environmental Modeling Center,College Park,MD 20740,USA

3NOAA Center for Satellite Applications and Research,College Park,MD 20740,USA

4Joint Center for Satellite Data Assimilation,College Park,MD 20740,USA

Use of Incremental Analysis Updates in 4D-Var Data Assimilation

Banglin ZHANG?1,2,Vijay TALLAPRAGADA2,Fuzhong WENG3,Jason SIPPEL1,2,and Zaizhong MA4

1I.M.System Group,Inc.,College Park,MD 20740,USA

2NOAA NCEP Environmental Modeling Center,College Park,MD 20740,USA

3NOAA Center for Satellite Applications and Research,College Park,MD 20740,USA

4Joint Center for Satellite Data Assimilation,College Park,MD 20740,USA

The four-dimensional variational(4D-Var)data assimilation systems used in most operational and research centers use initial condition increments as control variables and adjust initial increments to f i nd optimal analysis solutions.This approach may sometimes create discontinuities in analysis fields and produce undesirable spin ups and spin downs.This study explores using incremental analysis updates(IAU)in 4D-Var to reduce the analysis discontinuities.IAU-based 4D-Var has almost the same mathematical formula as conventional 4D-Var if the initial condition increments are replaced with time-integrated increments as control variables.

The IAU technique was implemented in the NASA/GSFC 4D-Var prototype and compared against a control run without IAU.The results showed that the initial precipitation spikes were removed and that other discontinuities were also reduced, especially for the analysis of surface temperature.

data assimilation,incremental analysis updates,4D-Var,convergence

1.Introduction

A prototype incremental strong constraint fourdimensional variational(4D-Var)data assimilation system has been developed at the Goddard Space Flight Center (GSFC)Global Modeling and Assimilation Of fi ce(GMAO) (Tremolet and Todling,personal communication).This prototype uses the Grid-Point Statistical Interpolation developed in the National Centers for Environmental Prediction(Wu et al.,2002),the fi fth generation of the Goddard Earth Observing System(GEOS-5)atmospheric model(Rienecker et al.,2008),and the GEOS-4 based tangent linear and adjoint models(Giering et al.,2003).

The 4D-Varprototype issuperiorto the NASA/GFSC 3DVar system for a number of reasons.A key bene fi t is the use of the tangent linear and its adjoint model,which enables flow-dependent propagation of background error covariance over a given assimilation window.Preliminary experiments made with the prototype 4D-Var system showed improvements over 3D-Var.For instance,the forecast skill scores were improved,especially in the data-sparse Southern Hemisphere.

However,a veri fi cation study of the 4D-Var prototype found that large spikes exist in the time series of global mean precipitation(Fig.1).While the exact cause of this has yet to be determined,it most likely arises from discontinuities at the beginning of data assimilation windows due to using initial condition increments as control variables.Such discontinuities can trigger spurious gravity waves that impact precipitation and other physics fields.

Bloom et al.(1996)introduced an incremental analysis updating(IAU)technique to the NASA/GSFC 3D-Var analysis system to remove the same type of initial discontinuities in 3D-Var.Polavarapu et al.(2000)also found a positive impact from using digital filter initialization to suppress gravity waves and to smooth analyses in a 4D-Var system,and Polavarapu et al.(2004)later showed that IAU and incremental digital filtering are equivalent to each other for linear models using time-invariant coeff icients.Because the NASA/GSFC 4D-Var prototype was based on the 3D-Var system with an IAU component embedded in the nonlinear forward model,it is quite straightforward to implement the IAU technique in the 4D-Var system.

The methodology underlying the current study has roots in advancements long before the development of operational 4D-Var.Derber(1989)proposed variational continuous assimilation(VCA)as a modif i cation to the adjoint technique introduced by Le Dimet and Talagrand(1986).In the adjoint technique,the initial conditions are control variables that areadjusted to f i nd the bestfit to the data.Meanwhile,in VCA the control variables are the values that alter the model time derivatives over the assimilation interval.The operational implementation of 4D-Var in terms of increments was later proposed by Courtier et al.(1994).

In the current study the initial condition increments in conventional 4D-Var were replaced with time-integrated increments as control variables in the cost function,which is similar to the VCA technique.This new IAU-based 4D-Var system distributes analysis increments throughout the entire assimilation window both in the full model outer loops and in the tangent linear and the adjoint models.By working this way,a continuous analysis state is generated,and initial discontinuities are greatly reduced.The characteristics of the IAU-based 4D-Var solution could be quite different from those of the conventional 4D-Var without IAU since the latter incrementally adjusts the time derivatives or tendencies throughoutthe analysiswindow while the formeradjustsonly the initial condition at the beginning of the window.Theoretically,IAU-based 4D-Var is also superior to IAU-based 3DVar,which does not take into account the propagation of the analysis increment in the analysis inner loop.

The outline ofthispaperisasfollows:Section 2 describes both conventional 4D-Var and IAU-based 4D-Var.Solution convergence and computer costs are discussed in section 3. In section 4,some experimental results are presented,and the positive impacts of the IAU technique in the 4D-Var system are evaluated.A summary and discussion points are presented in section 5.

2.Conventional 4D-Var and IAU-based 4DVar systems

In this section,the algorithm employed by the NASA GMAO incremental strong constraint 4D-Var prototype is briefly described in section 2.1,and the generalized IAU-based 4D-Var system is presented in section 2.2.In section 2.3,two special cases of the generalized IAU-based 4D-Var system are discussed,one of which is simplified to the regular strong constraint 4D-Var,and the other is a strict IAU 4D-Var.

2.1.Conventional incremental strong constraint 4D-Var

In an incremental,strong-constraint 4D-Var system (Courtier et al.,1994),the model’s trajectory and the departure of observations from the model are calculated by the use of a non-linear model in the outer-loop,

where x is the model state variable,M is the nonlinear forecast model,and the time stepis 0,1,2,···,n.

The preconditioned Lanczos conjugate-gradient method (Fisher,1998)is used to solve the minimization problem with the cost-function in the inner loop written as where the control variableis the correction from first guessis the difference betweenand model stateis the background error covariance ma-observation error,andis the observation.TheT()notation denotes a transpose of a vector or a matrix.For i=0,1,···,n,

In an actual implementation,the forward integrations are computed step by step for

and the summation on the right-hand side of?J0is derived backward through adjoint operations fo

2.2.IAU based 4D-Var

In an IAU-based 4D-Var system,analysis increments are gradually inserted to the model at each time step instead of at the initial step.Noting the time-integrated incrementsthe new control variables,and assuming the tendenciesare small fractions of the total integrated increments at time stepi,we can write the nonlinear forward model in the outer loopas

In the inner loop of the IAU based 4D-Var system,the forward operations,fori=1,···,n,are

and the adjoint operations in a backward order fori=n?1,···,1,0,are

The corresponding cost function in terms of?xis

where fori=0,1,···,n

The gradient ofJ0with respect to

where all the symbols with tildes are rede fined to re flect the presence of IAU vectors,

Here,the intermediate vectors with augmented IAU,andtheir adjoint vectorsare written as

Thus,the forward tangent linear model operations for timei=1,···,n?1,n,are

The backward adjoint operations fori=n?1,···,1,are

Fori=0,

Equations(18–22)for IAU-based 4D-Var are very similar to Eqs.(4)and(6–8),which allows for easy implementation of Eqs.(18–22).

The differences between the conventional incremental, strong-constraint 4D-Var and IAU-based 4D-Var are illustrated in Fig.2.In conventional 4D-Var,analysis increments are added at the initial step,which creates discontinuities at the beginning of an assimilation window.On the other hand, IAU-based 4D-Var gradually adds small fractions of analysis increments to a nonlinear forecast model in the outer loops at each time step and acts like a continuous assimilation method.The IAU-based 4D-Var system also gradually adds small fractions of increments to the tangent linear model in the inner loops.

In data assimilation a weak constraint refers to corrections made to the forecast model rather than the initial condition,so IAU-based 4D-Var is actually a weak-constraint scheme.However,the algorithm is implemented exactly as in the incremental strong-constraint algorithm.The only difference is that time-integrated increments replace initial condition increments as control variables.As for computational overhead,the increase is negligible for IAU-based 4D-Var when compared with conventional 4D-Var.

2.3.Special cases

The generalized IAU-based 4D-Var can be simpli fi ed to the conventional incremental 4D-Var when

For another extreme case,the generalized algorithm reduces to a strict IAU-based 4D-Var when

In this study,we only run experiments for the above two special cases to evaluate the impacts of the IAU in a 4D-Var system.

3.Convergence issue

To validate the algorithm,the first step is to examine solution convergence.We ran the outer loop 10 times and fi xed the number of inner loop iterations at 70 for both conventional 4D-Var and strict IAU-based 4D-Var.Both the conventional 4D-Var experiment and IAU-based algorithm were carried out with version fdda b1p3-das 215-3 of the NASA/GFSC 4D-Var prototype.The default con fi guration was adopted for setting up the control experiment,except that the inner loop iteration numbers and outer loop numbers were changed.Figure 3 shows the evolution of the cost per observation(Jo/p)as a function of the accumulated number of inner loop iterations for 10 outer loops.The convergence ofJo/pis obtained after only three outer loop iterations,though the convergence values are quite different between the two experiments.Meanwhile,Fig.4 shows the reduction of gradient norms as a function of inner-loop iteration number for the first three outer loops.The gradient norm from IAU-based 4D-Var decreases much more quickly than that of the conventional 4D-Var,which shows that the IAU-based algorithm converges faster.However,IAU-based 4D-Var converges to a bigger minimum value(0.470)than the conventional 4D-Var system(0.389).This implies that conventional 4D-Var has less model constraint and more strongly fit sobservations,but this could be a less balanced solution.IAU-based 4D-Var has more constraint from the model and a more balanced solution,but it does not fit observations as well.

4.Results

In this section experiments were designed to diagnose the impacts of IAU on 4D-Var.An assimilation experiment was run for both conventional and IAU-based 4D-Var starting from the same initial condition at 2100 UTC 8 September 2007 and ending at 2100 UTC 31 October 2007.The experiments used three outer loops based on the aforementioned convergence study,but the number of inner loop iterations was cut from 70 to 35 for the second and third outer loops to reduce the computational cost.

Figure 5 shows the temperature control variable as an example comparison between the two systems.Shown in the left panels are the initial condition increments from conventional 4D-Var at the 51st model level(≈5.6 hPa;Fig.5a)and on the model surface(Fig.5c)at 2100 8 September 2007. The right-hand panels show time-integrated temperature increments from the IAU-based 4D-Var system in a 6 h assimilation window starting from 2100 8 September 2007 at the 51st model level(Fig.5b),and on the model surface(Fig. 5d).The difference in temperature increments between conventional4D-Varand IAU-based 4D-Varis quite small.However,for IAU-based 4D-Var the time-integrated increment at level 51 has more detailed small structure over the Southern Hemisphere.In addition,the biggest increments in conventional 4D-Var are near locations with many rawinsonde observations,while IAU-based 4D-Var has big increments farther away.

4.1.Analysis and diagnostic fields

The time series of hourly total precipitation averaged over the globe from both conventional 4D-Var and IAU-based 4DVar are first analyzed to see if introducing IAU into 4D-Var can reduce discontinuities.As shown in Fig.1,the discontinuities found at the beginning of assimilation windows in the conventional4D-Var(red curve)are completely smoothed out by the IAU implementation(blue line).

Verif i cation of other state variables is also conducted to check the impacts of IAU in 4D-Var.Figure 6 shows an example time series of background and analysis surface temperature at(30?N,120?E)from conventional 4D-Var and the IAU-based 4D-var systems.For this example,the conventional 4D-Var analysis itself is of high quality,and only small discontinuities appeared at initial time of each assimilation window.The evolutions of background and analysis surface temperature from IAU based 4D-Var are quite close to the conventional 4D-Var.

In contrast,the time series of surface temperature atin Fig.7 demonstrates poor performance of the conventional strong constraint 4D-Var.The model background temperatures are much warmer than observations in many assimilation windows,and the analysis overcorrected the systematic warm bias,which resulted in an unrealistic saw-tooth pattern.The IAU-based 4D-Var distributed the increment over the entire assimilation window without over-correction and with a much smoother analysis,although the warm bias still exists.

The time series in Fig.8,which shows temperature at the 51st model level at(30?N,120?E),demonstrates noisier gravity wave effects in conventional 4D-Var than in the IAU-based 4D-Var system.Figure 9 shows a time series of globally averaged hourly temperature analyses from conventional 4D-Var(red)and the IAU-based 4D-Var system(blue) at the 51st model level(top panel)and at the model surface (bottom panel).Spurious high-frequency waves are observed in the conventional 4D-Var,while they are absent from the IAU-based 4D-Var.

The time series of globally averaged 6-hourly temperature analyses from IAU-based 3D-Var(green),conventional 4D-Var(red),and IAU-based 4D-Var(blue)are given in Fig. 10.The IAU-based 4D-Var analysis is even smoother than that of the IAU-based 3D-Var,but the difference between 4DVar analyses with and without IAU is much smaller than the difference between 3D-Var and 4D-Var.

4.2.Observation-minus-background and-analysis statistics

To verify IAU-based 4D-Var,the statistics of the observation-minus-background(OmB)departures and observation-minus-analysis(OmA)were calculated for 4DVar experiments with and without IAU.Giving atmospheric water vapor mixing ratio as an example,Fig.11 shows the monthly mean bias(solid)and standard deviations(dashed) of OmB residuals(top panels)and OmA residuals(bottom panels)for four different regions.Although the OmA standard deviation from 4D-Var with IAU is slightly larger than 4D-Var without IAU,the OmB mean biases and standarddeviations from both conventional 4D-Var and IAU-based 4D-Var are very similar.The IAU-based analysis slightly degrades in the OmA standard deviation statistics because of more constraint by the model.For other variables such as temperature,zonal and meridional winds,the results are similar(figures not shown here).

5.Summary and discussion

In this paper we introduced IAU into 4D-Var and compared it to conventional strong constraint 4D-Var without IAU.The implementation of IAU in 4D-Var generates a continuous analysis state,and large spikes in global mean precipitation present in conventional 4D-Var were greatly reduced. The easy conversion to the strong constraint formula from IAU is another outstanding characteristic and is why the IAU-based 4D-Var does not have additional computational cost.

The experiment in IAU-based 4D-Var used the same background error from conventional 4D-Var without any tuning.This might also be one of the reasons that the OmA statistics of the IAU-based 4D-Var are slightly larger than for conventional 4D-Var.Tuning of the background error will be carried out in the future to improve the OmA statistics and to obtain better forecast skill scores.

Acknowledgements.The authors thank Yannick TREMOLET of the European Centre for Medium-Range Weather Forecasts and Ricardo TODLING of the GMAO for their help with the development of the NASA/GMAO 4D-Var prototype.The authors are grateful to Jing GUO of Science Systems and Applications,Inc.at the NASA/GMAO for helpful discussions.The work was supported by NOAA’s Hurricane Forecast Improvement Project.

REFERENCES

Bloom,S.C.,L.L.Takacs,A.M.da Silva,and D.Ledvina,1996: Data assimilation using incremental analysis updates.Mon. Wea.Rev.,124,1256–1271.

Courtier,P.,J.-N.Th′epaut,and A.Hollingsworth,1994:A strategy for operational implementation of 4d-Var,using an incremental approach.Quart.J.Roy.Meteor.Soc.,120,1367–1387.

Derber,J.C.,1989:A variational continuous assimilation technique.Mon.Wea.Rev.,117,2437–2446.

Fisher,M.,1998:Minimization algorithms for variational data assimilation.Seminar on Recent Developments in Numerical Methods for Atmospheric Modelling,ECMWF,364–385.

Giering,R.,T.Kaminski,R.Todling,and S.-J.Lin,2003:Generating the tangent linear and adjoint models of the DAO f i nite volume GCM’s dynamical core by means of TAF.EGS-AGUEUG Joint Assembly,Abstracts,11680,France.

Le Dimet,F.-X.,and O.Talagrand,1986:Variational algorithms for analysis and assimilation of meteorological observations.Tellus,38A,97–110.

Polavarapu,S.,M.Tanguay,and L.Fillion,2000:Fourdimensional variational Data assimilation with digital filter initialization.Mon.Wea.Rev.,128,2491–2510.

Polavarapu,S.,S.Z.Ren,A.M.Clayton,S.David,and Y.Rochon, 2004:On the relationship between incremental analysis updating and incremental digital filtering.Mon.Wea.Rev.,132, 2495–2502.

Rienecker,M.,and Coauthors,2008:The GEOS-5 data assimilation system-documentation of versions 5.0.1,5.1.0,and 5.2.0.Technical Report Series on Global Modeling and Data Assimilation,NASA TM 104606.

Wu,W.S.,R.J.Purser,and D.F.Parrish,2002:Three-dimensional variational analysis with spatially inhomogeneous covariances.Mon.Wea.Rev.,130,2905–2916.

:Zhang,B.,V.Tallapragada,F.Weng,J.Sippel,and Z.Ma,2015:Use of incremental analysis updates in 4D-Var data assimilation.Adv.Atmos.Sci.,32(12),1575–1582,

10.1007/s00376-015-5041-7.

13 February 2015;revised 9 June 2015;accepted 10 June 2015)?

Banglin ZHANG Email:banglin.zhang@noaa.gov