DATA & PRODUCTS
IPWG Ground Validation Data
Other IPWG products
Introduction to Global Precipitation Algorithms and Data Sets
George J. Huffman
21 January 2013, rev. 17 June 2013
In the modern age the good news is that there is a rich selection of precipitation products from which data users can choose. However, this relative plethora of products is also a problem for users, requiring them to determine which product(s) to use. This document is intended to assist in this process by providing information and pointers to additional information on the algorithms that are used to compute precipitation estimates and the data sets that provide the estimates. The focus here is on data sets that provide
- global (or nearly global) coverage, with
- multi-year periods of record, that are
- publicly available.
At the surface, the only observations that support the requirements for spatial coverage and length of record are precipitation gauges (popularly referred to as "rain gauges"), and even they suffer large gaps, principally over oceans and in in sparsely settled land regions. Nonetheless, they are included both as input and in separate analyses because of their status as the closest thing we have to actual measurements, with appropriate caution in areas of sparse coverage.
In the next two sections the algorithms and data sets are introduced. The listings on which these are based have been assembled and are maintained by the International Precipitation Working Group (IPWG). The IPWG is charged with advancing precipitation science and promoting the use precipitation data by its parent body, the Coordinating Group for Meteorological Satellites, which is the World Meteorological Organization group focused on the operational use of meteorological satellites. The IPWG home page is http://www.isac.cnr.it/~ipwg/.
2. AlgorithmsAlgorithms are the computational procedures used to convert satellite and surface data into precipitation estimates. Considering satellite data, the first tier of algorithms converts sets of channel data to precipitation estimates for individual satellites. In very general terms, this means taking advantage of the characteristics of the various individual data sources discussed in the previous section. The reader should go to the algorithm pages on the IPWG web site or recent reviews (Kidd and Huffman 2011, Tapiador et al. 2012) to find information on how this is done, but a few overarching comments are in order. For example, one important implication of IR's dependence on cloud top is that no first-principles precipitation estimate is possible. Every IR algorithm is calibrated with some other source of precipitation data. In some cases this calibration is static (for example the GPI), computed for a particular developmental data set and then applied without further modification. In other cases the calibration is dynamic (for example the TMPI used in the GPCP 1DD), being recomputed on some schedule prescribed in the algorithm.
The precipitation signal in microwave data actually results from two physical effects, emission and scattering. Emission, which dominates at frequencies below 37 GHz, primarily arises from the emission of microwave energy by the surface, atmospheric vapor, and liquid cloud and hydrometeor drops. Scattering, which dominates at frequencies above 37 GHz, results from solid hydrometeors scattering upwelling microwave energy out of the line of sight of the satellite instrument. Solid hydrometeors tend to be confined to the upper levels of clouds, so the scattering signal is less sensitive to the surface precipitation than the emission signal. Also, snow, ice, and frost on the ground are highly effective at scattering, so such surfaces prevent a useful scattering-based precipitation estimates. Both emission and scattering are useful over ocean, but only scattering is over land, because the land's high emissivity and strong heterogeneity defeat current-generation emission algorithms. Accordingly, microwave estimates over land tend to be considered less reliable. Developing snow algorithms is a major focus in current research, including in the Global Precipitation Measurement mission (GPM). It is also the case that coastal areas and regions with complex terrain pose particular challenges for microwave-based algorithms.
Analyses of precipitation gauge data can be considered single-sensor algorithms as well. Assembling, quality-controlling, and archiving the necessary data records from the international collection of weather stations is a major barrier to creating such data sets. Another issue is that the effects of wind, evaporation, and side-wetting, usually resulting in an undercatch of precipitation, should be considered in the analysis. Wind losses are particularly significant in snow events (Legates 1987; Sevruk 1989).
A second tier of algorithms uses various combinations of satellite sensors. Note well that, except for the TCI, which uses TRMM PR and TMI channel data, all of the combination schemes combine precipitation products from the various individual sensors. The general goal is to provide denser time/space coverage with higher quality than any single-sensor algorithm can provide. Although the combination schemes seek to emphasize strengths and minimize weaknesses in the individual-sensor estimates, many of the shortcomings found in combination algorithm results are directly traceable to errors in the individual-sensor estimates.
The IPWG seeks to obtain algorithm summaries both from developers whose work results in the datasets discussed in the next section, and from developers whose algorithms are not represented in the next section. The latter group might provide an early look at possible future directions for quasi-operational data sets. Of course, not all data sets in the IPWG have a corresponding algorithm description. The algorithm descriptions are posted at http://www.isac.cnr.it/~ipwg/algorithms/algorithms-invent.html.
3. Data SetsThe actual precipitation data sets which are considered to be global (or nearly global), multi-year, and publicly available are summarized in four tables posted on http://www.isac.cnr.it/~ipwg/data/datasets.html. These tables are organized along the lines discussed above to help users more easily compare products:
- Table 1: Combination datasets with gauge data; data sets that are produced by combining input data from several sensor types, including satellite sensors and precipitation gauges.
- Table 2: Satellite combination datasets; data sets that are produced by combining input data from several satellite sensor types.
- Table 3: Single-source datasets; data sets from a single satellite sensor type.
- Table 4: Precipitation gauge analyses; data sets from precipitation gauge data.
4. ContactsWe anticipate that most questions about the algorithms and data sets are properly directed to the relevant experts. Questions about this summary and the listings may be directed to the IPWG webmaster (Vincenzo Levizzani, firstname.lastname@example.org) or the appropriate document custodian (George Huffman, email@example.com).
5. ReferencesAdler, R.F., G.J. Huffman, A. Chang, R. Ferraro, P. Xie, J. Janowiak, B. Rudolf, U. Schneider, S. Curtis, D. Bolvin, A. Gruber, J. Susskind, P. Arkin, E.J. Nelkin, 2003: The Version 2 Global Precipitation Climatology Project (GPCP) Monthly Precipitation Analysis (1979-Present). J. Hydrometeor., 4, 1147-1167.
Arkin, P.A., B.N. Meisner, 1987: The Relationship between Large-Scale Convective Rainfall and Cold Cloud over the Western Hemisphere during 1982-1984. Mon. Wea. Rev., 115, 51-74.
Kidd, C., G.J. Huffman, 2011: Global Precipitation Measurement. Meteor. Appl., 18, doi:10.1002/met.284, 334-353.
Legates, D.R., 1987: A Cimatology of Global Precipitation. Publications in Climatology, 40, Univ. of Delaware,85 pp.
Sevruk, B., 1989: Reliability of Precipitation Measurements. Proc. WMO/IAHS/ETH Workshop on Precipitation Measurements, St. Moritz, Switzerland, World Meteor. Org., 13-19.
Tapiador, F.J., F.J. Turk, W. Petersen, A.Y. Hou, E. Garc§a-Ortega, L.T. Machado, C.F. Angelis, P. Salio, C. Kidd, G.J. Huffman, M. de Castro, 2012: Global Precipitation Measurement: Methods, Datasets and Applications. Atmos. Res., 104-105, doi:10.1016/j.atmosres. 2011.10.021, 70-97.