text:
2. Despiking methodologies
a. Statistical-based methods
b. Filter methods
c. Phase-space thresholding
d. Spectral analysis by wavelet transform
e. Quantifying overall performance of the algorithms
3. Data
a. Synthetic signal
b. Real signal
a. Despiking synthetic data
b. Despiking real data
Beaton, A. E., , and Tukey J. W. , 1974: The fitting of power series, meaning polynomials, illustrated on band-spectroscopic data. Technometrics, 16, 147–185, doi:10.1080/00401706.1974.10489171.
Beaton, A. E., and TukeyJ. W. , 1974: The fitting of power series, meaning polynomials, illustrated on band-spectroscopic data. Technometrics, 16, 147–185, doi:10.1080/00401706.1974.10489171.)| false
Brock, F. V., 1986: A nonlinear filter to remove impulse noise from meteorological data. J. Atmos. Oceanic Technol., 3, 51–58, doi:10.1175/1520-0426(1986)003<0051:ANFTRI>2.0.CO;2.
Brock, F. V., 1986: A nonlinear filter to remove impulse noise from meteorological data. J. Atmos. Oceanic Technol., 3, 51–58, doi:10.1175/1520-0426(1986)003<0051:ANFTRI>2.0.CO;2.)| false
Daubechies, I., 1992: Ten Lectures on Wavelets. CBMS-NSF Regional Conference Series in Applied Mathematics, Vol. 61, Society for Industrial and Applied Mathematics, 350 pp.
Donoho, D. L., , and Johnstone I. M. , 1994: Ideal spatial adaptation by wavelet shrinkage. Biometrika, 81, 425–455, doi:10.1093/biomet/81.3.425.
Donoho, D. L., and JohnstoneI. M. , 1994: Ideal spatial adaptation by wavelet shrinkage. Biometrika, 81, 425–455, doi:10.1093/biomet/81.3.425.)| false
Felber, R., , Münger A. , , Neftel A. , , and Ammann C. , 2015: Eddy covariance methane flux measurements over a grazed pasture: Effect of cows as moving point sources. Biogeosciences, 12, 3925–3940, doi:10.5194/bg-12-3925-2015.
Felber, R., MüngerA. , NeftelA. , and AmmannC. , 2015: Eddy covariance methane flux measurements over a grazed pasture: Effect of cows as moving point sources. Biogeosciences, 12, 3925–3940, doi:10.5194/bg-12-3925-2015.)| false
Fochesatto, G. J., , and Sloan J. , 2008: Signal processing of multicomponent Raman spectra of particulate matter. Int. J. High Speed Electron. Syst., 18, 277–294, doi:10.1142/S0129156408005345.
Fochesatto, G. J., and SloanJ. , 2008: Signal processing of multicomponent Raman spectra of particulate matter. Int. J. High Speed Electron. Syst., 18, 277–294, doi:10.1142/S0129156408005345.)| false
Foken, T., , and Wichura B. , 1996: Tools for quality assessment of surface-based flux measurements. Agric. For. Meteor., 78, 83–105, doi:10.1016/0168-1923(95)02248-1.
Foken, T., and WichuraB. , 1996: Tools for quality assessment of surface-based flux measurements. Agric. For. Meteor., 78, 83–105, doi:10.1016/0168-1923(95)02248-1.)| false
Foken, T., and Coauthors, 2010: Energy balance closure for the LITFASS-2003 experiment. Theor. Appl. Climatol., 101, 149–160, doi:10.1007/s00704-009-0216-8.
Foken, T., and Coauthors, 2010: Energy balance closure for the LITFASS-2003 experiment. Theor. Appl. Climatol., 101, 149–160, doi:10.1007/s00704-009-0216-8.)| false
Fratini, G., , and Mauder M. , 2014: Towards a consistent eddy-covariance processing: An intercomparison of EddyPro and TK3. Atmos. Meas. Tech., 7, 2273–2281, doi:10.5194/amt-7-2273-2014.
Fratini, G., and MauderM. , 2014: Towards a consistent eddy-covariance processing: An intercomparison of EddyPro and TK3. Atmos. Meas. Tech., 7, 2273–2281, doi:10.5194/amt-7-2273-2014.)| false
Gallagher, N. C., , and Wise G. L. , 1981: A theoretical analysis of the properties of median filters. IEEE Trans. Acoust. Speech Signal Process., 29, 1136–1141, doi:10.1109/TASSP.1981.1163708.
Gallagher, N. C., and WiseG. L. , 1981: A theoretical analysis of the properties of median filters. IEEE Trans. Acoust. Speech Signal Process., 29, 1136–1141, doi:10.1109/TASSP.1981.1163708.)| false
Gao, W., , Shaw R. H. , , and Paw U K. T. , 1989: Observation of organized structure in turbulent flow within and above a forest canopy. Bound.-Layer Meteor., 47, 349–377, doi:10.1007/BF00122339.
Gao, W., ShawR. H. , and Paw UK. T. , 1989: Observation of organized structure in turbulent flow within and above a forest canopy. Bound.-Layer Meteor., 47, 349–377, doi:10.1007/BF00122339.)| false
Goring, D. G., , and Nikora V. I. , 2002: Despiking acoustic Doppler velocimeter data. J. Hydraul. Eng., 128, 117–126, doi:10.1061/(ASCE)0733-9429(2002)128:1(117).
Goring, D. G., and NikoraV. I. , 2002: Despiking acoustic Doppler velocimeter data. J. Hydraul. Eng., 128, 117–126, doi:10.1061/(ASCE)0733-9429(2002)128:1(117).)| false
Hill, W., , and Rogalia D. , 1992: Spike-correction of weak signals from charge-coupled devices and its applications to Raman spectroscopy. Anal. Chem., 64, 2575–2579, doi:10.1021/ac00045a019.
Hill, W., and RogaliaD. , 1992: Spike-correction of weak signals from charge-coupled devices and its applications to Raman spectroscopy. Anal. Chem., 64, 2575–2579, doi:10.1021/ac00045a019.)| false
Højstrup, J., 1993: A statistical data screening procedure. Meas. Sci. Technol., 4, 153–157, doi:10.1088/0957-0233/4/2/003.
Højstrup, J., 1993: A statistical data screening procedure. Meas. Sci. Technol., 4, 153–157, doi:10.1088/0957-0233/4/2/003.)| false
Lee, X., , Neumann H. H. , , Hartog G. , , Mickle R. E. , , Fuentes J. D. , , Black T. A. , , Yang P. C. , , and Blanken P. D. , 1997: Observation of gravity waves in a boreal forest. Bound.-Layer Meteor., 84, 383–398, doi:10.1023/A:1000454030493.
Lee, X., NeumannH. H. , HartogG. , MickleR. E. , FuentesJ. D. , BlackT. A. , YangP. C. , and BlankenP. D. , 1997: Observation of gravity waves in a boreal forest. Bound.-Layer Meteor., 84, 383–398, doi:10.1023/A:1000454030493.)| false
Lee, X., , Massman W. J. , , and Law B. E. , Eds., 2004: Handbook of Micrometeorology: A Guide for Surface Flux Measurement and Analysis. Atmospheric and Oceanographic Sciences Library, Vol. 29, Springer, 250 pp.
LI-COR, 2012: EddyPro 3.0 help and user's guide: Despiking and raw data statistical screening. Accessed 8 June 2015. [Available online at http://envsupport.licor.com/envhelp/EddyPro3/Content/Topics/Despiking_Raw_Stat_Screening.htm.]
Mauder, M., , and Foken T. , 2006: Impact of post-field data processing on eddy covariance flux estimates and energy balance closure. Meteor. Z., 15, 597–609, doi:10.1127/0941-2948/2006/0167.
Mauder, M., and FokenT. , 2006: Impact of post-field data processing on eddy covariance flux estimates and energy balance closure. Meteor. Z., 15, 597–609, doi:10.1127/0941-2948/2006/0167.)| false
Mauder, M., , and Foken T. , 2011: Documentation and instruction manual of the eddy-covariance software package TK3. Universität Bayreuth Dept. of Micrometeorology Work Results 46, 60 pp.
Mauder, M., , Cuntz M. , , Drüe C. , , Graf A. , , Rebmann C. , , Schmid H. P. , , Schmidt M. , , and Steinbrecher R. , 2013: A strategy for quality and uncertainty assessment of long-term eddy-covariance measurements. Agric. For. Meteor., 169, 122–135, doi:10.1016/j.agrformet.2012.09.006.
Mauder, M., CuntzM. , DrüeC. , GrafA. , RebmannC. , SchmidH. P. , SchmidtM. , and SteinbrecherR. , 2013: A strategy for quality and uncertainty assessment of long-term eddy-covariance measurements. Agric. For. Meteor., 169, 122–135, doi:10.1016/j.agrformet.2012.09.006.)| false
Metzger, S., , Junkermann W. , , Mauder M. , , Beyrich F. , , Butterbach-Bahl K. , , Schmid H. P. , , and Foken T. , 2012: Eddy-covariance flux measurements with a weight-shift microlight aircraft. Atmos. Meas. Tech., 5, 1699–1717, doi:10.5194/amt-5-1699-2012.
Metzger, S., JunkermannW. , MauderM. , BeyrichF. , Butterbach-BahlK. , SchmidH. P. , and FokenT. , 2012: Eddy-covariance flux measurements with a weight-shift microlight aircraft. Atmos. Meas. Tech., 5, 1699–1717, doi:10.5194/amt-5-1699-2012.)| false
Nikora, V. I., , and Goring D. G. , 2000: Flow turbulence over fixed and weakly mobile gravel beds. J. Hydraul. Eng., 126, 679–690, doi:10.1061/(ASCE)0733-9429(2000)126:9(679).
Nikora, V. I., and GoringD. G. , 2000: Flow turbulence over fixed and weakly mobile gravel beds. J. Hydraul. Eng., 126, 679–690, doi:10.1061/(ASCE)0733-9429(2000)126:9(679).)| false
Papale, D., and Coauthors, 2006: Towards a standardized processing of Net Ecosystem Exchange measured with eddy covariance technique: Algorithms and uncertainty estimation. Biogeosciences, 3, 571–583, doi:10.5194/bg-3-571-2006.
Papale, D., and Coauthors, 2006: Towards a standardized processing of Net Ecosystem Exchange measured with eddy covariance technique: Algorithms and uncertainty estimation. Biogeosciences, 3, 571–583, doi:10.5194/bg-3-571-2006.)| false
Pasian, F., , and Crise A. , 1984: Restoration of signals degraded by impulse noise by means of a low-distortion nonlinear filter. Signal Process., 6, 67–76, doi:10.1016/0165-1684(84)90052-5.
Pasian, F., and CriseA. , 1984: Restoration of signals degraded by impulse noise by means of a low-distortion nonlinear filter. Signal Process., 6, 67–76, doi:10.1016/0165-1684(84)90052-5.)| false
Phillips, G. R., , and Harris J. M. , 1990: Polynomial filters for data sets with outlying or missing observations: Application to charge-coupled-device-detected Raman spectra contaminated by cosmic rays. Anal. Chem., 62, 2351–2357, doi:10.1021/ac00220a017.
Phillips, G. R., and HarrisJ. M. , 1990: Polynomial filters for data sets with outlying or missing observations: Application to charge-coupled-device-detected Raman spectra contaminated by cosmic rays. Anal. Chem., 62, 2351–2357, doi:10.1021/ac00220a017.)| false
Starkenburg, D., , Fochesatto G. J. , , Prakash A. , , Cristóbal J. , , Gens R. , , and Kane D. L. , 2013: The role of coherent flow structures in the sensible heat fluxes of an Alaskan boreal forest. J. Geophys. Res. Atmos., 118, 8140–8155, doi:10.1002/jgrd.50625.
Starkenburg, D., FochesattoG. J. , PrakashA. , CristóbalJ. , GensR. , and KaneD. L. , 2013: The role of coherent flow structures in the sensible heat fluxes of an Alaskan boreal forest. J. Geophys. Res. Atmos., 118, 8140–8155, doi:10.1002/jgrd.50625.)| false
Vickers, D., , and Mahrt L. , 1997: Quality control and flux sampling problems for tower and aircraft data. J. Atmos. Oceanic Technol., 14, 512–526, doi:10.1175/1520-0426(1997)014<0512:QCAFSP>2.0.CO;2.
Vickers, D., and MahrtL. , 1997: Quality control and flux sampling problems for tower and aircraft data. J. Atmos. Oceanic Technol., 14, 512–526, doi:10.1175/1520-0426(1997)014<0512:QCAFSP>2.0.CO;2.)| false
A 60-min sample of actual 20-Hz sonic temperature data for a summer case in an Alaskan black spruce boreal forest. The data were taken 12 m above ground over a canopy that has an average height of 4.7 m.
SSS in magenta, with the CSS superimposed in black for comparison. This signal emulates a 60-min turbulent temperature at a 20-Hz sampling rate. Units are scaled to 1°C increments.
Histogram of the distance between the normalized raw signal and the median filter DI for (a) CSS and (b) SSS. Vertical lines in (b) indicate the first zero bin values to the left and right of 0, between which lie the quality data and beyond which points are considered spikes. Median filter value N = 3 and the window size = 7; histogram bin size for DI is 25.
The real CO2 data series showing obvious outlier points every hour, and the reduced signal when outliers below 600 and above 750 μg m−3 are replaced (black). A portion of the reduced signal in the interval (2–3 h) is shown in the insert.
Testing GN on the SSS. Circles (GN) are spikes detected by GN, black dots are known spike positions, and X marks indicate overdetections by GN. Units are scaled to 1°C increment.
(a) Distribution of the normalized raw SSS minus the median filter for BR, and (b) as in (a), but minus the reconstructed signal for WT. (c) As in (b), but with only 25 bins for better comparison to (a). Vertical lines indicate the first zero bin values on either side of zero. Note that the y axis is terminated at 120 for visual clarity.
(a) Distribution of the normalized raw CO2 signal minus the median filter for BR, and (b) as in (a), but minus the reconstructed signal for WT. Vertical lines indicate the first zero bin values on either side of zero. Note that the y axis is terminated at 10 for visual clarity.
Result of running WT, BR, and VM on the reduced CO2 signal (after removing and gap filling the most extreme outlier points as described in the text). Gray is the reduced signal, and "spike" indicates known spike positions (circles). WT, BR, and VM are where the respective algorithms detected spike points.
(a) Distribution of the normalized reduced CO2 signal minus the median filter for BR, and (b) as in (a), but minus the reconstructed signal for WT. Vertical lines indicate the first zero bin values on either side of zero. Note that the y axis is terminated at 30 and that the x axis is set between −1 and +1 for visual clarity.
Assessment of Despiking Methods for Turbulence Data in Micrometeorology
Derek Starkenburg 1 , Stefan Metzger 2 , Gilberto J. Fochesatto 3 , Joseph G. Alfieri 4 , Rudiger Gens 5 , Anupma Prakash 5 , and Jordi Cristóbal 5
1 Geophysical Institute, and Department of Atmospheric Sciences, College of Natural Science and Mathematics, University of Alaska Fairbanks, Fairbanks, Alaska
2 Fundamental Instrument Unit, National Ecological Observatory Network, and Institute of Arctic and Alpine Research, University of Colorado Boulder, Boulder, Colorado
4 Hydrology and Remote Sensing Laboratory, ARS, USDA, Beltsville, Maryland
5 Geophysical Institute, University of Alaska Fairbanks, Fairbanks, Alaska
https://doi.org/10.1175/JTECH-D-15-0154.1
The computation of turbulent fluxes of heat, momentum, and greenhouse gases requires measurements taken at high sampling frequencies. An important step in this process involves the detection and removal of sudden, short-lived variations that do not represent physical processes and that contaminate the data (i.e., spikes). The objective of this study is to assess the performance of several noteworthy despiking methodologies in order to provide a benchmark assessment and to provide a recommendation that is most applicable to high-frequency micrometeorological data in terms of efficiency and simplicity. The performance of a statistical time window–based algorithm widely used in micrometeorology is compared to three other methodologies (phase space, wavelet based, and median filter). These algorithms are first applied to a synthetic signal (a clean reference version and then one with spikes) in order to assess general performance. Afterward, testing is done on a time series of actual CO2 concentrations that contains extreme systematic spikes every hour owing to instrument interference, as well as several smaller random spike points. The study finds that the median filter and wavelet threshold methods are most reliable, and that their performance by far exceeds statistical time window–based methodologies that use the median or arithmetic mean operator (−34% and −71% reduced root-mean-square deviation, respectively). Overall, the median filter is recommended, as it is most easily automatable for a variety of micrometeorological data types, including data with missing points and low-frequency coherent turbulence.
Corresponding author address: Gilberto J. Fochesatto, Geophysical Institute, University of Alaska Fairbanks, 903 Koyukuk Drive, Fairbanks, AK 99775-7320. E-mail: gjfochesatto@alaska.edu
Keywords: Physical Meteorology and Climatology; Atmosphere-land interaction; Carbon cycle; Surface fluxes; Observational techniques and algorithms; Data processing; Mathematical and statistical techniques; Time series; Applications; Atmosphere-land interaction
It is well known that the evaluation of micrometeorological turbulent fluxes depends on data quality, especially if cross comparisons between different experimental sites are performed, or if a quantification of natural variability is desired (Papale et al. 2006; Mauder et al. 2013). Differences in instrumentation and data handling/processing methods can cause larger differences in derived meteorological values than the variability of the natural processes to be quantified (Foken and Wichura 1996; Mauder and Foken 2006). Mauder et al. (2013) provide a comprehensive assessment of the variety of problems that can affect scalar flux calculations, beginning with the quality of the raw high-frequency data, followed by the processing and assessment of derived flux values based on flow conditions. One fundamental problem with raw data is the presence of spikes, which are unrealistically high local deviations of one or a few data points compared to neighboring values (Vickers and Mahrt 1997). Spikes may manifest as artifacts of the instrument (Brock 1986), such as from water on the sonic anemometer transducers (Vickers and Mahrt 1997; Papale et al. 2006), from animal disturbances (Mauder et al. 2013), or from an unreliable power supply (Lee et al. 2004; Mauder et al. 2013). Other types of signal error such as dropouts (periods of data abruptly offset from the local mean), or sensor errors like calibration drift and hysteresis (Brock 1986), are often more visually evident. Spikes, however, are ubiquitous, and therefore an automated method for their removal is ideal. Spikes are problematic because they occupy the higher frequencies of a time series, but their presence affects all spectral characteristics of the data (Brock 1986). Even if spikes do not always have a significant effect on derived fluxes (Mauder and Foken 2006), they substantially affect higher-order statistical moments such as variance (Lee et al. 2004), which are required, for example, in applications such as source attribution models. Specifically, Fratini and Mauder (2014) attribute order-of-magnitude differences in variance to differences in despiking methods.
Furthermore, in the analysis by Vickers and Mahrt (1997, p. 513), testing for spikes is "the first quality control test and the only test that modifies the data itself." Spike detection is also part of the first stage in the algorithm for assessing the uncertainty of calculated flux values described by Mauder et al. (2013), and the second step after verification of physically plausible values in the eddy covariance software package TK3 by Mauder and Foken (2011). As such, despiking is the forerunner of basic data quality issues, and its performance sets the stage for subsequent quality control procedures and/or data usage. A despiking algorithm will ultimately flag a certain number of spiked points that can then be interpolated (i.e., replaced via an estimation of some sort), or marked as missing values. The former will directly control the number of artificial data points entered into the analysis; the latter will indirectly affect the data analysis by establishing a number of missing points, an amount of which may result in the data being rejected (Vickers and Mahrt 1997; Mauder et al. 2013). Despiking is a powerful tool that requires cautious control in order to limit its aggressiveness on observed data that were acquired at great time and monetary expense. Therefore, we focus specifically on the performance of despiking algorithms in the present study.
Technological advancements in equipment and data quality correction methods have significantly improved to date (Foken et al. 2010, and citations therein). Many instruments now have internal capabilities to flag suspect data (Mauder et al. 2013), and quality control algorithms are becoming more standardized (Papale et al. 2006) and combined into software suites (Mauder and Foken 2011). As algorithms become readily available, they should not be treated as black boxes. Since instrumentation and site conditions vary, data cleaning algorithms should be tested before their universal application to diverse datasets. To this end, Papale et al. (2006) showed applicability of their proposed method of standardized net ecosystem exchange flux corrections to 12 annual datasets taken from eight European sites. They showed that the percentages of half-hourly data removed due to the despiking component of their analysis is quite similar across sites, which indicates that the algorithm is not likely biased by regionally specific characteristics of the data (see Table 2 in Papale et al. 2006).
One major problem with evaluating the performance of a data cleaning algorithm is that outside of obviously unphysical values, one cannot know a priori how incorrect a given set of data is. To contend with this, it is proposed to initially test several despiking methods by applying them to both clean and spiked versions of a synthetic signal, for which one has control over the exact number and location of spike points. Afterward, testing the algorithms on real data embedded with obvious spiked points will pave the way for parameterizing their general performances on turbulent micrometeorological data. In practice, a myriad of signals under a variety of conditions should be evaluated before long-term performance of these methods can be stated with confidence.
Table 1 shows a classification of different despiking algorithms, along with some of their pros and cons, as discussed in the literature. These classifications are 1) a statistical approach based on the mean or median, 2) a filter approach using a least squares polynomial filter or a nonlinear median filter, 3) a phase-space approach in which a signal is compared with its first and second derivatives, and 4) a spectral approach using wavelet transformation. The subsections below provide detailed descriptions of these methodologies with a focus on the methods implemented in this paper.
Classification of despiking algorithms found in the literature. References in bold and italic fonts represent methods (with abbreviation) that are the subject of this study, or are used for intercomparison, respectively. The asterisk (*) denotes the most common method used to despike eddy covariance data.
A popular data cleaning method based on Højstrup (1993), and further developed by Vickers and Mahrt (1997), makes use of the mean (μ) and standard deviation (σ) for the data within a window whose width in time (L) is 5 min, or 3000 measurements at 10 Hz. The window slides point by point, searches for values that exceed ±3.5σ, and replaces them by interpolation. The scheme is repeated until no more spikes are detected, with the threshold of spike detection increasing by ±0.1σ each time. Cases where four or more consecutive points exceed the threshold are not replaced. More recently, the algorithm by Vickers and Mahrt (1997) has been modified by Mauder and Foken (2011) for use in their eddy covariance software package, TK3. The algorithm by Vickers and Mahrt (1997) is also the basis for the despiking and statistical screening procedures in the widely used software package EddyPro 3.0 (LI-COR 2012).
Other similar statistical approaches use the deviation of points from the median rather than from the mean, since the median is unbiased by outliers. Specifically, Metzger et al. (2012) apply the median absolute deviation (MAD), where the differences between individual points and a windowed (local) median ±MAD are used to locate spikes. They found that this method reliably removed spikes that were not detected by the Vickers and Mahrt (1997) and Mauder and Foken (2011) schemes. The median- and MAD-based method has subsequently been adopted by Mauder et al. (2013) in an update to their TK3 eddy covariance software package, which uses a nonwindowed (global) median ± MAD threshold. Because of superior performance, the median- and MAD-based method has also been proposed for EddyPro (Fratini and Mauder 2014).
This study will assess the performance of a version of the original scheme by Vickers and Mahrt (1997, hereafter VM), in order to provide a base-level comparison from which to evaluate other lesser-known methodologies. In this paper, VM will follow the same concept as what is described above from the original paper by VM, except that the window size is 300 s, or 6000 points for our 20-Hz data. VM will be allowed to iterate until no more spikes are detected, with spikes replaced by linear interpolation between successive iterations. Other statistical methods from Table 1 are not investigated in similar detail, but their overall performance is nonetheless quantified (section 2e) and a comparative summary of results for those other methods is provided for context (section 4b).
Taking advantage of the fact that the median is an unbiased statistical estimator, the paper of Brock (1986) carefully outlines a methodology whereby a nonlinear median filter is applied with threshold logic to remove spikes. This idea derives from Beaton and Tukey (1974), who were concerned with handling bad or missing lines in band-spectroscopic data; specifically, they noted that a smoothing filter that is nonlinear will not be biased by the spikes themselves. Nonlinear median filtering is a simple operation whose only parameter is the window size, and whose physical behavior is to maintain ("pass") signal edges but remove ("stop") impulses or outliers (Gallagher and Wise 1981). Based on the paper by Pasian and Crise (1984), Brock (1986) describes how a median filter can perform spike detection if a threshold logic is used to determine which data values are far enough from the filter to be considered outliers. Brock (1986) first produces a histogram of the differences between the raw signal and the median filtered signal (DI). In such a distribution, valid data will condense into a central population, while spikes result in subpopulations. According to Brock (1986, p. 55), "searching the histogram for the first minima from the center" will define a threshold value (DT), and any points for which |DI| > DT are considered spikes. The first minima in the distribution of DI are ideally bins with zero counts (i.e., gaps); if no zero bin counts are found, then the bin size is doubled (e.g., from an initial size of 25–51, with one added to retain an odd number bin size) (Brock 1986). However, Brock (1986, p. 55) notes that, "If the bin size is too small, artificial gaps can form because the data have finite resolution. . . ." Thus, for histograms generated purely from acquired data, the maximum number of bins should be such that the bin width is not less than the acquiring instrument's resolution. For a histogram of differences (DI) as in this case, the restriction is the maximum number of bins, which cannot exceed the digital resolution of the instrument used to calculate DI. Ultimately, the y axis is displayed as the square root of the bin counts to emphasize spikes with low occurrence but potentially large amplitudes (Brock 1986).
The advantages of median filtering are its robustness, simplicity, and that its effectiveness is not altered by spikes that are frequent or high in amplitude. Its disadvantage is that it cannot detect spikes of more than a prescribed number of consecutive points N, which is a function of the window size, 2N + 1 (Brock 1986). Furthermore, experimentation suggests that this procedure will detect some spikes even in clean data. Therefore, some preliminary qualitative examination of a few random samples of a given dataset should be performed to broadly assess its quality, before automating a despiking algorithm over the entire set.
For this work we adopt the median filter algorithm as described by Brock (1986, hereafter BR). We use an order N = 3 (i.e., a window of seven points), since such a filter will be sensitive to spikes of up to three consecutive points (Brock 1986), which by definition is the maximum number of successive points within a spike (VM; Mauder and Foken 2011). The raw data are first normalized (by subtracting its mean and dividing by the standard deviation) before applying the BR method. This ensures that the central population for the histogram of DI is centered near zero. Then, we locate zero bin sizes on either side of the central population (R on the positive side; L on the negative side). Next, points in the original signal for which DI > R and DI < L are flagged as spikes.
Another despiking algorithm was derived by Goring and Nikora (2002) for cleaning measurements made using an acoustic Doppler velocimeter. The scheme is known as phase-space thresholding. The procedure requires that three axes be derived: the signal itself U (x axis); its first surrogate time derivative, approximated as a discrete difference over a constant sampling period, ΔU (y axis); and its second surrogate time derivative, also approximated discretely, Δ2U (z axis). These axes define three planes (x–y, x–z, and z–y) whose superposition generates a three-dimensional cluster of points within which most of the data lie. Spikes are those points that reside a certain distance from the main cluster. That distance is based on the universal threshold, which is the expected absolute maximum value of a normally distributed, standard, random series of independent values (Goring and Nikora 2002), the mathematics of which are explained in detail by Donoho and Johnstone (1994). This threshold, as used by Goring and Nikora (2002), is calculated independently for the x, y, and z axes:
where n is the sample size, and σ is the standard deviation of U, ΔU, and Δ2U (Goring and Nikora 2002). By evaluating λUσ for each axis, a three-dimensional bounding ellipsoid is generated within which lie acceptable values, and outside of which are spikes. As spikes are detected, the algorithm replaces them and runs iteratively until no more are detected. This method has the advantage that it does not require the calibration of independent parameters for streamflow measurements (i.e., λUσ is a function of the data itself), and that it can detect multiple spike events. Some caveats are that for λUσ to be valid, the data need to have its mean removed and be detrended. In addition, since the universal threshold is based on "normal probability distribution theory" (Goring and Nikora 2002, p. 118), the data should ideally be independent and normally distributed. Certain datasets, especially those with coherent turbulence, may violate these criteria enough that the universal threshold is less amenable. Finally, this method also requires iterations, owing to the fact that spike replacement reduces the value of σ (Goring and Nikora 2002).
In this study, we adapt the method of Goring and Nikora (2002, hereafter GN). In the GN method, the raw signal is first detrended and its mean is removed prior to processing. Ten iterations are allowed before outputting the results, and spikes are removed with each subsequent iteration performed on the remaining values. In our initial testing of this algorithm on samples of real data, we found some oversensitivity of the universal threshold to the rapid temperature changes associated with the ramp shapes resulting from coherent structures. Therefore, in GN, the universal threshold is increased by an amount determined via empirical calibration.
In their paper, GN also describe a method for spike detection called wavelet thresholding. Wavelet thresholding is inspired by the denoising technique called wavelet shrinkage, proposed by Donoho and Johnstone (1994). Wavelet shrinkage takes advantage of the compact property of the wavelet kernel, which allows signal behaviors to be located in time (Donoho and Johnstone 1994, and citations therein). Since the primary signal can be described by a few wavelet coefficients, other coefficients can be discarded as noise (i.e., "shrunk," or set to zero) if they fall below the threshold defined by Donoho and Johnstone (1994).
According to GN, wavelet thresholding is similar except that one seeks to remove spikes above a threshold versus shrinkage, where the desire is to remove noise below a threshold. Wavelet thresholding is performed by evaluating the first (lowest scale) wavelet coefficient where the mother wavelet has unit dilation. Points where this coefficient exceeds the universal threshold are spikes. Caveats are that the signal must have its mean removed and be zero padded, and that the process is iterated with spike replacement after each round. Also, missing values pose a problem for this methodology, so point replacement is necessary.
In the current study, we adapt a wavelet thresholding method (WT). The raw signal is first normalized to a zero mean and ±1 standard deviation. Next, the normalized signal is decomposed using the Daubechies mother wavelet (Daubechies 1992). From there, the low-frequency portion of the signal obtained from that decomposition is used to reconstruct a low-pass-filtered signal, also known as an approximate signal. The distance (DI) of the points in the normalized signal from the low-frequency reconstructed signal is then evaluated. Then, as with the BR method, a histogram of differences (DI) is produced. This is done rather than using a universal threshold because, as stated previously, this threshold has been found to require additional calibration for the signals used in micrometeorology.
In addition to evaluating the ability of each algorithm to detect known spike points in the data, we also compare their performances via a metric that is based on the Euclidean distance, or the root-mean-square deviation (RMSD). We calculate the reduction in RMSD relative to a reference signal as
Here, Xs is the signal of interest to be treated with the despike(X) algorithm ∈ {BR, GN, WT, VM}. Whenever a spike is identified, a missing value is imputed and subsequently linearly interpolated. The reference signal Xr is created by imputing missing values for all known spike points in Xs and subsequently linearly interpolated. Thus, Xr represents the case that the despike(X) algorithm was able to remove all true spikes, without false detections. Consequently, RMSDr will indicate a reduction of −100% if all true but no falsely detected spikes are removed, and RMSDr > −100% if only part of all true spikes and/or falsely detected spikes is removed.
In short, the larger the reduction in RMSDr, the better the algorithm cleaned the signal. As the RMSD itself is based on Gaussian statistics, RMSDr thus reflects the ability of the despike(X) algorithm to rectify the standard deviation of the signal of interest.
To perform this analysis, a 1-h synthetic temperature signal is generated at a 20-Hz sampling frequency (i.e., 72 000 points) based on Højstrup (1993):
Here, a point Sj is a function of the previous point Sj−1 and R (the point-to-point correlation); μ is the signal mean and σ is its standard deviation, while G is a random number based on the parameters μ and σ (it should be noted that the resultant signal S will have an actual mean higher than the prescribed μ; this is not of concern here, since only the local variation is important for despiking). Appropriate values for R and σ were selected empirically by comparison with a real 20-Hz sonic temperature series taken from the boreal forest of interior Alaska during summertime (Fig. 1). Since temperature ramps occur in scalar time series within and over canopies (Gao et al. 1989; Starkenburg et al. 2013), while inverse ramps, or canopy waves, occur during more stable conditions (Lee et al. 1997), we introduce a series of forward and inverse ramp shapes whose amplitude and duration are based on our experience working with such data (Starkenburg et al. 2013). This signal is hereafter the clean synthetic signal (CSS; Fig. 2). Afterward, a spiked version of the synthetic signal (SSS) was generated by inserting 720 spiked points (1% of the data series). The spike locations were randomly selected, and divided into 360 single spikes, 240 spikes as double (consecutive) events, and 120 spikes as triple (consecutive) events. Each spike (single, pair, or triplet) is shifted by +1.5° of temperature if its first position location is an even number, and by −1.5° if its location is odd (Fig. 2). This spike amplitude in SSS (1.5°) is twice the standard deviation of the CSS (±0.75°). The distribution of DI based on the median filter method (BR) is unimodal for the CSS, and multimodal for the SSS (Fig. 3).
Citation: Journal of Atmospheric and Oceanic Technology 33, 9; 10.1175/JTECH-D-15-0154.1
A very clean signal or an excessively spiked signal does not provide a meaningful evaluation of a despiking methodology. In this study, we use a 20-Hz, 6-h time series (0800–1400 UTC 21 October 2008) of CO2 measured 50 m above ground at a micrometeorological tower on a flat field site in Lindenberg, Germany (Metzger et al. 2012). This signal has two qualities that make it amenable to this evaluation. First, the CO2 measurement contains severe disruptions due to signal communication (data downlink) every hour that produce obvious spikes of unreasonable amplitude (a standard flux processing algorithm would reject such extreme outliers during an initial range test). The signal also contains several smaller (but still obvious) spikes between these systematic outliers that can be qualitatively discerned. The extreme spikes at each hour can be removed, thus providing a reduced version of the signal for a second round of processing (Fig. 4).
The discussion that follows is the result of testing the despiking algorithms on turbulent temperature and CO2 data. The characteristics of other scalar time series, such as that for CH4, may require additional consideration owing to their unique behaviors and spatial distributions (e.g., Felber et al. 2015).
GN state that the universal threshold is amenable to their analysis because "the velocity spectrum at low frequencies approximates the white-noise spectrum" (Nikora and Goring 2000, p. 124), and that their data are approximately normal, such that the standard deviation sufficiently describes the distribution. Qualitative evaluation on real data reveals that the sensitivity of GN to second derivatives sometimes causes false detections in micrometeorological data in the presence of coherent turbulence where ramp shapes do not preserve the second-order momentum in the data distribution and therefore violate the normal distribution required for the universal threshold to perform. Thus, we perform a sensitivity test on GN using CSS and SSS, in which we divide the universal threshold by varying coefficients. Ultimately, a coefficient of 0.48 was selected as a trade-off between correct detection and overdetection.
Next, all algorithms are run on the CSS to determine how they treat clean data (Table 2). For the CSS, GN detects over 500 spikes, many associated with ramp features. WT and BR detect 11 and 10 spikes, respectively, while VM detects no spikes. The bin size in Table 2 indicates that the histogram of DI required a resolution of 103 bins (i.e., 25 were first tried, then 51, and then 103) to find zero bin counts.
Performance of despiking methods for the CSS. First column is the despiking method, second column is the total number of spikes detected, third column is the threshold used (if applicable), and fourth column is the bin size used to isolate zero bins in the distribution of DI (if applicable).
The algorithms are then applied to the SSS. For each method, the distance of all detected spikes in the SSS from their corresponding point in the CSS was evaluated (DX). For GN, a large amount of false detections (DX = 0) occurs, as well as a large amount of true spikes (DX = ±1.5); many of the false detections are near the sharp drop in ramp shapes associated with coherent structures (most of the points in the ramp remain; so that in practice, we do not expect significant problems with flux calculations on data despiked with GN) (Fig. 5). Results for WT are an improvement, as it can be seen that most of the detected spikes are correct (DX = ±1.5). The overdetections from WT are also often near ramp features; however, the sensitivity to ramps is less than with GN. The results for BR show that all but three of the detections are correct, while the results of VM reveal that all detected spikes are correct.
Based on these results, it might appear that VM is the optimal scheme because it detected no spikes in the CSS and had only correct detections in the SSS. However, Table 3 reveals the total detections, correct detections, missed detections, and overdetections in the SSS for each algorithm. VM detects only 167 of the 720 spiked points in the SSS (553 spikes were missed). In the SSS, the modest amplitude of the spikes may be problematic for a pure statistically based method that relies on the mean (VM) to discern outliers. Further, it is noted that while GN and WT have some sensitivity to ramps, most of the spikes found by VM are not within ramp shapes (we noted similar results with actual data). Since ramps are local changes in the signal mean, it may be difficult for an algorithm such as VM to locate spikes within ramps.
Performance of despiking methods for the SSS. The first column is the despiking method, the second column is the total number of spikes detected, the third column is the number of correct detections, the fourth column is the number of spikes missed by the algorithm, the fifth column is the number of incorrect (over) detections, the sixth column is the threshold used (if applicable), and the seventh column is the bin size used to isolate zero bins in the distribution of DI (if applicable).
Table 3 also shows that for GN, 705 of the detected spikes were correct. However, this came at a great cost of overdetection (297 false detections). By comparison, WT locates 757 total spikes, 711 of which are correct (with 46 overdetections). BR detected 718 spikes, 715 of which are correct (only 3 overdetections). Thus, BR appears to perform optimally. The bin size in Table 3 shows that the initial bin size of 25 was sufficient to isolate spikes for BR, but 207 bins were needed in WT. The distribution of DI from WT is slightly smoother than that from BR (Fig. 6). The density of the histogram from WT in Fig. 6b is partially the result of the greater bin size. However, even when the bin size for WT is held at 25 (Fig. 6c), the histogram of DI for the WT is still smoother than for the BR method. This is likely due to the stepwise nature of the windowed median filter in BR as compared to the smoother reconstructed signal from WT. Ultimately, in terms of correct detections, both WT and BR perform about equally well. However, BR has the fewest false detections, making it the preferred method for this analysis.
Since GN requires extensive calibration for use on micrometeorological data, we chose to test the real data series using only WT, BR, and VM. This is done in two steps: 1) apply the algorithms to the raw CO2 signal, including the extreme outliers that occur each hour; and then 2) remove and replace those outliers to provide a reduced version of the CO2 data, and then run the algorithms again. The test assesses the ability of the algorithms over a range of spike amplitudes. The point replacement simply prevents the problem of missing values that bias the spectral methodology of WT. Since replacing points (and the method for how to do so) is neither a goal nor necessarily a recommendation of this work, we use a simple procedure that replaces the extreme spikes with a value that is the mean of the 20 surrounding points, simply to reduce their amplitudes (not to accurately replace them for use in any analysis).
Table 4 provides the results of step 1, where the raw CO2 signal is despiked. In this step, a broad-brush approach was taken to flag the most extreme values, as defined qualitatively by being less than 600 or greater than 750 μg m−3. The positions of these 39 instances were retained as known spike points. WT and BR found a similar number of spikes (38 and 37, respectively), all of which were contained in the 39 extreme values originally flagged. Table 4 shows that both WT and BR required a bin size of 51 (meaning two iterations on the bin size) in order to find zero bins, while Fig. 7 shows the resulting distributions of DI for both methods. The distribution of DI has many zero bin values, as expected when the spiked points have such extreme amplitudes. However, the distribution for WT is again slightly smoother.
As in Table 3, but for the performance of WT, BR, and VM on the raw CO2 signal containing extreme outliers.
Also in Table 4 are the results of VM, who detected 557 spikes (only 6 of which were the ones flagged as extreme outliers). The outliers have severe amplitudes and occur as multiple spiked points every hour. Therefore, it is possible that the mean is biased by the magnitude of these points. It is also possible that the spikes go undetected because they are more than three consecutive points. Regarding the latter, it should be noted that these extreme spikes oscillate between being higher or lower than the local mean, such that no more than three consecutive points lie well above, before the next point lies well below, the local mean. This appears to be important, because BR was able to detect multiple extreme outlier points (e.g., 7 in a row), despite that it had an order N = 3 (window size of 2N + 1 = 7), which limits it to the detection of three or fewer consecutive points. Ultimately, VM is unable to detect most of the extreme values, while BR and WT had more success.
The next step is to compare the performances of WT, BR, and VM on the reduced CO2 signal. In this instance, the 39 most extreme outliers (< 600 or > 750 μg m−3) from the raw signal are replaced and reduced successfully enough that none of the despiking algorithms detected these filled points. However, five spikes that result each hour from the signal communication were not removed because their values were not extreme (< 600 or > 750 μg m−3) and therefore still remain in the reduced signal. Furthermore, seven other points that are not associated with the systematic hourly interference also exist, and can now be visually selected and included as spikes. Together, these 12 new points are the "known" spikes for the reduced signal.
After running the algorithms on the reduced signal, we note that VM located 565 spikes, 11 of which are correct detections but 554 of which are overdetections (Table 5; Fig. 8). This means that in the reduced signal, the spike amplitude is not too extreme for VM to be able to correctly detect them. However, despite that VM can detect most of the known spikes, it also detects a large number of points that visually do not appear to be spikes. These overdetections occur during the intrusion of CO2-depleted eddies. These periods are composed of sufficient data points (order 100) such that they should not be considered outliers. Furthermore, during those periods, the points VM flags as spikes are not necessarily the local extrema. When comparing the results across methods, it becomes apparent that those based on Gaussian statistics are more susceptible to producing artifacts, and that their sensitivity to artifacts is modulated by parameters such as window size and threshold.
As in Table 4, but for the performance of WT, BR, and VM on the reduced CO2 signal.
By comparison, WT correctly detects 10 spikes (missing 2), while BR correctly detects 8 spikes (missing 4). WT and BR both still require a bin size of 51 to isolate zero bin values within the distribution of DI. Furthermore, the distribution of DI is similar for BR and WT, and the range of accepted data also matches closely (Fig. 9). Neither WT nor BR overdetected. Based on this result, WT performed slightly better on the reduced signal. This raises the question as to why BR and WT perform similarly on this real dataset, while BR was superior when applied to the SSS. One difference is that the spike amplitude in the real signal is larger than in the SSS, even for the reduced version. Also, ramp shapes are less sharp in the real signal owing to an expected amount of instrument noise, which softens their edges. It may be that sharp, systematic ramps and low spike amplitudes in the SSS hinder the performance of WT (and GN as well).
In Table 6, we tabulate the reduction in RMSD for each despiking algorithm relative to a reference signal (section 2e). We also include additional algorithms from Table 1 as a reference for comparison (italics in Table 6). For statistical time window–based algorithms that use the mean, successful despiking highly depends on the statistical measures used and specific parameterizations. For these algorithms (VM; Mauder and Foken 2011; Fratini and Mauder 2014), we obtain comparatively small and varying reductions of RMSDr ≥ −36% ± 51%. By comparison, statistical median-based windowed algorithms are more successful (Metzger et al. 2012; Mauder et al. 2013) but still largely variable across datasets with an RMSDr of −59 ± 52% and −58 ± 52%, respectively. The optimal algorithms are BR and WT, which consistently have large RMSDr values across all data. BR is excellent, with RMSDr = −92 ± 6%. While WT performs even better in raw numbers (RMSDr = −93 ± 3%), it is most optimal for data not dominated by sharp ramp shapes, and especially for cases where there are no missing data values. We caution that even optimal procedures such as BR and WT will detect spikes even in clean data, and thus we recommend some qualitative review of a few random data samples from each download to get a general sense of data quality before despiking a large amount of data.
Relative reduction in RMSDr due to despiking. The first column is the despiking method, including several widely used procedures listed in Table 1 for context (italics). The second through fourth columns are the RMSDr for the SSS, raw, and reduced CO2 signals, respectively. The fifth and sixth columns are the RMSDr mean and standard deviation for each algorithm across all signals, respectively.
For practical implementation, despiking performance is important, but so is the ability to automate the process and the overall computational efficiency. From a despiking perspective, BR performs very well, followed by WT and median-based statistical methods (Metzger et al. 2012; Mauder et al. 2013). The mean-based statistical methods (VM; Mauder and Foken 2011; Fratini and Mauder 2014) and GN trail behind, which is also the reason for Fratini and Mauder (2014) to suggest upgrading EddyPro (LI-COR 2012) from the mean-based method to the median-based method. Regarding automation for use with micrometeorological data, BR and the median- and mean-based statistical methods rank highest, with WT next in line (owing to the dependence of WT on gap-free data), followed by GN (owing to its calibration required to adjust the universal threshold for coherent turbulence). Computationally, the most efficient was WT, followed by BR and GN, and trailed by the median- and mean-based statistical methods, each group separated by approximately one order of magnitude runtime. Equal emphasis on these attributes would place BR ahead of WT, followed by median- and mean-based statistical methods, and trailed by GN. Ultimately, the choice of the most appropriate method will depend on the emphasis that a specific use puts on the different attributes.
In this analysis, different methodologies for despiking high-frequency resolution data series were reviewed, and four of them were adapted so that their performance could be evaluated using both a synthetic signal and a real signal. Specifically, we evaluate a statistical method based on VM, a phase-space thresholding scheme based on GN, a nonlinear median filter with threshold logic based on BR, and a wavelet thresholding technique inspired from Donoho and Johnstone (1994) and GN called WT. We acknowledge that outside of obviously unrealistic values, visual spike confirmation is always somewhat subjective, and therefore the evaluation of the performance of these despiking algorithms are subject to those limitations.
Across all the signals tested, WT and BR have the largest and most stable reduction in root-mean-square deviation compared to a reference value, suggesting optimal despiking performances. This also holds true in comparison to widely used time window–based despiking methods, which on average perform 34% and 71% worse for implementations using median- and mean-based statistical measures, respectively. GN often overdetects in the presence of sharp ramps (coherent turbulence) in the synthetic signal. On the other hand, VM underdetects in the synthetic signal with sharp ramps and small amplitude spikes, while it overdetects in the real signals with larger amplitude spikes. BR and WT both do a superior job of detecting most of the known spikes with minimal overdetection.
We conclude that WT and BR are both adequate methods. We recommend BR as the most versatile choice, however, because it does not appear sensitive to low-frequency turbulence (i.e., ramp shapes), which are prevalent in many micrometeorological data taken over plant or forest canopies. Also, BR is able to handle missing values, even one that will strongly skew the results of WT. Therefore, use of BR does not require point replacement, which is an advantage since point replacement is not always desirable depending on the data type and its application. Moreover, BR is highly adaptive with a minimal set of parameters and is computationally efficient. Altogether, this makes BR most suitable also for large-scale, automated, and standardized processing in surface–atmosphere exchange networks, such as the Integrated Carbon Observation System (ICOS) and the National Ecological Observatory Network (NEON). One of the most important results of this study is that a thorough testing of despiking algorithms over different signals and using different metrics is required to fully determine their robustness. To this end, these despiking algorithms should be tested with many datasets over a variety of physical and meteorological conditions to determine long-term performance.
This research was supported by the Alaska NASA EPSCoR Program Award NNX10NO2A, by the Alaska Space Grant Program, and by the "New GK-12 Program: The CASE (Changing Alaska Science Education) for Enhancing Understanding of Climate Change" NSF (DGE-0948029). Data from the Falkenberg tower were kindly provided by Deutscher Wetterdienst Meteorologisches Observatorium Lindenberg-Richard-Aßmann-Observatorium. We thank J. P. Leps and K. Jantze for the CO2 datasets. The National Ecological Observatory Network is a project solely sponsored by the National Science Foundation and is managed under cooperative agreement by NEON, Inc. This material is based upon work supported by the National Science Foundation under Grant DBI-0752017. Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation. Datasets for this paper can be requested from Professor G.J. Fochesatto (gjfochesatto@alaska.edu), Geophysical Institute, University of Alaska Fairbanks.


text:
@interface DCDetailLikeCell : UICollectionViewCell

@end

redpajama_set_name: RedPajamaGithub


Belvac's manufacturing innovation in aluminium bottle and can-shaping technology is forging new market opportunities for creating distinctive packaging.
For decades, global brand managers have been driven to distinguish their products through package design and point-of-purchase advantage. Brand managers and can-makers alike are therefore excited about Belvac's new shaping technology for aluminium bottles, cans and aerosol containers that allows the production of distinctive aluminium products with Belvac machinery at high speeds and volumes, and at reasonable container costs using proven technology. Belvac has been the world leader in high-speed continuous-motion rotary die-necking technology for more than 30 years.
Shaping and aluminium-container lightweighting innovation from Belvac production machinery is changing the way companies look at aluminium packaging for distinctively shaped bottles and cans, opening up new opportunities to use aluminium in packaging styles that would previously have been cost-prohibitive.
Glass has traditionally been the best choice for bottles, but Belvac machinery now provides a cost-effective alternative. Aluminium bottles produced using impact extrusion (IE) have shown up in several markets - largely as promotional products - but the amount of material required to produce a container has meant the cost of production is high. Belvac's new technology is changing that.
Belvac machines are using drawn and ironed (D&I) preforms to produce bottles with nearly 40% less aluminium than traditional IE methods can. A 16oz aluminium bottle produced by IE weighs around 50g, but 16oz D&I bottles in supermarkets today are only 31g. This has created a better financial model for branded aluminium containers and allows the creation of mainstream offerings for branded beverages.
For a bottle, the reduced weight also means reduced logistical costs: a glass bottle weighs around 180g - equivalent to an entire six-pack of D&I aluminium cans. This makes a big difference in terms of shipping costs, while breakage costs are also eliminated with aluminium.
These factors bring the overall life-cycle price of aluminium and glass close, but another factor in the drive to replace glass bottles with aluminium is the premium price consumers are willing to pay for the latter - research has shown that across the globe, they will pay a premium for aluminium, even when the bottle is smaller. In some cases, this equates to a price three times higher per ounce.
Consumers pay this premium because aluminium packaging has user-experience advantages: it chills faster and feels colder to the touch, making the drinking experience more pleasurable in the heat of summer. Aluminium containers are also building momentum in many traditional venues while providing additional benefits in non-traditional ones, such as pools, beaches and sporting events, where broken glass is a significant safety hazard.
D&I aluminium bottles are also a very green technology. Not only is less material used than in traditional aluminium processes but aluminium packages in general are also almost twice as likely to be recycled. According to the Glass Packaging Institute, in 2013, 34% of glass packages were recycled compared with 65% of aluminium packages, as reported by the Can Manufactures Institute.
Belvac is confident its Shaper and Bottle Can Manufacturing System (BCMS) can deliver the highest-quality shaped aluminium cans and bottles at a low cost. The ability to deliver cost-effective aluminium containers with high-speed, high-volume throughout, low spoilage rates and less material use has been Belvac's boast for decades.
The company is investing heavily in this young market because it believes these breakthroughs will establish long -term and increasing demand for these containers, and it is taking the lead in new shaped D&I aluminium can lines by partnering with can manufacturers from the design process and installation to commissioning and beyond.
The modularity of the Belvac machines accommodates container design changes without having to buy a new machine, while existing standard bottle lines can also be easily converted to a shaped bottle line by adding a Belvac Shaper.
Belvac makes no compromises when it comes to speed. Its shaper can run at speeds of 1,200 cans a minute, and the BCMS has proven reliable at speeds of up to 600 cans a minute in multiple global installations. The Belvac Shaper and BCMS can also produce D&I aluminium bottles and shaped cans up to 254mm, and can shapes 200mm from the top edge of the bottle or shaped can.
The breakthroughs in lightweighting shaped cans are changing the financial models associated with producing branded shaped cans, and this new technology is making aluminium a very attractive alternative in the glass-dominated bottle market.
Belvac's D&I aluminium bottles are a cost-efficient competitor to glass.


Aki Kaurismäki, Finland, 1986 74 minutes, M Violence.
The film that set the blueprint for the Kaurismäki mode, Shadows in Paradise may run a mere 76 minutes, but one couldn't mistake brevity for slightness, despite its wisp of a narrative. A garbage collector and supermarket cashier (regular players Matti Pellonpää and Kati Outinen) are brought together through circumstance and misfortune, their relationship tentatively blossoming in the face of dashed dreams and collective disappointments.


text:
Disney's Harry Houdini movie with Ben Affleck
The Harry Houdini movie that Disney has been trying to make for four years is back on track. It looks like the studio has finally found its first actor to recruit, two-time Academy Award winner, Ben Affleck. Apparently, the former Batman will appear in a secondary role.
The new Harry Houdini movie will be based on the novel "The Secret Life of Houdini: The Making of America's First Superhero" by William Kalush & Larry Sloman. Harry Houdini was an American illusionist and escapist, known for his impossible escapes which he enacted chained, tied, wearing a straitjacket, etc.
By haute fashion on Wed, 12/16/2020 - 01:25
The life of Olga Kurylenko
Actress Olga Kurylenko's life begins in a small town in Ukraine. Olga...
The Witches: Anne Hathaway is eaten by a cat
A witch who hates children plans to turn children around the world into mice. The leader of the...
Nike "If something is burning you up, burn it off by running"
The Nike brand is more than a range of sportswear: it is a lifestyle. Nike is...
Top 100 best Greenpeace advertisements
Today I bring you the 100 best Greenpeace advertisements, the most well-known...
Emily Ratajkowski always had a soft spot for culture
Emily Ratajkowski was born on June 7, 1991 in London, UK. As the child of two...
Ellen DeGeneres sold a property in California for $ 33 million
Ellen DeGeneres and Portia de Rossi have sold a $ 33 million...
The world has to prepare for the next threat
A committee of experts provides the UN with an analysis of the risk of a global threat...
George Clooney talks about Russell Crowe
Hollywood actor George Clooney spoke of a long-term feud with Russell...
Panasonic Camera Lenses At Gadgetward In Canada
Panasonic lenses excel in terms of zoom range and focus clarity, setting them...
Top 10 youtube channels
Everyone around the world is familiar with the application of YouTube. YouTube is basically the...
Best XIAOMI MI 11 LITE At Gadgetward
The Xiaomi Mi 11 Lite 5G has a 6.55-inch AMOLED display with Corning Gorilla...
MiniTool Movie Maker is a free video converter
If you want to change the video format, MiniTool Movie Maker, a free video...
Nokia Smartphone At Gadgetward In Canada
Nokia used to be one of the world's biggest mobile phone manufacturers but it fell behind with...
14 Proven Pinterest Marketing Strategies For Your Business
Did you know that out of all adults who have access to the internet, 71% are...
Our 360° digital marketing approach effectively builds substantial and...

redpajama_set_name: RedPajamaCommonCrawl


text:
Eagle News Breaking News, Latest World Headlines, World, Entertainment, Politics, Weather & Video News
London ENI Bureau Telecasts
Switzerland Bureau Telecasts
Washington DC Bureau Telecasts
Canada Bureau Telecasts
New York honors veterans on 100th anniversary of Armistice Day
The Mudd House is most visited historic site in Charles County
How 'Heidi' conquered Japan, sparking an anime revolution
Coffee and quacks served up at Chengdu duck cafe
Protect 30% of planet by 2030: UN Nature rescue plan
Plea for New Zealand to house fire-threatened koalas
Citizens battle to save China's sickly 'mother river'
Princess Diana, sustainability inspire New York Fashion Week
Vintage fashion: senior models bridge S. Korea's age divide
Kate Spade was under treatment for depression, anxiety: husband
Watch: Meghan's wedding dress designer says Duchess of Sussex was "so genuine, warm" on dress collaboration
Sweet! Indian bakers make world's 'longest' cake
Shelling out: Japan crab fetches record $46,000 at auction
The pirarucu: the giant prized fish of the Amazon
Americans go cuckoo for chicken sandwich
Mystery China virus patients could have infected family members: officials
Japan reports case of mystery virus behind China outbreak
Instagram to require birth dates in move to block underage use
Facebook buys maker of hit VR game 'Beat Saber'
Facebook nixes billions of fake accounts
Twitter offering 'topics,' from sports teams to K-pop
Robo-crib highlights infant safety at technology show
Huawei says 'survival' top priority as sales fall short
Carmaker tie-ups and break-ups
Southwest extends MAX grounding until April 2020
First commercial electric plane takes flight in Canada
London repatriates 10% of Thomas Cook's UK customers
No link between talcum powder and ovarian cancer, finds major study
By Ivan Couronne
WASHINGTON, DC (AFP) — A major US government-led study published Tuesday found no link between ovarian cancer and the use of talcum powder in the genital area, citing data from more than 250,000 women.
The paper appeared in the influential Journal of the American Medical Association (JAMA), which also published an editorial praising the research methods and calling the findings "overall reassuring."
For decades, some women have used talcum powder for genital hygiene to absorb odor and moisture — either through direct application or via underwear, sanitary pads, tampons or diaphragms. The practice is more common among older generations.
But its use has grown controversial because of reported cancer risks.
In 2018, US pharmaceutical giant Johnson & Johnson was ordered to pay out $4.7 billion to 22 women who had claimed that asbestos in the company's talcum powder products caused them to develop ovarian cancer. An appeal is underway.
In the 1970s, concerns arose over possible contamination of the mineral talc with asbestos, which often form alongside each other in nature.
Some studies showed a higher risk of ovarian cancer among users of talcum powder, which was suspected of entering the ovaries via the vagina and uterus.
But the link remained contested because of the overall low number of studies conducted, with some of them criticized for a methodology that introduced recall bias among participants, while others were not statistically conclusive.
The effect is also difficult to isolate because ovarian cancers themselves are rare: only 1.3 percent of all women risk being affected in their lifetimes.
– Unprecedented scale –
In the new JAMA paper, led by Katie O'Brien of the National Institute of Environmental Health Sciences, researchers synthesized data from four large studies, which encompassed data from a quarter of a million women from 1982 to 2017.
The studies surveyed participants every year or two on a diverse set of questions related to health, including the use of talcum powder.
The hope was that by scaling up the number of participants, it would be possible to discern weak effects with statistical validity, which would have been undetectable on a smaller population.
Among the 252,745 women followed for a median period of 11.2 years, 2,168 developed ovarian cancer.
No statistically significant association was found when comparing women who had used powder and those who had never used it. Nor was any significant association found when comparing frequency or length of use.
But although the study is the largest of its kind with the longest follow-up time, the authors said there were several limitations.
These included that two of the four data sets missed information on frequency and duration of use.
– 'Competent, careful study' –
There are also inherent limitations associated with so-called observational studies of the population at large — as opposed to controlled clinical trials for drugs — including failure to account for all possible external factors.
Kevin McConway, an emeritus professor of applied statistics at Britain's Open University called it a "good, competent, careful study," but added that it could not definitively rule out a link between talc and cancer entirely.
"Most of the risk differences that the researchers examined were not statistically significant," he said. "That doesn't mean that these differences were definitely zero, only that they were small enough so that they could plausibly be due only to random variation."
He concluded that what the research did establish was that if such a risk did exist, it was likely to be very small.
"I'm not a woman, so can't have concerns about my own health in these respects – but if I were a woman, this wouldn't be high on my list of worries."
Children in South Asia hardest hit by air pollution – study
Women's brains appear 'years younger' than men's: study
Humpback whales stop singing when ships are near: study
Eagle News © Copyright 2020, All Rights Reserved.


text:
For Admirals, it's all about team building
Antoine Laganiere skated confidently Tuesday during the Norfolk Admirals' first training camp practice at Scope. A year ago, in the same venue, he spent more time looking at everybody else to see what he was supposed to be doing.
"It takes awhile for me to get used to anything," he said.
He seemed at times lost over the season's first 25 games, but by the end had finished with 10 goals in 72 games.
A week ago, he started an NHL exhibition game for Anaheim against Arizona. Now he's back in the AHL, armed with a better understanding of what he has to do to play for the Ducks. Stefan Noesen and Nic Kerdiles also were in that game, and also at Scope on Tuesday.
They are among a group of eight or so players considered by the Ducks to be bona fide prospects. They're guys, said Bob Ferguson, the Admirals' liaison with Anaheim, who "if they don't play in the NHL someday, we'll be disappointed."
That group also includes winger Max Friberg and defenseman Josh Manson, though they remain in Anaheim until the big club sorts out injury issues. So are center Will Karlsson and Rickard Rakell, though one or both figure to stay in Anaheim with winger Emerson Etem.
Determining the prospects is one-third of a three-part process used in building an AHL roster. It begins with a "wish list" put together at the end of the previous season, said Ferguson. Where that list stands going into training camp, though, can be undone by salary or playing demands of free agents who have plenty of other options.
Parts two and three of the roster are comprised of players who understand their roles in support of the first-among-equals group. Everybody is there to win. Everybody wants to play in the NHL. But the "character guys" or "depth players," as they are called by scouts and front offices, have a different status.
"The character guys with AHL contracts can help you win games at this level," Ferguson said. "They'll do anything to help you win, but they understand that development of prospects comes first. They understand their roles and know that there are times when they think they should be on the ice, times like the end of a close game, but that (the prospects) get that time because it helps them develop."
Players such as center David Steckel, an NHL veteran, are among that character class.
"David Steckel is a long-time National Hockey League player and deserves respect," said coach Jarrod Skalde, who conducted his first practice as the Admirals' new boss Tuesday. "You respect everybody, but this is a pro with a family. A lot of these guys are learning to be pros."
The class also includes defenseman Mat Clark and center Chris Wagner, both still with Anaheim but likely bound for Norfolk in need of strong seasons to continue in the organization.
Center John Kurtz is among the character group, a known quantity in his fifth season as a professional, a guy who understands his role and is willing to stand up for the youngsters on the ice.
"Some guys aren't really cut out for coming to the rink, putting their work boots on and never getting recognition in the newspapers," said Kurtz, who figures to be among the Admirals' leaders. "The guys who are willing to do that are the guys you build a team around, ultimately. They understand that the only thing you can really control is your own attitude and how you approach the game."
That doesn't mean that they don't try to change some minds.
"Hopefully this is my year, when I can break out of just being pigeonholed as a guy who fights but who can't really play hockey," Kurtz said. "When you're only playing a couple of shifts a period, you have to try to make an impact some way. For me it was dropping the gloves."
Lest anyone think that the character players have limited value, remember that Steckel and Kurtz were called up by the Ducks last season.
"For a team to be successful in a Stanley Cup run, they'll use between 36 and 40 players over the course of the season," Ferguson said. Sometimes when you need a guy, leaving a top prospect in the AHL to continue playing a lot, playing on the power play or penalty kill makes more sense.
"That next core of (character) guys can become valuable then," Ferguson added. "Maybe you want to send up a guy to play on the fourth line, but keep (your prospect) here because he gets more out of playing 22 minutes here than playing on the fourth line" with Anaheim.
The final peg of the roster stool goes to guys like winger Norm Ezekiel: a free agent in search of a job. The difference between Ezekiel and 11 other free agents at the Admirals' camp is that he went through it a year ago, got a contract and played 25 games with Norfolk.
"My confidence is up," Ezekiel said. "I am a veteran of this league. But it's always in the back of your mind. You try and stay positive... (but) every time I'm in the rink, someone's watching, judging."
Skalde understands. Four of the free agents played for him two seasons ago in Cincinnati of the ECHL: defensemen Charles-Olivier Roussel and David McDonald, and forwards Michael Pelech and David Pacan.
"Every practice is so important, and that's the message I relay to them," Skalde said. "We have to evaluate some guys quickly, and it's very important that they put their best foot forward every day. They can't take a day off.... You don't get a pass here."
Regardless of your position on the roster.


text:
Careers Contact Close Main Menu
Mobile site search submit
FIRM PEOPLE
INSIGHTS CAREERS CONTACT
How can we be of service?
–Maria Scarfo,
Litigation & Advocacy
Real Estate & Business
Business Reorganization & Insolvency
Corporate Finance & Securities
Cyber, Information and Privacy Risk
Election & Political Law
Fraud Investigation Recovery and Enforcement
Government Procurement & Litigation
Insurance Coverage Counsel
International Trade and Business
Media and Entertainment Law
Police Liability
Start or defend a lawsuit
Resolve a business dispute
Finance a project / Access capital
Insurance matters
Develop land
Employment and Labour issues
Deal with immigration issues
Family Separations
Wills or estates issues
Protect your ideas
Settle a dispute
Careers Contact Open Main Menu
Insights Social News
Sheldon Inkol Successful at the Court of Appeal November 29, 2019
Lexpert/ROB Special Edition on Canada's Leading Litigation Lawyers 2019 October 30, 2019
John Polyzogopoulos Recognized by Lexology as a Legal Influencer for Dispute Resolution in Canada October 01, 2019
Varoujan Arman Successful at the Court of Appeal
July 19, 2017 DOWNLOAD PDF
Government of Canada Amends the Citizenship Act
Original Newsletter(s) this article was published in: Blaneys on Immigration: July 2017
On June 19, 2017, Bill C-6, which proposed numerous amendments to the Canadian Citizenship Act, (R.S.C., 1985, c. C-29), received Royal Assent. Bill C-6 attempts to reverse many of the changes contained in the Strengthening Canadian Citizenship Act (the "2014 Act"), which was enacted by the former Conservative Government back in 2014.
Many of the amendments described in Bill C-6 came into effect immediately on June 1, 2017. However, some changes are expected to come into effect later this year. Other changes are expected to come into effect in 2018.
A summary of the key provisions contained in Bill C-6, and their effective dates, appears below.
Revocation of Canadian Citizenship for Reasons of National Security
Prior to Bill C-6, dual citizens who engaged in certain actions contrary to national security, while holding Canadian citizenship, could have their Canadian citizenship revoked. This included convictions for treason, spying, and terrorism offences (depending on the sentence received), and being part of an armed force of a country or organized group engaged in conflict with Canada [Subsection 10(1)]. This provision has now been repealed, effective June 19, 2017.
Intention to Reside in Canada No Longer a Requirement
Prior to Bill C-6, applicants for Canadian citizenship were required to demonstrate that they intended to reside in Canada, if their application was granted [Paragraph 5(1)(c.1)]. This provision has now been repealed, effective June 19, 2017.
Repeal of Minimum Age for Naturalization
Prior to Bill C-6, minors (persons under the age of 18) could not apply to naturalize as a Canadian citizen [Paragraph 5(1)(b)]. However, the Minister of Immigration, Refugees, and Citizenship still had the discretion to waive the requirement, based on compassionate grounds [Paragraph 5(3)(b)].
The age requirement for citizenship has now been repealed, as of June 19, 2017. Minors may now apply to naturalize as Canadian citizens without requiring discretionary relief.
Reduction in the Required Period of Physical Presence
Prior to Bill C-6, in order to naturalize as Canadian citizens, applicants had to be physically present in Canada for 1,460 days (four years) during the preceding six years, be physically present in Canada at least 183 days during each of at least four calendar years, and to have filed at least four income tax returns during the preceding six years [Paragraph 5(1)(c)].
Under Bill C-6, applicants will only need to be physically present in Canada for at least 1,095 days (three years) out of the preceding five years. They must also have filed at least three income tax returns (instead of four) during the preceding five years. There is no longer a requirement that applicants spend at least 183 days during each eligible calendar year.
This amendment is expected to come into effect later this year.
Limiting the Requirement to Demonstrate Knowledge of Canada and its Official Languages
Prior to Bill C-6, applicants for naturalization who were between the ages of 18 and 64 were required to demonstrate an adequate knowledge of: (1) Canada and of the responsibilities and privileges of citizenship [Subsection 5(d)], and (2) one of Canada's official languages [Subsection 5(e)].
Under Bill C-6, this requirement will only apply to applicants between the ages of 18 and 54. This reinstates the applicable age that was in place prior to the 2014 Act.
Counting Time Spent in Canada Prior to Obtaining Permanent Residence
Prior to Bill C-6, time spent in Canada prior to becoming a permanent resident did not count towards the physical presence requirement for Canadian citizenship [Paragraph 5(1)(c)].
Under Bill C-6, for every day that an applicant was physically present in Canada as a temporary resident or a protected person before becoming a permanent resident of Canada will be counted as half a day of physical presence for the purposes of citizenship, up to a maximum of 365 days. This more or less reinstates the method of calculation used prior to the 2014 Act.
Authority to Seize Fraudulent or Improperly Obtained Documents
Prior to Bill C-6, there was no express authority for citizenship officers to seize fraudulently or improperly obtained documents provided in connection with the Citizenship Act.
Under Bill C-6, citizenship officers will be able to seize any document provided in connection with the Citizenship Act, if they have reason to believe that it was fraudulently or improperly obtained or used, or if it is necessary to prevent its fraudulent or improper use. This amendment is expected to come into effect in 2018.
Federal Court to Adjudicate All Revocation Cases
Prior to Bill C-6, the Minister of Immigration, Refugees and Citizenship Canada had the authority to revoke a person's citizenship or renunciation of citizenship if they obtained, retained, renounced or resumed their citizenship by false representation or fraud or by knowingly concealing material circumstances [Subsection 10(1)]. The Federal Court had jurisdiction to adjudicate such cases only where they involved security grounds, human or international right violations, and organized criminality [Subsection 10.1(1)].
Under Bill C-6, the Federal Court will have jurisdiction to adjudicate all revocation cases, unless the individual requests that the Minister of Immigration, Refugees and Citizenship make the decision. This amendment is expected to come into effect in 2018.
While Bill C-6 does not represent a complete repeal of the 2014 Act, it eases many of the key eligibility requirements for citizenship, including the physical presence requirement and the requirement to demonstrate knowledge of Canada and its official languages. Bill C-6 also eliminates some of the more controversial elements of the 2014 Act, including the ability to revoke the Canadian citizenship of dual nationals based on national security grounds.
Member: US TAG Law ILG RMC