Adjusting the significance of daily climate responses in tree-ring proxies

Abstract

Correlating tree-ring parameters with daily resolved climate data is becoming increasingly common for understanding the complex relationships between tree growth and the surrounding environment. However, with an increased number of calculated correlations, there is an inherent risk of spurious significance. In this study, we present an analysis using synthetic weather and tree-ring data mimicking the statistical properties of ten real-world sites across Europe to quantify the extent to which numerous comparisons may inflate maximum correlations. Comparisons of different tree-ring proxies, considering varying overlapping period lengths and seasons, revealed 95th percentile correlation differences reaching 0.25 by chance. Using synthetic tree-ring chronologies with an assigned non-signal (r = 0.00), spurious correlations can reach statistical significance in over 60% of tests. Correlation inflation is greater when: (1) the climate-proxy relationship is weaker; (2) comparison periods are shorter; and (3) the length of seasonal windows is longer. Autocorrelation in the proxy records does not appear to have a major effect. These findings indicate that caution should be exercised when computing high numbers of correlations with limited observations. We provide tables listing correlation inflations for precipitation- and temperature-sensitive tree-ring chronologies that can inform interpretations of significance.

Keywords

Dendroclimatology / Signal–noise / Daily resolution / Significance / Uncertainty

References

[1] Anchukaitis KJ, Wilson R, Briffa KR, Büntgen U, Cook ER, D’Arrigo R, Davi N, Esper J, Frank D, Gunnarson BE, Hegerl G, Helama S, Klesse S, Krusic PJ, Linderholm HW, Myglan V, Osborn TJ, Zhang P, Rydval M, Schneider L, Schurer A, Wiles G, Zorita E. Last millennium Northern Hemisphere summer temperatures from tree rings: part II, spatially resolved reconstructions. Quat Sci Rev, 2017, 163: 1-22

[2] Benjamini Y, Hochberg Y. Controlling the false discovery rate: a practical and powerful approach to multiple testing. J R Stat Soc Ser B Methodol, 1995, 57(1): 289-300

[3] Bloomfield P. Fourier analysis of time series: an introduction, 1976, New York, John Wiley and Sons

[4] Bogachev MI, Grigoriev AA, Pyko NS, Gulin AN, Grigorieva AV, Chindyaev AS, Kayumov AR, Tishin DV. Detection and evaluation of anthropogenic impacts on natural forest ecosystems from long-term tree-ring observations. For Ecol Manag, 2024, 558 121784

[5] Bonferroni CE. Volume in Onore di Racarddo dalla Volta, 1937, Teoria statistica delle classi e calcolo delle probabilita, Universita di Firenze62

[6] Boole G. The mathematical analysis of logic, 1847, London, UK, Henderson & Spalding85

[7] Büntgen U, Urban O, Krusic PJ, Rybníček M, Kolář T, Kyncl T, Ač A, Koňasová E, Čáslavský J, Esper J, Wagner S, Saurer M, Tegel W, Dobrovolný P, Cherubini P, Reinig F, Trnka M. Recent European drought extremes beyond Common Era background variability. Nat Geosci, 2021, 14: 190-196

[8] Büntgen U, Reinig F, Verstege A, Piermattei A, Kunz M, Krusic P, Slavin P, Štěpánek P, Torbenson M, del Castillo EM, Arosio T, Kirdyanov A, Oppenheimer C, Trnka M, Palosse A, Bebchuk T, Camarero JJ, Esper J. Recent summer warming over the western Mediterranean region is unprecedented since medieval times. Glob Planet Change, 2024, 232 104336

[9] Caprio JM, Fritts HC, Holmes RL, Meko DM, Hemming DL. A Chi-square test for the association and timing of tree ring-daily weather relationships: a new technique for dendroclimatology. Tree Ring Res, 2003, 59(2): 99-113

[10] Cerrato R, Salvatore MC, Gunnarson BE, Linderholm HW, Carturan L, Brunetti M, De Blasi F, Baroni C. A Pinus cembra L. tree-ring record for late spring to late summer temperature in the Rhaetian Alps. Italy Dendrochronologia, 2019, 53: 22-31

[11] Chen J, Brissette FP, Leconte R. A daily stochastic weather generator for preserving low-frequency of climate variability. J Hydrol, 2010, 388(3–4): 480-490

[12] Chen J, Brissette FP, Leconte R. WeaGETS–a Matlab-based daily scale weather generator for generating precipitation and temperature. Procedia Environ Sci, 2012, 13: 2222-2235

[13] Chen F, Man WM, Wang SJ, Esper J, Meko D, Büntgen U, Yuan YJ, Hadad M, Hu M, Zhao XE, Roig FA, Fang OY, Chen YP, Zhang HL, Shang HM, Yu SL, Luo X, He DM, Chen FH. Southeast Asian ecological dependency on Tibetan Plateau streamflow over the last millennium. Nat Geosci, 2023, 16(12): 1151-1158

[14] Conneely KN, Boehnke M. So many correlated tests, so little time! Rapid adjustment of P values for multiple correlated tests. Am J Hum Genet, 2007, 81(6): 1158-1168

[15] Conover WJ. Practical nonparametric statistics, 19802New York, NY, USA, John Wiley466467

[16] Cook ER, Kairiukstis L. Methods of dendrochronology, 1990, New York, NY, Springer

[17] Cook ER, Peters K. The smoothing spline: a new approach to standardizing forest interior tree-ring width series for dendroclimatic studies. Tree-Ring Bulletin, 1981, 41: 45-53

[18] Cook ER, Seager R, Kushnir Y, Briffa KR, Büntgen U, Frank D, Krusic PJ, Tegel W, van der Schrier G, Andreu-Hayles L, Baillie M, Baittinger C, Bleicher N, Bonde N, Brown D, Carrer M, Cooper R, Čufar K, Dittmar C, Esper J, Griggs C, Gunnarson B, Günther B, Gutierrez E, Haneca K, Helama S, Herzig F, Heussner KU, Hofmann J, Janda P, Kontic R, Köse N, Kyncl T, Levanič T, Linderholm H, Manning S, Melvin TM, Miles D, Neuwirth B, Nicolussi K, Nola P, Panayotov M, Popa I, Rothe A, Seftigen K, Seim A, Svarva H, Svoboda M, Thun T, Timonen M, Touchan R, Trotsiuk V, Trouet V, Walder F, Ważny T, Wilson R, Zang C. Old World megadroughts and pluvials during the Common Era. Sci Adv, 2015, 1(10 e1500561

[19] Cornes RC, van der Schrier G, van den Besselaar EJM, Jones PD. An ensemble version of the E-OBS temperature and precipitation data sets. J Geophys Res Atmos, 2018, 123(17): 9391-9409

[20] Dawdy DR, Matalas NC. Te Chow V. Analysis of variance, covariance and time series (Chapter 8-III). Handbook of Applied Hydrology, 1964, United States, McGraw-Hill, New York

[21] Esper J, Cook ER, Schweingruber FH. Low-frequency signals in long tree-ring chronologies for reconstructing past temperature variability. Science, 2002, 295(5563): 2250-2253

[22] Feise RJ. Do multiple outcome measures require p-value adjustment?. BMC Med Res Methodol, 2002, 2: 8

[23] Fisher RA. On the ‘probable error’ coefficient of correlation deduced from a small sample. Metron, 1921, 1: 3-32

[24] Fritts HC. Tree rings and climate, 1976, Academic Press, London, UK, Academic Press, New York567

[25] Genovese CR, Roeder K, Wasserman L. False discovery control with p-value weighting. Biometrika, 2006, 93(3): 509-524

[26] Ghil M, Allen MR, Dettinger MD, Ide K, Kondrashov D, Mann ME, Robertson AW, Saunders A, Tian Y, Varadi F, Yiou P. Advanced spectral methods for climatic time series. Rev Geophys, 2002

[27] Helama S. Distinguishing type I and II errors in statistical tree-ring dating. Quat Geochronol, 2023, 78 101470

[28] Homfeld IK, Büntgen U, Reinig F, Torbenson MCA, Esper J. Application of RCS and signal-free RCS to tree-ring width and maximum latewood density data. Dendrochronologia, 2024, 85 126205

[29] Howard IM, Stahle DW. Tree-ring reconstruction of single-day precipitation totals over eastern Colorado. Mon Weather Rev, 2020, 148(2): 597-612

[30] Howard IM, Stahle DW, Torbenson MCA, Griffin D. The summer precipitation response of latewood tree-ring chronologies in the southwestern United States. Int J Climatol, 2021, 41(5): 2913-2933

[31] Howard IM, Stahle DW, Dettinger MD, Poulsen C, Ralph FM, Torbenson MCA, Gershunov A. A 440-year reconstruction of heavy precipitation in California from blue oak tree rings. J Hydrometeorol, 2023, 24(3): 463-477

[32] IPCC (2021) Climatic change 2021: The physical science basis. Contributions of working group i to the sixth assessment report of the intergovernmental panel on climate change. Masson-Delmotte, V., et al. (Eds.). Cambridge University Press, Cambridge, UK. https://doi.org/10.1017/9781009157896

[33] Jafari M, Ansari-Pour N. Why, when and how to adjust your P values?. Cell J, 2019, 20(4): 604-607

[34] Jevšenak J. Daily climate data reveal stronger climate-growth relationships for an extended European tree-ring network. Quat Sci Rev, 2019, 221 105868

[35] Jevšenak J. New features in the dendroTools R package: bootstrapped and partial correlation coefficients for monthly and daily climate data. Dendrochronologia, 2020, 63 125753

[36] Jevšenak J, Levanič T. dendroTools: R package for studying linear and nonlinear responses between tree-rings and daily environmental data. Dendrochronologia, 2018, 48: 32-39

[37] Karanitsch-Ackerl S, Mayer K, Gauster T, Laaha G, Holawe F, Wimmer R, Grabner M. A 400-year reconstruction of spring–summer precipitation and summer low flow from regional tree-ring chronologies in North-Eastern Austria. J Hydrol, 2019, 577 123986

[38] Lee CC, Dannenberg MP. Frequencies of multivariate air masses drive tree growth. JGR Biogeosciences, 2023, 128(3 e2022JG007064

[39] Lin MF, Lucas HCJr, Shmueli G. Research commentary—too big to fail: large samples and the p-value problem. Inf Syst Res, 2013, 24(4): 906-917

[40] Meko DM, Baisan CH. Pilot study of latewood-width of conifers as an indicator of variability of summer rainfall in the North American monsoon region. Int J Climatol, 2001, 21(6): 697-708

[41] Meko DM, Woodhouse CA. Tree-ring footprint of joint hydrologic drought in Sacramento and Upper Colorado river basins, western USA. J Hydrol, 2005, 308(1–4): 196-213

[42] Meko DM, Touchan R, Anchukaitis KJ. Seascorr: a MATLAB program for identifying the seasonal climate signal in an annual tree-ring time series. Comput Geosci, 2011, 37(9): 1234-1241

[43] Menne MJ, Williams CNJr, Vose RS. United States historical climatology network daily temperature, precipitation, and snow data. Carbon Dioxide Information Analysis Center, 2015, Oak Ridge, United States, Oak Ridge National Laboratory

[44] Moran MD. Arguments for rejecting the sequential Bonferroni in ecological studies. Oikos, 2003, 100(2): 403-405

[45] Nakagawa S. A farewell to Bonferroni: the problems of low statistical power and publication bias. Behav Ecol, 2004, 15(6): 1044-1045

[46] Peres-Neto PR. How many statistical tests are too many? The problem of conducting multiple ecological inferences revisited. Mar Ecol Prog Ser, 1999, 176: 303-306

[47] Pompa-García M, Camarero JJ, Colangelo M, González-Cásares M. Inter and intra-annual links between climate, tree growth and NDVI: improving the resolution of drought proxies in conifer forests. Int J Biometeorol, 2021, 65(12): 2111-2121

[48] Rydval M, Gunnarson BE, Loader NJ, Cook ER, Druckenbrod DL, Wilson R. Spatial reconstruction of Scottish summer temperatures from tree rings. Int J Climatol, 2017, 37(3): 1540-1556

[49] Schweingruber F. Tree rings: basics and applications of dendrochronology, 1988, Bern, Switzerland, Paul Haupt

[50] Šidák Z. Rectangular confidence regions for the means of multivariate normal distributions. J Am Stat Assoc, 1967, 62(318): 626-633

[51] Sokal RR, Rohlf FJ. Biometry: the principles and practices of statistics in biological research, 19812New York, United States, W.H. Freeman and Company

[52] St George S, Ault TR. Is energetic decadal variability a stable feature of the central Pacific Coast’s winter climate?. J Geophys Res, 2011, 116(D12): D12102

[53] St George S, Ault TR. The imprint of climate within Northern Hemisphere trees. Quat Sci Rev, 2014, 89: 1-4

[54] Stahle DW, Cook ER, Burnette DJ, Torbenson MCA, Howard IM, Griffin D, Diaz JV, Cook BI, Williams AP, Watson E, Sauchyn DJ, Pederson N, Woodhouse CA, Pederson GT, Meko D, Coulthard B, Crawford CJ. Dynamics, variability, and change in seasonal precipitation reconstructions for North America. J Clim, 2020, 33(83173-3195

[55] Tejedor E, Saz MA, Esper J, Cuadrat JM, de Luis M. Summer drought reconstruction in northeastern Spain inferred from a tree ring latewood network since 1734. Geophys Res Lett, 2017, 44(16): 8492-8500

[56] Torbenson MCA, Stahle DW, Villanueva Díaz J, Cook ER, Griffin D. The relationship between earlywood and latewood ring-growth across North America. Tree Ring Res, 2016, 72(2): 53-66

[57] Torbenson MCA, Brázdil R, Stagge JH, Esper J, Büntgen U, Vizina A, Hanel M, Rakovec O, Fischer M, Urban O, Treml V, Reinig F, Martinez Del Castillo E, Rybníček M, Kolář T, Trnka M. Increasing volatility of reconstructed Morava River warm-season flow. Czech Republic J Hydrol Reg Stud, 2023, 50 101534

[58] Torbenson MCA, Büntgen U, Esper J, Urban O, Balek J, Reinig F, Krusic PJ, Martinez del Castillo E, Brázdil R, Semerádová D, Štěpánek P, Pernicová N, Kolář T, Rybníček M, Koňasová E, Arbelaez J, Trnka M. Central European agroclimate over the past 2000 years. J Clim, 2023, 36(13): 4429-4441

[59] Touchan R, Anchukaitis KJ, Shishov VV, Sivrikaya F, Attieh J, Ketmen M, Stephan J, Mitsopoulos I, Christou A, Meko DM. Spatial patterns of eastern Mediterranean climate influence on tree growth. Holocene, 2014, 24(4): 381-392

[60] Touchan R, Anchukaitis KJ, Meko DM, Kerchouche D, Slimani S, Ilmen R, Hasnaoui F, Guibal F, Julio Camarero J, Sánchez-Salguero R, Piermattei A, Sesbou A, Cook BI, Sabir M, Touchane H. Climate controls on tree growth in the Western Mediterranean. Holocene, 2017, 27(10): 1429-1442

[61] Unterholzner L, Castagneri D, Cerrato R, Știrbu MI, Roibu CC, Carrer M. Climate response of a glacial relict conifer across its distribution range is invariant in space but not in time. Sci Total Environ, 2024, 906 167512

[62] Urban O, Ač A, Kolář T, Rybníček M, Pernicová N, Koňasová E, Trnka M, Büntgen U. The dendroclimatic value of oak stable isotopes. Dendrochronologia, 2021, 65 125804

[63] Vautard R, Yiou P, Ghil M. Singular-spectrum analysis: a toolkit for short, noisy chaotic signals. Phys D Nonlinear Phenom, 1992, 58(1–4): 95-126

[64] Wasserstein RL, Lazar NA. The ASA statement on p-values: context, process, and purpose. Am Stat, 2016, 70(2): 129-133

[65] Wise EK, Dannenberg MP. Climate factors leading to asymmetric extreme capture in the tree-ring record. Geophys Res Lett, 2019, 46(6): 3408-3416

[66] Woodhouse CA, Meko D. Number of winter precipitation days reconstructed from southwestern tree rings. J Climate, 1997, 10(10): 2663-2669

[67] Woodhouse CA, Stahle DW, Villanueva Díaz J. Rio Grande and Rio Conchos water supply variability over the past 500 years. Clim Res, 2012, 51(2): 147-158

[68] Yang B, He MH, Shishov V, Tychkov I, Vaganov E, Rossi S, Ljungqvist FC, Bräuning A, Grießinger J. New perspective on spring vegetation phenology and global climate change based on Tibetan Plateau tree-ring data. Proc Natl Acad Sci USA, 2017, 114(27): 6966-6971

[69] Yuan YJ, Jin LY, Shao XM, He Q, Li ZZ, Li JF. Variations of the spring precipitation day numbers reconstructed from tree rings in the Urumqi River drainage, Tianshan Mts. over the last 370 years. Chin Sci Bull, 2003, 48(14): 1507-1510

[70] Zhao SD, Pederson N, D’Orangeville L, HilleRisLambers J, Boose E, Penone C, Bauer B, Jiang Y, Manzanedo R. The international tree-ring data bank (ITRDB) revisited: data availability and global ecological representativity. J Biogeogr, 2019, 46(2): 355-368

[71] Ziaco E, Liang EY. New perspectives on sub-seasonal xylem anatomical responses to climatic variability. Trees, 2019, 33(4): 973-975

[72] Zuur AF, Ieno EN, Elphick CS. A protocol for data exploration to avoid common statistical problems. Meth Ecol Evol, 2010, 1(1): 3-14

Funding

Johannes Gutenberg-Universität Mainz (1030)

RIGHTS & PERMISSIONS

The Author(s)