To: Tim Osborn <t.osborn@uea.ac.uk>

Subject: Re: reconstruction errors

Date: Thu, 31 Jul 2003 11:18:24 -0400

Tim,

Attached are the calibration residual series for experiments based on available networks

back to:

AD 1000

AD 1400

AD 1600

I can't find the one for the network back to 1820! But basically, you'll see that the

residuals are pretty red for the first 2 cases, and then not significantly red for the 3rd

case--its even a bit better for the AD 1700 and 1820 cases, but I can't seem to dig them

up. In any case, the incremental changes are modest after 1600--its pretty clear that key

predictors drop out before AD 1600, hence the redness of the residuals, and the notably

larger uncertainties farther back...

You only want to look at the first column (year) and second column (residual) of the files.

I can't even remember what the other columns are!

Let me know if that helps. Thanks,

mike

p.s. I know I probably don't need to mention this, but just to insure absolutely clarify on

this, I'm providing these for your own personal use, since you're a trusted colleague. So

please don't pass this along to others without checking w/ me first. This is the sort of

"dirty laundry" one doesn't want to fall into the hands of those who might potentially try

to distort things...

At 02:58 PM 7/31/2003 +0100, you wrote:

Thanks for the explanation, Mike. Now I see it, it looks familiar - so perhaps you've

explained it to me previously (if you have, then sorry for asking twice!).

I now understand how you compute them in theory. I have two further questions though

(sorry):

(1) how do you compute them in practise? Do you actually integrate the spectrum of the

residuals?

(2) how would I estimate an uncertainty for a particular band of time scales (e.g.

decadal to secular, f=0.0 to 0.1)? If integrating the spectrum of the residuals, I

wonder whether integrating from f=0 to f=0.02 and then f=0.02 to (e.g.) f=0.1 (note this

last limit has changed) would give me the right error for time scales of 10 years and

longer (i.e. for a 10-yr low pass filter)? The way I had planned to do this was to

assume the residuals could be modelled as a first order autoregressive process, with

lag-1 autocorrelation r1=0.0 after 1600 (essentially white) and r1=??? before 1600. Do

you know what the lag-1 autocorrelation of the residuals is for the network that goes

back to 1000 AD?

The stuff back 2000 years will be interesting, though the GCM runs we're starting to

look at go back only 500 (Hadley Centre) or 1000 (German groups), so MBH99 seems fine

for now.

Cheers

Tim

At 14:28 31/07/2003, you wrote:

Tim,

The one-sigma *total* uncertainty is determined from adding the low f and high f

components of uncertainty in quadrature. The low f and high f uncertainties aren't

uncertainties for a particular (e.g. 30 year or 40-year) running mean,they are band

integrated estimates of uncertainties (high-frequency band from f=0 to f=0.02,

low-frequency band from f=0.02 to f=0.5 cycle/year) taking into account the spectrum of

the residual variance (the broadband or "white noise" mean of which is the nominal

variance of the calibration residuals)

Alternatively, one could calculate uncertainties for a particular timescale average

using the standard deviation of the calibration residuals, and applying a square-root-N'

argument (where N' is the effective degrees of freedom in the calibration residuals). I

believed I did this at one point, and got similar results.

Let me know if this needs further clarification. Thanks,

mike

p.s. you might want to try to using Mann and Jones N. Hem if you're going back further

than AD 1000? Crowley has some EBM results now back to 0 AD, and is in the process of

comparing w/ that. SHould be interesting...

At 02:04 PM 7/31/2003 +0100, you wrote:

Hi Mike,

we've recently been making plans with Simon Tett at the Hadley Centre for comparing

model simulations with various climate reconstructions, including the MBH98 and MBH99

Northern Hemisphere temperatures. I was stressing the importance of including

uncertainty estimates in the comparison and that the error estimates should depend on

the timescale (e.g. smoothing filter or running mean) that had been applied.

I then looked at the file that I have been using for the uncertainties associated with

MBH99 (see attachment), which I must have got from you some time ago. Column 1 is year,

2 is the "raw" standard error, 3 is 2*SE.

But what are columns 4 and 5? I've been plotting column 4, labelled "1 sig (lowf)" when

plotted your smoothed reconstruction, assuming that this is the error appropriate to

low-pass filtered data. I'd also assumed that the last column "1 sig (highf)" was

appropriate to high-pass filtered data. I also noticed that the sum of the squared high

and low errors equalled the square of the raw error, which is nice.

But I've realised that I don't understand how you estimate these errors, nor what time

scale the lowf and highf cutoff uses (maybe 40-year smoothed as in the IPCC plots?).

From MBH99 it sounds like post-1600 you assume uncorrelated gaussian calibration

residuals. In which case you would expect the errors for a 40-year mean to be reduced

by sqrt(40). This doesn't seem to match the values in the attached file. Pre-1600 you

take into account that the residuals are autocorrelated (red noise rather than white),

so presumably the reduction is less than sqrt(40), but some factor (how do you compute

this?).

The reason for my questions is that I would like to (1) check whether I've been doing

the right thing in using column 4 of the attached file with your smoothed

reconstruction, and (2) I'd like to estimate the errors for a range of time scales, so I

can compare decadal means, 30-year means, 50-year means etc.

Thanks in advance for any help you can give me here.

Tim

Dr Timothy J Osborn

Climatic Research Unit

School of Environmental Sciences, University of East Anglia

Norwich NR4 7TJ, UK

e-mail: t.osborn@uea.ac.uk

phone: +44 1603 592089

fax: +44 1603 507784

web: [1]http://www.cru.uea.ac.uk/~timo/

sunclock: [2]http://www.cru.uea.ac.uk/~timo/sunclock.htm

______________________________________________________________

Professor Michael E. Mann

Department of Environmental Sciences, Clark Hall

University of Virginia

Charlottesville, VA 22903

_______________________________________________________________________

e-mail: mann@virginia.edu Phone: (434) 924-7770 FAX: (434) 982-2137

[3]http://www.evsc.virginia.edu/faculty/people/mann.shtml

Dr Timothy J Osborn

Climatic Research Unit

School of Environmental Sciences, University of East Anglia

Norwich NR4 7TJ, UK

e-mail: t.osborn@uea.ac.uk

phone: +44 1603 592089

fax: +44 1603 507784

web: [4]http://www.cru.uea.ac.uk/~timo/

sunclock: [5]http://www.cru.uea.ac.uk/~timo/sunclock.htm

______________________________________________________________

Professor Michael E. Mann

Department of Environmental Sciences, Clark Hall

University of Virginia

Charlottesville, VA 22903

_______________________________________________________________________

e-mail: mann@virginia.edu Phone: (434) 924-7770 FAX: (434) 982-2137

[6]http://www.evsc.virginia.edu/faculty/people/mann.shtml

Attachment Converted: "c:\documents and settings\tim osborn\my

documents\eudora\attach\nh-ad1000-resid.dat" Attachment Converted: "c:\documents and

settings\tim osborn\my documents\eudora\attach\nh-ad1400-resid.dat" Attachment Converted:

"c:\documents and settings\tim osborn\my documents\eudora\attach\nh-ad1600-resid.dat"

References

1. http://www.cru.uea.ac.uk/~timo/

2. http://www.cru.uea.ac.uk/~timo/sunclock.htm

3. http://www.evsc.virginia.edu/faculty/people/mann.shtml

4. http://www.cru.uea.ac.uk/~timo/

5. http://www.cru.uea.ac.uk/~timo/sunclock.htm

6. http://www.evsc.virginia.edu/faculty/people/mann.shtml

## No comments:

## Post a Comment