
<?xml version="1.0" encoding="UTF-8"?><!-- generator="wordpress/2.3.3" -->
<rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	>
<channel>
	<title>Comments on: Spanish Expedition</title>
	<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/</link>
	<description>"All manner of statistical analyses cheerfully undertaken."</description>
	<pubDate>Fri, 21 Nov 2008 12:18:16 +0000</pubDate>
	<generator>http://wordpress.org/?v=2.3.3</generator>
		<item>
		<title>By: Craig Moore</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2508</link>
		<dc:creator>Craig Moore</dc:creator>
		<pubDate>Fri, 11 Apr 2008 17:51:15 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2508</guid>
		<description>Roger Pielke Sr. has a very timely column on what the models really do.  http://climatesci.org/2008/04/11/real-climates-agreement-that-the-ipcc-multi-decadal-projections-are-actually-sensitivity-model-runs/</description>
		<content:encoded><![CDATA[<p>Roger Pielke Sr. has a very timely column on what the models really do.  <a href="http://climatesci.org/2008/04/11/real-climates-agreement-that-the-ipcc-multi-decadal-projections-are-actually-sensitivity-model-runs/" rel="nofollow">http://climatesci.org/2008/04/11/real-climates-agreement-that-the-ipcc-multi-decadal-projections-are-actually-sensitivity-model-runs/</a></p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Craig</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2288</link>
		<dc:creator>Craig</dc:creator>
		<pubDate>Tue, 08 Apr 2008 13:45:42 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2288</guid>
		<description>Fair points.  I agree that the fact that the models are consistently predicting overly warm temperatures is very worrying and something I'd like to know more about.  I guess I am just a little uncomfortable with making a binary choice between the models are "right" or "wrong" - it is much more complex and subtle than that.

Anyway, I look forward to reading future posts on the subject.</description>
		<content:encoded><![CDATA[<p>Fair points.  I agree that the fact that the models are consistently predicting overly warm temperatures is very worrying and something I&#8217;d like to know more about.  I guess I am just a little uncomfortable with making a binary choice between the models are &#8220;right&#8221; or &#8220;wrong&#8221; - it is much more complex and subtle than that.</p>
<p>Anyway, I look forward to reading future posts on the subject.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: thomas</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2284</link>
		<dc:creator>thomas</dc:creator>
		<pubDate>Tue, 08 Apr 2008 12:42:03 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2284</guid>
		<description>a little too late.  I read over the pdf of the Spanish talk.
I think it is impossible to measure the degree of uncertainty in the measurements.  There are cumulative uncertainties.

start first with simply measuring he temperatures

what is the accuracy of reading a thermometer?  If I have 1000 thermometers, what is the range of temperatures recorded by the thermometers in the same room?  what is the variability of thermometers produced by various manufacturers?  what is the variability of housing designs, painting of the temperature boxes, placement of the boxes and what is the delta from observed temp to actual temp?

for digital recorders, what is the hysteresis of the measurement?  what is the manufacturer's determined precision and accuracy?  how has this changed over time?

how does the statisitics of the measureing device itself vary with temperature?  is a warm reading as accurate as a cold reading?

From my own experience with lab thermometers, boiled water often reads 100.5 or 99.6.  freezing can be anywhere from 0 to 1.  with digital themistors, in the 70's these were highly slow and inaccurate within .6 degrees.  With modern cooking thermometers, they take 3 minutes to come to equilibrium and are often wrong by 2-3 degrees.

The surface temperature record as we have it is not a validated measurement.  No statistics on the recording devices as used world wide or the persons doing the observations have ever been made.  It could not be used as a validated device or method for medical research for an FDA approvable drug study.</description>
		<content:encoded><![CDATA[<p>a little too late.  I read over the pdf of the Spanish talk.<br />
I think it is impossible to measure the degree of uncertainty in the measurements.  There are cumulative uncertainties.</p>
<p>start first with simply measuring he temperatures</p>
<p>what is the accuracy of reading a thermometer?  If I have 1000 thermometers, what is the range of temperatures recorded by the thermometers in the same room?  what is the variability of thermometers produced by various manufacturers?  what is the variability of housing designs, painting of the temperature boxes, placement of the boxes and what is the delta from observed temp to actual temp?</p>
<p>for digital recorders, what is the hysteresis of the measurement?  what is the manufacturer&#8217;s determined precision and accuracy?  how has this changed over time?</p>
<p>how does the statisitics of the measureing device itself vary with temperature?  is a warm reading as accurate as a cold reading?</p>
<p>From my own experience with lab thermometers, boiled water often reads 100.5 or 99.6.  freezing can be anywhere from 0 to 1.  with digital themistors, in the 70&#8217;s these were highly slow and inaccurate within .6 degrees.  With modern cooking thermometers, they take 3 minutes to come to equilibrium and are often wrong by 2-3 degrees.</p>
<p>The surface temperature record as we have it is not a validated measurement.  No statistics on the recording devices as used world wide or the persons doing the observations have ever been made.  It could not be used as a validated device or method for medical research for an FDA approvable drug study.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Briggs</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2282</link>
		<dc:creator>Briggs</dc:creator>
		<pubDate>Tue, 08 Apr 2008 11:33:40 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2282</guid>
		<description>Craig,

Thanks very much for your explanations.  They are very well put.  The only thing I disagree with is that there is a true answer.  We might not be able to measure the truth without error, but that does not mean it does not exist.

And of course by "wrong" I mean something like Bernie implied.  If the models predict exactly what is subsequently observed, then the models are right, if they do not, they are wrong.  They may still be wrong but "close enough", but that is a separate argument.  Right now, of course, they are wrong and consistently too warm.

I will write more about this in a separate post, and I may steal some of your comments.

Again, thanks.

Briggs</description>
		<content:encoded><![CDATA[<p>Craig,</p>
<p>Thanks very much for your explanations.  They are very well put.  The only thing I disagree with is that there is a true answer.  We might not be able to measure the truth without error, but that does not mean it does not exist.</p>
<p>And of course by &#8220;wrong&#8221; I mean something like Bernie implied.  If the models predict exactly what is subsequently observed, then the models are right, if they do not, they are wrong.  They may still be wrong but &#8220;close enough&#8221;, but that is a separate argument.  Right now, of course, they are wrong and consistently too warm.</p>
<p>I will write more about this in a separate post, and I may steal some of your comments.</p>
<p>Again, thanks.</p>
<p>Briggs</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Bernie</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2252</link>
		<dc:creator>Bernie</dc:creator>
		<pubDate>Mon, 07 Apr 2008 22:00:19 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2252</guid>
		<description>Craig:
Your perspective is very helpful.  Matt can respond for himself, but I think you slightly missed his point: Since ALL the models over-predict global temperatures and because of this consistent error the models are "wrong".  I also believe Matt is using wrong in the sense that there must be a recurring error in the models rather than the models are full of errors.  I would use the term "incomplete" since it is slightly less perjorative.
The other difference is that the predictions of the models can be compared to actual observed measures - hence the over-prediction.
I am sure you are right that the models are based on a series of approximations both for theoretical and computational reasons.  My surmise is that Matt would say, "yes, of course, but there are also approximations where we do not know but do not say we do not know."  This is another of Matt's recurring themes.
Anyway, I am glad you have joined the discussion.</description>
		<content:encoded><![CDATA[<p>Craig:<br />
Your perspective is very helpful.  Matt can respond for himself, but I think you slightly missed his point: Since ALL the models over-predict global temperatures and because of this consistent error the models are &#8220;wrong&#8221;.  I also believe Matt is using wrong in the sense that there must be a recurring error in the models rather than the models are full of errors.  I would use the term &#8220;incomplete&#8221; since it is slightly less perjorative.<br />
The other difference is that the predictions of the models can be compared to actual observed measures - hence the over-prediction.<br />
I am sure you are right that the models are based on a series of approximations both for theoretical and computational reasons.  My surmise is that Matt would say, &#8220;yes, of course, but there are also approximations where we do not know but do not say we do not know.&#8221;  This is another of Matt&#8217;s recurring themes.<br />
Anyway, I am glad you have joined the discussion.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Craig</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2241</link>
		<dc:creator>Craig</dc:creator>
		<pubDate>Mon, 07 Apr 2008 19:43:08 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2241</guid>
		<description>I am astrophysics PhD student who runs numerical simulations studying galaxy dynamics.  While I have absolutely no direct experience working on climate models, nor do I have any but the faintest idea of the inputs or physics that goes into them, I am quite familiar with the similar numerical modeling techniques that are used in astrophysics calculations.  I would like to very briefly address your question of "why are there any differences between climate models?"

The systems I study are actually much simpler than any climate system.  I model the mass of galaxies as a simple N-body, collisionless, self-gravitating fluid of point masses- which means that the only relevant physics involved are Newton's laws that we all learned in high school.  Yet different gravitational codes yield slightly different answers.  The reason is that there is no analytic solution to the gravitational N-body problem - there are only numerical approximations.  

So each code has to make different assumptions on how to best approximate the result.  There is the additional constraint that the time it takes to actually perform the calculations on current computers has to be reasonably small (hopefully, less than the time it takes to earn a PhD!).  In order to decrease the computational expense, more approximations are used.  Obviously, different approximation methods will yield slightly different answers, but all should yield approximately the same result.  Since we can't measure our approximations against the "true" answer (such an answer does not exist), comparing different techniques to make sure they give similar results is the best method we have for checking our codes.

Keep in mind that the system I have described is an extraordinarily simple system.  Climate models have many more layers of complexity - and thus approximations - to deal with.  Again, there is no "true" answer against which to compare the results of simulations.

So, let me be clear about the very narrow point I am trying to make.  You are certainly correct that results from different codes are not necessarily independent pieces of evidence.  It is also worrying that the codes are not fitting independent data.  Asking why the models disagree with the data and trying to improve them is of paramount importance.  However, simply asserting that "the climate models are wrong" seems to me to be missing the point.  It does matter how wrong the models are because all we have are approximations and there is no a priori method of determining how good those approximations are.  So, the best we can do is make lots of different models using different assumptions and hope they give reasonably similar answers.  "Reasonably similar" may not seem quantitatively satisfactory, but it's the only way we have to do science.</description>
		<content:encoded><![CDATA[<p>I am astrophysics PhD student who runs numerical simulations studying galaxy dynamics.  While I have absolutely no direct experience working on climate models, nor do I have any but the faintest idea of the inputs or physics that goes into them, I am quite familiar with the similar numerical modeling techniques that are used in astrophysics calculations.  I would like to very briefly address your question of &#8220;why are there any differences between climate models?&#8221;</p>
<p>The systems I study are actually much simpler than any climate system.  I model the mass of galaxies as a simple N-body, collisionless, self-gravitating fluid of point masses- which means that the only relevant physics involved are Newton&#8217;s laws that we all learned in high school.  Yet different gravitational codes yield slightly different answers.  The reason is that there is no analytic solution to the gravitational N-body problem - there are only numerical approximations.  </p>
<p>So each code has to make different assumptions on how to best approximate the result.  There is the additional constraint that the time it takes to actually perform the calculations on current computers has to be reasonably small (hopefully, less than the time it takes to earn a PhD!).  In order to decrease the computational expense, more approximations are used.  Obviously, different approximation methods will yield slightly different answers, but all should yield approximately the same result.  Since we can&#8217;t measure our approximations against the &#8220;true&#8221; answer (such an answer does not exist), comparing different techniques to make sure they give similar results is the best method we have for checking our codes.</p>
<p>Keep in mind that the system I have described is an extraordinarily simple system.  Climate models have many more layers of complexity - and thus approximations - to deal with.  Again, there is no &#8220;true&#8221; answer against which to compare the results of simulations.</p>
<p>So, let me be clear about the very narrow point I am trying to make.  You are certainly correct that results from different codes are not necessarily independent pieces of evidence.  It is also worrying that the codes are not fitting independent data.  Asking why the models disagree with the data and trying to improve them is of paramount importance.  However, simply asserting that &#8220;the climate models are wrong&#8221; seems to me to be missing the point.  It does matter how wrong the models are because all we have are approximations and there is no a priori method of determining how good those approximations are.  So, the best we can do is make lots of different models using different assumptions and hope they give reasonably similar answers.  &#8220;Reasonably similar&#8221; may not seem quantitatively satisfactory, but it&#8217;s the only way we have to do science.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Doug</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2150</link>
		<dc:creator>Doug</dc:creator>
		<pubDate>Sun, 06 Apr 2008 00:50:04 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2150</guid>
		<description>"Professor Moreno vehemently disagreed, incorrectly using as an example the unfortunate heat wave in Spain that was responsible for a large number of deaths."

If Moreno and others of his persuasion actually had a policy that reduced the number of heat waves, then it follows the same policy will cause more cold waves. Cold causes more deaths than heat. So, in effect, Moreno is advocating a policy that causes more deaths. I don't think he is being responsible.</description>
		<content:encoded><![CDATA[<p>&#8220;Professor Moreno vehemently disagreed, incorrectly using as an example the unfortunate heat wave in Spain that was responsible for a large number of deaths.&#8221;</p>
<p>If Moreno and others of his persuasion actually had a policy that reduced the number of heat waves, then it follows the same policy will cause more cold waves. Cold causes more deaths than heat. So, in effect, Moreno is advocating a policy that causes more deaths. I don&#8217;t think he is being responsible.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Chris</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2147</link>
		<dc:creator>Chris</dc:creator>
		<pubDate>Sat, 05 Apr 2008 23:10:58 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2147</guid>
		<description>Thank you sir for the update.  My readers appreciate your insight and what really matters in the end is the content you were trying to communicate.  It's hard enough to communicate to someone even in your native language ideas and concepts that are foreign to them.  You sir help bridge that gap.

Keep up the great work.</description>
		<content:encoded><![CDATA[<p>Thank you sir for the update.  My readers appreciate your insight and what really matters in the end is the content you were trying to communicate.  It&#8217;s hard enough to communicate to someone even in your native language ideas and concepts that are foreign to them.  You sir help bridge that gap.</p>
<p>Keep up the great work.</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Briggs</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2142</link>
		<dc:creator>Briggs</dc:creator>
		<pubDate>Sat, 05 Apr 2008 21:39:32 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2142</guid>
		<description>Jorge,

Muchas gracias!  My spelling also obviously needs improvement.

Matt</description>
		<content:encoded><![CDATA[<p>Jorge,</p>
<p>Muchas gracias!  My spelling also obviously needs improvement.</p>
<p>Matt</p>
]]></content:encoded>
	</item>
	<item>
		<title>By: Alan D. McIntire</title>
		<link>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2141</link>
		<dc:creator>Alan D. McIntire</dc:creator>
		<pubDate>Sat, 05 Apr 2008 21:08:42 +0000</pubDate>
		<guid>http://wmbriggs.com/blog/2008/04/05/spanish-expedition/#comment-2141</guid>
		<description>My familiarty with statistical predictions is limited to
my experience handicapping horse races.  When models overpredict dependent data, obviously the sources of data you're combining aren't independent.

  When I considered a horse's past speed rating as one factor, and combined it with jocky performance in an esoteric formula to predict the winner, my predicted win percentage  always fell somewhat short of reality.  I'm sure that part of the reason was
that jockey performance and horse performance are not independent factors- the better jockeys tend to get first pick of the better horses - A. McIntire</description>
		<content:encoded><![CDATA[<p>My familiarty with statistical predictions is limited to<br />
my experience handicapping horse races.  When models overpredict dependent data, obviously the sources of data you&#8217;re combining aren&#8217;t independent.</p>
<p>  When I considered a horse&#8217;s past speed rating as one factor, and combined it with jocky performance in an esoteric formula to predict the winner, my predicted win percentage  always fell somewhat short of reality.  I&#8217;m sure that part of the reason was<br />
that jockey performance and horse performance are not independent factors- the better jockeys tend to get first pick of the better horses - A. McIntire</p>
]]></content:encoded>
	</item>
</channel>
</rss>

<!-- Dynamic Page Served (once) in 1.471 seconds -->
