{"id":741,"date":"2009-07-20T09:36:39","date_gmt":"2009-07-20T13:36:39","guid":{"rendered":"http:\/\/www.easterbrook.ca\/steve\/?p=741"},"modified":"2009-07-20T09:38:43","modified_gmt":"2009-07-20T13:38:43","slug":"how-do-people-decide-which-model-to-use","status":"publish","type":"post","link":"http:\/\/www.easterbrook.ca\/steve\/2009\/07\/how-do-people-decide-which-model-to-use\/","title":{"rendered":"How do people decide which model to use?"},"content":{"rendered":"<p>In our climate brainstorming session last week, we invited two postdocs (<a title=\"Chris Fletcher's home page\" href=\"http:\/\/www.atmosp.physics.utoronto.ca\/people\/cgf\/\" target=\"_blank\">Chris<\/a> and <a title=\"Lawrence Mudryk's page\" href=\"http:\/\/www.atmosp.physics.utoronto.ca\/~mudryk\/\" target=\"_blank\">Lawrence<\/a>) from the atmospheric physics group to come and talk to us about their experiences of using climate models. Most of the discussion focussed on <a title=\"My post with links to most of the major climate models\" href=\"http:\/\/www.easterbrook.ca\/steve\/?p=667\" target=\"_blank\">which models<\/a> they use and why, and what problems they experience. They&#8217;ve been using the <a title=\"GFDL model development page\" href=\"http:\/\/gfdl.noaa.gov\/model-development\" target=\"_blank\">GFDL models<\/a>, specifically <a title=\"Source code and documentation for AM2\" href=\"http:\/\/data1.gfdl.noaa.gov\/~arl\/pubrel\/m\/am2\/doc\/\" target=\"_blank\">AM2<\/a> and <a title=\"AM3 doesn't have a public release yet\" href=\"http:\/\/gfdl.noaa.gov\/atmospheric-model\" target=\"_blank\">AM3<\/a>\u00a0(atmosphere only models) for most of their research, largely because of legacy: they&#8217;re working with <a title=\"Paul Kushner's page\" href=\"http:\/\/pjk.atmosp.physics.utoronto.ca\/\" target=\"_blank\">Paul Kushner<\/a>, who is from GFDL, \u00a0and the group now has many years experience working with these models. However, they&#8217;re now faced with having to switch to NCAR&#8217;s <a title=\"CCSM release pages\" href=\"http:\/\/www.ccsm.ucar.edu\/models\/\" target=\"_blank\">Community Climate System Model (CCSM)<\/a>. Why? Because the university has acquired a <a title=\"press release about SciNet\" href=\"http:\/\/www.artsci.utoronto.ca\/main\/supercomputer-june-09\/\" target=\"_blank\">new IBM supercomputer<\/a>, and the GFDL models won&#8217;t run on it (without a large effort to port them). The resulting dilemma reveals a lot about the current state of climate model engineering:<\/p>\n<ul>\n<li>If they stick with the GFDL models, they can&#8217;t make use of the new supercomputer, hence miss out on a great opportunity to accelerate their research (they could do many more model runs).<\/li>\n<li>If they switch to CCSM, they lose a large investment in understanding and working with the GFDL models. This includes both their knowledge of the model (some of their research involves making changes to the code to explore how\u00a0perturbations\u00a0affect the runs), and the investment in tools and scripts for dealing with model outputs, diagnostics, etc.<\/li>\n<\/ul>\n<p>Of course, the obvious solution would be to port the GFDL models to the new IBM hardware. But this turns out to be hard because the models were never designed for portability. Right now, the GFDL models won&#8217;t even compile on the IBM compiler, because of differences in how picky different compilers are over syntax and style checking &#8211; climate models tend to have many coding\u00a0idiosyncrasies\u00a0that are never fixed because the usual compiler never complains about them: e.g. see <a title=\"Jon's blog post of preliminary results of running static checkers on climate model code\" href=\"http:\/\/skoolr.blogspot.com\/2009\/07\/some-results-from-forcheck.html\" target=\"_blank\">Jon&#8217;s analysis<\/a> of static checking NASA&#8217;s modelE. And even if they fix all these and get the compiler to accept the code, they&#8217;re still faced with extensive testing to make sure the models&#8217; runtime behaviour is correct on the new hardware.<\/p>\n<p>There&#8217;s also a big difference in support available. GFDL doesn&#8217;t have the resources to support external users (particularly\u00a0ambitious\u00a0attempts to port the code). In contrast, NCAR has extensive support for the CCSM, because they have made community building an explicit goal. Hence, CCSM is much more like an open source project. Which sounds great, but it also comes at a cost. NCAR have to devote significant resources to supporting the community. And making the model open and flexible (for use by a broader community) hampers their ability to get the\u00a0latest\u00a0science into the model quickly. Which leads me to hypothesize that it is the <em>diversity<\/em> of your user-base that most restricts the ongoing <a title=\"me, on growth of the code of the Hadley Centre model\" href=\"http:\/\/www.easterbrook.ca\/steve\/?p=694\" target=\"_blank\">rate of evolution<\/a> of a software system. For a climate modeling centers like GFDL, if you don&#8217;t have to worry about developing for multiple platforms and diverse users, you can get new ideas into the model much quicker.<\/p>\n<p>Which brings me to a similar discussion over the choice of weather prediction models in the UK. Bryan recently <a title=\"Bryan's post on UM as crack cocaine (!)\" href=\"http:\/\/home.badc.rl.ac.uk\/lawrence\/blog\/2009\/07\/08\/UM_Crack_Cocaine\" target=\"_blank\">posted an article <\/a>about the choice between\u00a0<a title=\"WRF model information\" href=\"http:\/\/www.wrf-model.org\/users\/users.php\" target=\"_blank\">WRF<\/a> (NCAR&#8217;s mesoscale weather model) versus the <a title=\"UM model at the Met Office\" href=\"http:\/\/www.metoffice.gov.uk\/science\/creating\/daysahead\/nwp\/um.html\" target=\"_blank\">UM<\/a> (the UK Met Office&#8217;s model). <a title=\"Alan Gadian's pages\" href=\"http:\/\/homepages.see.leeds.ac.uk\/~lecag\/\" target=\"_blank\">Alan<\/a> posted a <a title=\"see comment #4\" href=\"http:\/\/home.badc.rl.ac.uk\/lawrence\/blog\/2009\/07\/08\/UM_Crack_Cocaine\" target=\"_blank\">lengthy response<\/a> which echoes much of what I said above (but with much more detail): basically the WRF is well supported and flexible for a diverse community. The UM has many advantages (particularly speed), but is basically unsupported outside the Met Office. He concludes that someone should re-write the UM to run on other hardware (specifically massively parallel machines), and presumably set up the kind of community support that NCAR has. But funding for this seems unlikely.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>In our climate brainstorming session last week, we invited two postdocs (Chris and Lawrence) from the atmospheric physics group to come and talk to us about their experiences of using climate models. Most of the discussion focussed on which models they use and why, and what problems they experience. They&#8217;ve been using the GFDL models, [&hellip;]<\/p>\n","protected":false},"author":392,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[10,27],"tags":[],"aioseo_notices":[],"jetpack_sharing_enabled":true,"jetpack_featured_media_url":"","_links":{"self":[{"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/posts\/741"}],"collection":[{"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/users\/392"}],"replies":[{"embeddable":true,"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/comments?post=741"}],"version-history":[{"count":4,"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/posts\/741\/revisions"}],"predecessor-version":[{"id":746,"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/posts\/741\/revisions\/746"}],"wp:attachment":[{"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/media?parent=741"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/categories?post=741"},{"taxonomy":"post_tag","embeddable":true,"href":"http:\/\/www.easterbrook.ca\/steve\/wp-json\/wp\/v2\/tags?post=741"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}