Mission

The Model Diagnostics Task Force is constituted to develop, coordinate, and implement process-based model evaluation metrics and a metrics framework in National modeling center metrics packages, leveraging ongoing efforts at the modeling centers toward advancing model evaluation and development capabilities.

This Task Force is constituted of researchers whose projects were successfully evaluated as part of the FY15 competition held by NOAA’s Modeling, Analysis, Predictions, and Projections program on the topic of Process Oriented Metrics. This competition was motivated by a number of factors, including community interest in moving beyond performanceoriented metrics toward processoriented metrics, ongoing efforts to develop next-generation climate and Earth system models, evolving plans for CMIP, and a need to link model development and evaluation efforts across modeling centers. Nine projects were selected as a result of the competitive process, including eight focused on developing metrics and one that will develop metrics as well as define a direction and framework for the overall effort.

Task Force Function and Implementation

This Task Force will initiate its activities in October 2015 and will have a duration of three years. It is expected that researchers who were selected through the NOAA competitive process will participate actively in this Task Force helping to build an integrative processoriented metrics framework serving NOAA and other modeling centers. Task Force membership may also include affiliates, elected by Task Force leadership, who are not supported by MAPP funding but whose expertise and work are relevant to achieving the goals of this task force. The Task Force will coordinate with other relevant ongoing diagnostic efforts including emerging community processoriented metrics efforts such as the WCRP/WGCM Metrics Panel, PCMDI’s UVCDAT effort, and the EMBRACE ESMValTool project.

The Task Force will connect all of the funded investigators and other invitees. Beyond enhancing communication between investigators, expectations of this group include contribution by the individual projects to the development and implementation of the collective effort with a focus on implementing a cohesive metrics framework, open documentation of the efforts, and a focus on maximizing the community utility of metrics and the metrics framework. It is expected the main group will have monthly teleconferences and consider inperson meetings, as appropriate.

 

As of Spring 2017, the Task Force has developed a functional Application Program Interface (API) for the metrics package, which is documented here. The linked document also describes the overall status of the effort as of April 2017. The API is python based and designed to be flexible such that metrics coded in different non-proprietary software packages can be integrated into the API.

MAPP Task Force Concept and Terms of Reference

Leadership

Lead: Eric Maloney, Colorado State University
Co-Lead: Yi Ming, NOAA Geophysical Fluid Dynamics Laboratory
Co-Lead: Andrew Gettelman, National Center for Atmospheric Research
Co-Lead: Aiguo Dai, University at Albany

Participants

Relevant MAPP Program PIs and selected additional invitees.
To view the full Participants list, please visit the Participants page.

Projects

To view the full list of Projects, please click here.

News & Events

Scientists meet to improve understanding of model errors

  • 15 June 2017
  • Number of views: 482

Scientists from around the world will meet for the fifth time to advance understanding of the causes of errors in weather and climate models. Co-organized by the Model Diagnostics Task Force (MDTF), the World Climate Research Program Working Group on Numerical Experimentation (WGNE) workshop will focus on several key themes identified by WGNE centered around processes that models currently do not represent well: atmosphere-land-ocean-cryosphere interactions, clouds and precipitation, resolution issues, teleconnections, metrics and diagnostics, and model errors in ensembles. 

In support of the metrics and diagnostics theme, the MDTF, organized by the NOAA Modeling, Analysis, Predictions, and Projections (MAPP) Program, will meet for a one-day group meeting to discuss current and future activities to better diagnose models, or determine whether or not weather and climate models produce good simulations, and if not, why they don’t. NOAA’s MAPP Program contributed to both events.

Environment and Climate Change Canada will host the workshop and MDTF meeting June 19-23 and June 24m respectively, in Montreal.

 

For more information, go to: http://collaboration.cmc.ec.gc.ca/science/rpn/wgne_wse/index-en.html   

 

Print

Name:
Email:
Subject:
Message:
x

CONTACT US

Climate Program Office
1315 East-West Hwy, Suite 1100
Silver Spring, MD 20910

CPO.webmaster@noaa.gov

ABOUT OUR ORGANIZATION

Americans’ health, security and economic wellbeing are tied to climate and weather. Every day, we see communities grappling with environmental challenges due to unusual or extreme events related to climate and weather. In 2011, the United States experienced a record high number (14) of climate- and weather-related disasters where overall costs reached or exceeded $1 billion. Combined, these events claimed 670 lives, caused more than 6,000 injuries, and cost $55 billion in damages. Businesses, policy leaders, resource managers and citizens are increasingly asking for information to help them address such challenges.