Mission

The Model Diagnostics Task Force is constituted to develop, coordinate, and implement process-based model evaluation metrics and a metrics framework in National modeling center metrics packages, leveraging ongoing efforts at the modeling centers toward advancing model evaluation and development capabilities.

This Task Force is constituted of researchers whose projects were successfully evaluated as part of the FY15 competition held by NOAA’s Modeling, Analysis, Predictions, and Projections program on the topic of Process Oriented Metrics. This competition was motivated by a number of factors, including community interest in moving beyond performanceoriented metrics toward processoriented metrics, ongoing efforts to develop next-generation climate and Earth system models, evolving plans for CMIP, and a need to link model development and evaluation efforts across modeling centers. Nine projects were selected as a result of the competitive process, including eight focused on developing metrics and one that will develop metrics as well as define a direction and framework for the overall effort.

Task Force Function and Implementation

This Task Force will initiate its activities in October 2015 and will have a duration of three years. It is expected that researchers who were selected through the NOAA competitive process will participate actively in this Task Force helping to build an integrative processoriented metrics framework serving NOAA and other modeling centers. Task Force membership may also include affiliates, elected by Task Force leadership, who are not supported by MAPP funding but whose expertise and work are relevant to achieving the goals of this task force. The Task Force will coordinate with other relevant ongoing diagnostic efforts including emerging community processoriented metrics efforts such as the WCRP/WGCM Metrics Panel, PCMDI’s UVCDAT effort, and the EMBRACE ESMValTool project.

The Task Force will connect all of the funded investigators and other invitees. Beyond enhancing communication between investigators, expectations of this group include contribution by the individual projects to the development and implementation of the collective effort with a focus on implementing a cohesive metrics framework, open documentation of the efforts, and a focus on maximizing the community utility of metrics and the metrics framework. It is expected the main group will have monthly teleconferences and consider inperson meetings, as appropriate.

 

As of Spring 2017, the Task Force has developed a functional Application Program Interface (API) for the metrics package, which is documented here. The linked document also describes the overall status of the effort as of April 2017. The API is python based and designed to be flexible such that metrics coded in different non-proprietary software packages can be integrated into the API.

MAPP Task Force Concept and Terms of Reference

Leadership

Lead: Eric Maloney, Colorado State University
Co-Lead: Yi Ming, NOAA Geophysical Fluid Dynamics Laboratory
Co-Lead: Andrew Gettelman, National Center for Atmospheric Research
Co-Lead: Aiguo Dai, University at Albany

Participants

Relevant MAPP Program PIs and selected additional invitees.
To view the full Participants list, please visit the Participants page.

Projects

To view the full list of Projects, please click here.

News & Events

New research offers potential to predict atmospheric river activity up to 5 weeks ahead 20 February 2018

New research offers potential to predict atmospheric river activity up to 5 weeks ahead

A new study in the Nature Partner Journal Climate and Atmospheric Science describes a breakthrough in accurately predicting atmospheric river behavior several weeks ahead.

New NOAA forecast product guides 3- to 4-week temperature and precipitation outlooks 15 February 2018

New NOAA forecast product guides 3- to 4-week temperature and precipitation outlooks

Thanks to a team of scientists led by Nat Johnson, an Associate Research Scholar at NOAA’s Geophysical Fluid Dynamics Laboratory (GFDL) and the Cooperative Institute for Climate Science at Princeton University, NOAA’s forecasters at the Climate Prediction Center (CPC) now have a new tool that provides week 3-4 guidance for their precipitation outlooks, and even better guidance for their temperature outlooks — all while helping them understand what drives the weather we see several weeks from now. 
 

MAPP Newsletter: Winter 2018 Issue 1 February 2018

MAPP Newsletter: Winter 2018 Issue

See what's been happening in the MAPP community!

Check out research and program highlights, as well as MAPP Task Force updates.

MAPP-Climate Test Bed research successfully transitions towards National Weather Service operations 29 January 2018

MAPP-Climate Test Bed research successfully transitions towards National Weather Service operations

The National Weather Service (NWS) recently reviewed four NOAA Climate Test Bed (CTB) MAPP program projects to evaluate whether or not some of the new research capabilities tested during the projects are ready for operational use. The review revealed that all projects had some modeling methodologies and/or prediction tools ready to be implemented in operations or that have already officially transitioned, according to the NWS reviewers.

Global rainfall pattern could offer prediction skill three weeks out 19 January 2018

Global rainfall pattern could offer prediction skill three weeks out

A new study says that teleconnections with certain phases of a recurring tropical rainfall pattern could extend predictions up to 20-25 days in advance. The authors’ findings provide guidance on which tropical conditions might lead to improved forecasts beyond our current capability – and more time to prepare for extreme events.

RSS

CONTACT US

Climate Program Office
1315 East-West Hwy, Suite 1100
Silver Spring, MD 20910

CPO.webmaster@noaa.gov

ABOUT OUR ORGANIZATION

Americans’ health, security and economic wellbeing are tied to climate and weather. Every day, we see communities grappling with environmental challenges due to unusual or extreme events related to climate and weather. In 2011, the United States experienced a record high number (14) of climate- and weather-related disasters where overall costs reached or exceeded $1 billion. Combined, these events claimed 670 lives, caused more than 6,000 injuries, and cost $55 billion in damages. Businesses, policy leaders, resource managers and citizens are increasingly asking for information to help them address such challenges.