Deriving evaluation indicators for knowledge transfer and dialogue processes in the context of climate research
Renate Treffeisen
CORRESPONDING AUTHOR
Alfred Wegener Institute Helmholtz Centre for Polar and Marine
Research, 27570 Bremerhaven, Germany
Klaus Grosfeld
Alfred Wegener Institute Helmholtz Centre for Polar and Marine
Research, 27570 Bremerhaven, Germany
Franziska Kuhlmann
Alfred Wegener Institute Helmholtz Centre for Polar and Marine
Research, 27570 Bremerhaven, Germany
Related authors
Monica Ionita, Klaus Grosfeld, Patrick Scholz, Renate Treffeisen, and Gerrit Lohmann
Earth Syst. Dynam., 10, 189–203, https://doi.org/10.5194/esd-10-189-2019, https://doi.org/10.5194/esd-10-189-2019, 2019
Short summary
Short summary
Based on a simple statistical model we show that the September sea ice extent has a high predictive skill, up to 4 months ahead, based on previous months' oceanic and atmospheric conditions. Our statistical model skillfully captures the interannual variability of the September sea ice extent and could provide a valuable tool for identifying relevant regions and oceanic and atmospheric parameters that are important for the sea ice development in the Arctic.
Monica Ionita, Patrick Scholz, Klaus Grosfeld, and Renate Treffeisen
Earth Syst. Dynam., 9, 939–954, https://doi.org/10.5194/esd-9-939-2018, https://doi.org/10.5194/esd-9-939-2018, 2018
Short summary
Short summary
In austral spring 2016 the Antarctic region experienced anomalous sea ice retreat in all sectors, with sea ice extent in October and November 2016 being the lowest in the Southern Hemisphere over the observational record (1979–present). The extreme sea ice retreat was accompanied by the wettest and warmest spring on record, over large areas covering the Indian ocean, the Ross Sea, and the Weddell Sea.
Johannes Sutter, Hubertus Fischer, Klaus Grosfeld, Nanna B. Karlsson, Thomas Kleiner, Brice Van Liefferinge, and Olaf Eisen
The Cryosphere, 13, 2023–2041, https://doi.org/10.5194/tc-13-2023-2019, https://doi.org/10.5194/tc-13-2023-2019, 2019
Short summary
Short summary
The Antarctic Ice Sheet may have played an important role in moderating the transition between warm and cold climate epochs over the last million years. We find that the Antarctic Ice Sheet grew considerably about 0.9 Myr ago, a time when ice-age–warm-age cycles changed from a
40 000 to a 100 000 year periodicity. Our findings also suggest that ice as old as 1.5 Myr still exists at the bottom of the East Antarctic Ice Sheet despite the major climate reorganisations in the past.
Monica Ionita, Klaus Grosfeld, Patrick Scholz, Renate Treffeisen, and Gerrit Lohmann
Earth Syst. Dynam., 10, 189–203, https://doi.org/10.5194/esd-10-189-2019, https://doi.org/10.5194/esd-10-189-2019, 2019
Short summary
Short summary
Based on a simple statistical model we show that the September sea ice extent has a high predictive skill, up to 4 months ahead, based on previous months' oceanic and atmospheric conditions. Our statistical model skillfully captures the interannual variability of the September sea ice extent and could provide a valuable tool for identifying relevant regions and oceanic and atmospheric parameters that are important for the sea ice development in the Arctic.
Monica Ionita, Patrick Scholz, Klaus Grosfeld, and Renate Treffeisen
Earth Syst. Dynam., 9, 939–954, https://doi.org/10.5194/esd-9-939-2018, https://doi.org/10.5194/esd-9-939-2018, 2018
Short summary
Short summary
In austral spring 2016 the Antarctic region experienced anomalous sea ice retreat in all sectors, with sea ice extent in October and November 2016 being the lowest in the Southern Hemisphere over the observational record (1979–present). The extreme sea ice retreat was accompanied by the wettest and warmest spring on record, over large areas covering the Indian ocean, the Ross Sea, and the Weddell Sea.
S. Goeller, V. Helm, M. Thoma, and K. Grosfeld
The Cryosphere Discuss., https://doi.org/10.5194/tcd-9-3995-2015, https://doi.org/10.5194/tcd-9-3995-2015, 2015
Revised manuscript has not been submitted
Short summary
Short summary
The Ross Ice Streams in West Antarctica showed a high variability in the past. We model basal water pathways and catchment areas for present and future ice sheet geometries (gained by applying satellite-derived elevation change rates) in this sector. Thus, we can explain the current ice stream configuration and estimate implications for the next two centuries, where we find that a major basal hydraulic tributary of the Kamb and Whillans IS could be redirected underneath the Bindschadler IS.
D. Barbi, G. Lohmann, K. Grosfeld, and M. Thoma
Geosci. Model Dev., 7, 2003–2013, https://doi.org/10.5194/gmd-7-2003-2014, https://doi.org/10.5194/gmd-7-2003-2014, 2014
T. Goelles, K. Grosfeld, and G. Lohmann
Geosci. Model Dev., 7, 1395–1408, https://doi.org/10.5194/gmd-7-1395-2014, https://doi.org/10.5194/gmd-7-1395-2014, 2014
M. Thoma, K. Grosfeld, D. Barbi, J. Determann, S. Goeller, C. Mayer, and F. Pattyn
Geosci. Model Dev., 7, 1–21, https://doi.org/10.5194/gmd-7-1-2014, https://doi.org/10.5194/gmd-7-1-2014, 2014
S. Goeller, M. Thoma, K. Grosfeld, and H. Miller
The Cryosphere, 7, 1095–1106, https://doi.org/10.5194/tc-7-1095-2013, https://doi.org/10.5194/tc-7-1095-2013, 2013
Cited articles
Arnott J. C., Moser S. C., and Goodrich, K. A.: Evaluation that counts: A review of climate change adaption indicators & metrics using lessons from effective evaluation and science-practice interaction, Environ. Sci. Policy, 66, 383–392, https://doi.org/10.1016/j.envsci.2016.06.017, 2016.
Becker, K. L. and Renger, R.: Suggested guidelines for writing reflective case narratives structure and indicators, Am. J. Eval., 38, 138–150, https://doi.org/10.1177/1098214016664025, 2017.
Blotevogel, H. H. and Wiegand, T. W.: Zur Evaluation von Wissensgenerierung und Wissenstransfer in der Akademie für Raumforschung und Landesplanung (ARL) – Leibniz-Forum für Raumwissenschaften, Raumforschung Raumordnung, 73, 155-165, https://doi.org/10.1007/s13147-015-0346-7, 2015.
Bornmann, L. and Marx, W.: How should the societal impact of research be generated and measured? A proposal for a simple and practicable approach to allow interdisciplinary comparisons, Scientometrics, 98, 211–219, https://doi.org/10.1007/s11192-013-1020-x, 2013.
Brereton, F., O Neill, E., and Dunne, L.: Towards measuring societal impact of research: Insights from an Irish case study, Irish Journal of Sociology, 25, 150–173, https://doi.org/10.1177/0791603517702160, 2017.
Constantino, T. E. and Greene, J. C.: Reflections on the use of narrative in evaluation, Am. J. Eval., 24, 35–49, 2003.
Crawford, C., Dytham, S., and Naylor, R.: Improving the evaluation of outreach, Office for fair access: Interview Report, June, available at: https://www.offa.org.uk/wp-content/uploads/2017/06/OFFA-Interview-report.pdf, last access: 5 October 2017.
Doran, G. T.: There's a S.M.A.R.T. way to write management's goals and objectives, Management Review, AMA FORUM, 70, 35–36, available at: http://community.mis.temple.edu/mis0855002fall2015/files/2015/10/S.M.A.R.T-Way-Management-Review.pdf (last access: 5 October 2017), 1981.
EC: (European Commission), Commission staff working document, Launching the EU International Cooperation and Development Results Framework, Brussels, SWD, 80 final, available at: https://ec.europa.eu/europeaid/sites/devco/files/swd-2015-80-f1-staff-working-paper-v3-p1-805238_en_0.pdf (last access: 5 October 2017), 2015.
Ellen, M. and Brown, A.: Transferring research from researchers to knowledge users: the importance of relationships and getting them right, J. Health Serv. Res. Po., 21, 134–136, https://doi.org/10.1177/1355819615602030, 2016.
Grosfeld, K., Lemke, P., Braesicke, P., Brauer, A., Dethloff, K., Kunz, M., Latif, M., Ratter, B. M., Sachs, T., Schmidt, H. P., Treffeisen, R., and Schwarze, R.: The Helmholtz Regional Climate Initiative REKLIM from a Polar Perspective – a Preface, Polarforschung, Alfred Wegener Institute for Polar and Marine Research & German Society of Polar Research, Bremerhaven, 85, 65–68, https://doi.org/10.2312/polfor.2016.001, 2016a.
Grosfeld, K., Treffeisen, R., Asseng, J., Bartsch, A., Bräuer, B., Fritzsch, B., Gerdes, R., Hendricks, S., Hiller, W., Heygster, G., Krumpen, T., Lemke, P., Melsheimer, C., Nicolaus, M., Ricker, R., and Weigelt, M.: Online sea-ice knowledge and data platform http://www.meereisportal.de, Polarforschung, Alfred Wegener Institute for Polar and Marine Research & German Society of Polar Research, Bremerhaven, 1, 143–155, https://doi.org/10.2312/polfor.2016.011, 2016b.
Haas, P. M.: Policy response to stratospheric ozone depletion, Global Environ. Chang., 85, 224–234, https://doi.org/10.1016/0959-3780(91)90044-T, 1991.
Hansjürgens, B. and Arbeitsgruppe Wissenstransfer (Helmholtzgemeinschaft): Wissenstransfer in der Helmholtz-Gemeinschaft, Konzept zur strategischen Weiterentwicklung und Stärkung – Stand der Ergebnisse, available at: https://www.helmholtz.de/fileadmin/user_upload/01_forschung/Technologietransfer/Wissenstransfer/AG_Wissenstransfer_Ergebnispapier_Dez_2016_Layout.pdf (last access: 5 October 2017), 2016.
Hubermann, M.: Linkage between researchers and practitioners: a qualitative study, Am. Educ. Res. J., 27, 363–391, https://doi.org/10.3102/00028312027002363, 1990.
IPCC: Summary for Policymakers, in: Climate Change 2013, The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, edited by: Stocker, T. F., Qin, D., Plattner, G.-K., Tignor, M., Allen, S. K., Boschung, J., Nauels, A., Xia, Y., Bex, V., and Midgley, P. M., Cambridge, United Kingdom and New York, NY, USA, 28 pp., 2013.
Julian, D. A., Jones, A., and Deyo, D.: Open system evaluation and the logical model: program planning and evaluation tools, Eval. Program Plann., 18, 333–341, https://doi.org/10.1016/0149-7189(95)00034-8, 1995.
Kirchhoff, C. J., Lemos, M. C., and Dessai, S.: Actionable knowledge for environmental decision making: broading the usability of climate science, Annu. Rev. Env. Resour., 38, 393–414, https://doi.org/10.1146/annurev-environ-022112-112828, 2013.
Lomas, J.: The in-between world of knowledge brokering, Brit. Med. J., 334, 129–131, https://doi.org/10.1136/bmj.39038.593380.AE, 2007.
Marín-Gonzílez, E., Malmusi, D., Camprubí, L., and Borrell, C.: The role of dissemination as a fundamental part of research project: lessons learned from SOPIE, Int. J. Health Serv., 47, 258–276, https://doi.org/10.1177/0020731416676227, 2017.
Meinke, I.: On the comparability of knowledge transfer activities – a case study at the German Baltic Sea Coast focusing regional climate services, Adv. Sci. Res., 14, 145–151, https://doi.org/10.5194/asr-14-145-2017, 2017.
Neij, L and Åstrand, K.: Outcome indicators for the evaluation of energy policy instruments and technical change, Energ. Policy, 34, 2662–2672, https://doi.org/10.1016/j.enpol.2005.03.012, 2006.
OECD (Organisation for Economic Co-operation and Development): Glossary of Key Terms in Evaluation and Results Based Management, available at: https://www.oecd.org/dac/evaluation/2754804.pdf (last access: 15 October 2017), 2002.
Pardoe, S.: Research Impact Unpacked? A Social Science Agenda for Critically Analyzing the Discourse of Impact and Informing Practice, SAGE Open, 4, 1–16, https://doi.org/10.1177/2158244014529774, 2014.
Rush, B. and Ogborne, A.: Program logic models: expanding their role and structure for program planning and evaluation, The Canadian Journal of Program Evaluation, 6, 95–106, 1991.
Schipper, J. W., Meinke, I., Zacharias, S., Treffeisen, R., Kottmeier, Ch., von Storch, H., and Lemke, P.: Regionale Helmholtz Klimabüros bilden bundesweites Netz, DMG Mitteilungen 1-2009, 10-12, available at: https://www.hzg.de/imperia/md/content/klimabuero/publikationen/2009_1.pdf#page=12 (last access: 15 October 2017), 2009.
Solomon, S., Ivy, D. J., Kinnison, D., Mills, M. J., Neely, R. R., and Schmidt, A.: Emergence of healing in the Antarctic ozone layer, Science, 353, 269–274, https://doi.org/10.1126/science.aae0061, 2016.
Spruijt, P., Knol, A. B., Vasileiadou, E., Devilee, J., Lebret, E., and Petersen, A. C.: Roles of scientists as policy advisers on complex issues: A literature review, Environ. Sci. Policy, 40, 16–25, https://doi.org/10.1016/j.envsci.2014.03.002, 2014.
UNDG (United Nations Development Group): Results-Based Management Handbook, Clean Draft Version, available at: http://www.un.cv/files/UNDG RBM Handbook.pdf (last access: 15 October 2017), 2010.
Vasileiadoua, E., Heimeriks, G., and Petersen, A. C.: Exploring the impact of the IPCC Assessment Reports on science, Environ. Sci. Policy, 14, 1052–1061, https://doi.org/10.1016/j.envsci.2011.07.002, 2011.
von Storch, H., Emeis, K., Meinke, I., Kannen, A., Matthias, V., Ratter, B. M. W., Stanev, E., Weisse, R., and Wirtz, K.: Making coastal research useful – cases from practice, Oceanologia, 57, 3–16, https://doi.org/10.1186/s40322-015-0029-0, 2015.
Wall, T. U., Meadow, A. M., and Horganic, A.: Developing evaluation indicators to improve the process of coproducing usable climate science, Weather, Climate and Society, 9, 95–107, https://doi.org/10.1175/WCAS-D-16-0008.1, 2017.
Wholey, J. S., Hatry, H. P., and Newcomer, K. E. (Eds.): Handbook of practical program evaluation, 2nd Edn., John Wiley & Sons, United States of America, 768 pp., 2004.
W. K. Kellogg Foundation: Logic model development guide, Tech. Doc., available at: https://www.bttop.org/sites/default/files/public/W.K. Kellogg LogicModel.pdf (last access: 15 October 2017), 2004.
Short summary
Knowledge transfer and dialogue processes (KT) in the field of climate science have captured intensive attention. This paper aims to serve as an input to stimulate further reflection on the field of evaluation of KT in the context of climate sciences. We carry out an analysis of three example activities and derive a set of indicators for measuring the output/outcome by balancing the wide diversity and range of activity contents as well as the different tools to realize them.
Knowledge transfer and dialogue processes (KT) in the field of climate science have captured...