Next Generation Network Evolution

Next Generation Network Evaluation
June 2010

Produced by: Innovations for Scaling Impact and Keystone Accountability With generous support from the International Development Research Center and the Packard Foundation

For questions and/or comments on this paper please contact Catrina Lucero at [e-mail]

Table of Contents

PURPOSE INTRODUCTION AND CONTEXT THE CURRENT FIELD NETWORK METRICS NETWORK TOOLS GAPS IN CURRENT PRACTICE NETWORK THEORIES OF CHANGE NETWORKS AS COMPLICATED AND COMPLEX INITIATIVES CHALLENGES OF NETWORK MONITORING AND EVALUATION NETWORKS ARE COMPLICATED NETWORKS ARE COMPLEX NETWORK IPARL SYSTEMS ARTICULATING A NETWORK THEORY OF CHANGE EXPLICATING NETWORK MEMBERS’ THEORIES OF ACTION DEVELOPING AN INTEGRATED ASSESSMENT FRAMEWORK DEVELOPING STAKEHOLDER, PUBLIC AND DONOR REPORTING PROCESSES CONTINUOUS LEARNING AND IMPROVEMENT MECHANISMS IMPLEMENTING AN IPARL SYSTEM THROUGH THE NETWORK LIFE CYCLE CATALYZING LAUNCHING ENHANCING AND EXPANDING TRANSFORMING CHALLENGES OF NETWORK IPARL NETWORK IPARL CASES THE GLOBAL KNOWLEDGE PARTNERSHIP THE GLOBAL PARTNERSHIP FOR THE PREVENTION OF ARMED CONFLICT THE GLOBAL AIDS ALLIANCE AND ITS CAMPAIGN TO END PEDIATRIC HIV/AIDS REFERENCES

3 3 4 4 13 24 24 26 28 28 29 31 31 32 32 33 34 34 35 35 35 36 34 37 39 42 48

For questions and/or comments on this paper please contact Catrina Lucero at [e-mail]

2

Purpose This paper reviews the current field of network monitoring and evaluation with the goal of identifying where progress has been made and where further work is still needed. It proposes a framework for network impacts planning, assessment, reporting and learning that can help to close some of the current gaps in network evaluation while building on the advances that have been made. This document is written for practitioners undertaking network evaluation and foundation program staff working to support networks. Introduction and Context Networking and networks

References: Allee, Verna. And Schwabe, Oliver., 2009. "Measuring the Impact of Research Networks in the EU: Value Networks and Intellectual Capital Formation." Paper presented at the European Conference on Intellectual Capital. Haarlem, The Netherlands. April 28-29. Bender-demoll, Skye., 2008. "Potential Human Rights Uses of Network Analysis and Mapping: A Report to the Science and Human Rights Program of the American Association for the Advancement of Science." Creech, Heather., 2001. “Measuring while you manage: Planning, monitoring and evaluating knowledge networks.” IISD. Creech, Heather., Ramji, Aly., 2004. "Knowledge Networks: Guidelines for Assessment." IISD Working paper. Creeh, Heather. Willard, Terri., 2001. "Strategic Intentions: Managing knowledge Networks For Sustainable Development." Chapter 6: Measure while you manage: Planning, monitoring and evaluating knowledge networks. International Institute for Sustainable Development. Cross et al. 2009. "Using Mixed-Method Design and Network Analysis. American Journal of Evaluation. August 24. 2009. Sage Publications. Davies, Rick., 2003. “Mapping the Ecology of Ideas: Social Network Analysis And the Evaluation of Networks.” An Ideas Paper (Draft) Davis, Rick., 2004. " Scale, Complexity and the Representation of Theories of Change." Evaluation 10;101 Douthwaite, B., T. Kuby, E. van de Fliert and S. Schulz. (2003). Impact Pathway Evaluation: An approach for achieving and attributing impact in complex systems. Agricultural Systems 78 pp243-265 Douthwaite, Boru., Alvarez, Sophie., Thiele, Graham., Mackay, Ronald. "Participatory Impact Pathways Analysis: A Practical Method for Project Planning and Evaluation." Institutional Learning and Change Initiative Briefing Paper. Eoyang, Glenda. And Berkas, Thomas., 1998. "Evaluation in a Complex Adaptive System" Holley, June., 2007. "Mapping the positive deviance MRSA prevention networks at the VA Pittsburgh healthcare system acute care and long-term care facility." Holley, June., 2007. "Networks and Evaluation." For questions and/or comments on this paper please contact Catrina Lucero at [e-mail] 48 Horelli, Liisa., 2009. "Network Evaluation from the everyday life perspective: A tool for capacity-building and voice." Evaluation, April 2009, Vol. 15 Issue 2, p205-223. Khagram, Sanjeev. and Thomas, Craig. with Lucero, Catrina. and Mathes, Subarna., 2009. “Evidence for Development Effectiveness.” Journal of Development Effectiveness. 1(3), 247270. Krebs, Vakdus. and Holley, June., 2006. "Building Smart Communities through Network Weaving." Lock Lee, Laurence. and Kjaer, Cai. 'The Partnership Scorecard." Optimice Pty Ltd. Www.optimice.com.au Mason, Paul. and Barnes, Marian., 2007. "Constructing Theories of Change: Methods and Sources." Evaluation. Vol 13 (2): 151-170. Mayne, John. "Contribution Analysis: An Approach to exploring cause and effect." Institutional Learning and Change Initiative Briefing Paper. Mendizabal, Enrique., 2006. "Understanding Networks: The Functions of Research Policy Networks." Overseas Development Institute Working Paper 271. London. Monitor Institute. 2009. “Networks and Evaluation 101.” A presentation to the Network of Network Funders. San Francisco, CA. October 14-15. Plastrik, Peter and Madeleine, Taylor., 2006. "NET GAINS: A Handbook for Network Builders Seeking Social Change" Version 1.0 Provan, Keith G. and Brinton Milward. 1995. “A Preliminary Theory of Inter-organizational Network Effectiveness: A Comparative Study of Four Community Mental Health Systems” Administrative Science Quarterly 40. 1-33. Provan, Keith. and Milward, Brinton., 2001. "Do Networks Really Work?" Public Administration Review. July/August. 2001. Vol. 61, No. 4. Ramalingam, Ben. and Mendizabal, Enrique. and Schenkenberg Van Mierop, Ed., 2008. "Strengthening Humanitarian Networks: Applying the Network Function Approach." Oversees Development Institute Background Note. Rogers, Patricia., 2008. “Using program theory to evaluate complicated and complex aspects of interventions.” Evaluation. 2008 14: 29-48. Stame, Nicoletta. 2004. "Theory based evaluation and types of complexity." Evaluation. 2004. 10;58. For questions and/or comments on this paper please contact Catrina Lucero at [e-mail] 49 Taylor-Powell, Ellen. And Rossing, Boyd. "Evaluating Collaboration: Challenges and Methods."http://danr.ucop.edu/eee-aea/rossing.html Wilson-Grau, Ricardo. And Nuñez, Martha., 2006. "Evaluating International Social Change Networks." Draft to be publishes in Development in Practice. For questions and/or comments on this paper please contact Catrina Lucero at [e-mail] 50