Getting Less for More: Economic Evaluation in the Social Welfare Field

Getting Less for More: Economic Evaluation in the Social Welfare Field
Tom Sefton

Contents Introduction............................................................................................................................ 1 What is economic evaluation? .............................................................................................. 2 Approaches to quantitative evaluation ............................................................................... 5 Evaluation issues in the social welfare field ....................................................................... 8 Alternative perspectives on evaluation............................................................................. 11 Way forward.......................................................................................................................... 20 References .............................................................................................................................. 28

CASEpaper 44 November 2000

Centre for Analysis of Social Exclusion London School of Economics Houghton Street London WC2A 2AE CASE enquiries – tel: [phone]

i

Centre for Analysis of Social Exclusion
The ESRC Research Centre for Analysis of Social Exclusion (CASE) was established in October 1997 with funding from the Economic and Social Research Council. It is located within the Suntory and Toyota International Centres for Economics and Related Disciplines (STICERD) at the London School of Economics and Political Science, and benefits from support from STICERD. It is directed by Howard Glennerster, John Hills, Kathleen Kiernan, Julian Le Grand, Anne Power and Carol Propper. Our Discussion Paper series is available free of charge. We also produce summaries of our research in CASEbriefs, and reports from various conferences and activities in CASEreports. To subscribe to the CASEpaper series, or for further information on the work of the Centre and our seminar series,

References: Blow, Laura and Crawford, Ian (1997), The distributional effects of taxes on private motoring, London: Institute of Fiscal Studies. Buxton, Martin J. et al (1997), ‘Modelling in economic evaluation: An unavoidable fact of life’, Health Economics 6: 217-227. Byford, S. (2000), “The Application of health economic techniques to social welfare”, unpublished manuscript. Chen, Huey-Tsyh (1990), Theory-driven Evaluations, Beverly Hills, CA: Sage. Connell, James P. (ed.) (1995), New Approaches to Evaluating Community Initiatives: concepts, methods, and contexts, Queenstown, Md: Aspen Institute. Drummond, Michael F. et al (1997), Methods for the Economic Evaluation of Health Care Programmes, Oxford; New York: Oxford University Press. Evans, Martin (1996), Giving credit where it’s due: The success of Family Credit reassessed, Welfare State Programme Discussion Paper WSP/121, London: STICERD, London School of Economics. Fraser, Neil (2000), ‘Economic Policy Analysis’, in Hills, J. and Fraser, N, (eds), Public Policy for the 21st Century: Essays in memory of Henry Neuburger, Bristol: Policy Press. Glennerster, Howard et al (1994), Implementing GP Fundolding: Wild Card or Winning Hand?, London; Bristol Pa: Open University Press. Gold, Marthe R. (1996), Cost-effectiveness in health and medicine, New York: Oxford University Press. Guba, Egon G. and Lincoln, Yvonna S. (1989), Fourth Generation Evaluation, London: Sage. Hasluck, Chris, McKnight, Abigail and Elias, Peter (2000), Evaluation of the New Deal for Lone Parents: Early Lessons from the Phase One Prototype – Cost-benefit and Econometric Analyses, Department of Social Security Research Report No.110, Leeds: The Stationary Office. H M Treasury (1988), Policy Evaluation: A Guide for Managers, London: HMSO. 28 H M Treasury (1997), Appraisal and Evaluation in Central Government, London: HMSO. House, Ernest, R. (2000), ‘The Limits of Cost-Benefit Analysis’, Evaluation: The International Journal of Theory, Research and Practice 6(1): 79-86. Hughes, Mike and Traynor, Tish (2000), ‘Reconciling Process and Outcome in Evaluating Community Initiatives’, Evaluation: The International Journal of Theory, Research and Practice 6(1): 37-49. Julnes, George, Mark, Melvin M, and Henry, Gary T. (1999), ‘Promoting Realism in Evaluation’, Evaluation: The International Journal of Theory, Research and Practice 4(4): 483-504. Kendall, Jeremy and Knapp, Martin (2000), ‘Measuring the Performance of Voluntary Organisations’, Public Management 2:1 105-32. Knapp, Martin (1984), The Economics of Social Care, Basingstoke and London: Macmillan. Knapp, Martin (1999), ‘Economic Evaluation and Mental Health: Sparse Past…Fertile Future?’, Journal of Mental Health Policy and Economics 2(4). Knapp, Martin et al (1992), Care in the Community: Challenge and Demonstration, Aldershot: Ashgate. Kushner, Saville (1996), ‘Limits of Constructivism in Evaluation’, Evaluation: The International Journal of Theory, Research and Practice 2(2): 189-200. Martin, Steve and Sanderson, Ian (2000), ‘Evaluating Public Policy Experiments’, Evaluation: The International Journal of Theory, Research and Practice 5(3): 245-58. McDaid, David and Murray, Joanna (forthcoming), ‘Carer Burden: The Difficulties and Rewards of Caregiving’, in Warner, M. et al, Alzheimer’s Disease Policy and Practice, Oxford: Radcliffe Medical Press. Patton, Michael Q. (1996), Utilisation-focused Evaluation, Beverly Hills, CA: Sage. Pawson, Ray and Tilley, Nick (1997), Realistic Evaluation, London: Sage. Peled, Einat and Spiro, Shimon E. (1998), ‘Goal-focused Evaluation’, Evaluation: The International Journal of Theory, Research and Practice 4(4): 455-468. 29 Rossi, Peter H. and Freeman, Howard E. (1993), Evaluation: A Systematic Approach, Beverly Hills, CA: Sage. Schmid, Gunther (1997), ‘The Evaluation of Labour Market Policy: Notes on the State of the Art’, Evaluation: The International Journal of Theory, Research and Practice 3(4): 409-434. Scott, David and Weston, Ros (1998), Evaluating Health Promotion, Cheltenham: Stanley Thornes. Shaw, Ian (1997), ‘Evaluation in Health and Social Care’, Evaluation: The International Journal of Theory, Research and Practice 3(4): 469-480. Stinnett, A. et al (1996), ‘The cost-effectiveness of dietary and pharmacological therapy for cholesterol reduction in adults’, in Gold, M. et al Cost-effectiveness in Health and Medicine, New York: Oxford University Press. Stockdale, Janet E, Gresham, Peter J, and Whitehead, Christine M.E. (1999), Applying Economic Evaluation to Policing Activity, Policy Research Series Paper 103, London: Home Office. White, Michael and Lakey, Jane (1992), The restart effect: evaluation of labour market programme for unemployed people, London: Policy Studies Institute. 30