Understanding the Evaluation Methodology

Only available on StudyMode
  • Download(s) : 79
  • Published : December 16, 2012
Open Document
Text Preview
E D U C A T I O N

Preparing for the 2003 UFE Understanding the Evaluation Methodology

JUNE 2002

TABLE OF CONTENTS
I II III IV V INTRODUCTION ...............................................................................................................2 THE MOCK MARKING CENTRE ....................................................................................4 THE BOTTOM LINE: PASS/FAIL ...................................................................................8 BOE CONCLUSIONS ON THE METHODOLOGY.......................................................14 COMMENTARY ON CANDIDATE PERFORMANCE .................................................15

APPENDIX A MOCK MARKING CENTRE SIMULATIONS AND EVALUATION GUIDES...........................................................................................................19 APPENDIX B CANDIDATE PERFORMANCE ON PRIMARY INDICATORS BY COMPETENCY AREA.................................................................................156 APPENDIX C CANDIDATE PERFORMANCE ON PRIMARY AND SECONDARY INDICATORS BY SIMULATION...............................................................159

Copyright  2002 The Canadian Institute of Chartered Accountants 277 Wellington Street West, Toronto, Canada M5V 3H2 Printed and bound in Canada

Preparing for the 2003 UFE Understanding the Evaluation Methodology June 2002

2

I

INTRODUCTION

Overview In March 2002 the CICA published “Preparing for the 2003 UFE: An Introduction to the New Uniform Evaluation Process.” That publication explains the change in the CA professional education to focus on competence. It also briefly describes the new Uniform Evaluation process that will be used to assess whether candidates possess the level of competence expected of entrylevel CAs. The Board of Evaluators (BOE) was charged with the responsibility of developing a methodology for evaluating competence. Given the nature and magnitude of the changes, the BOE decided to test the new methodology before using it for the 2003 Uniform Evaluation. In February 2002 the BOE set up a Mock Marking Centre using selected 2001 UFE questions and a representative sample of candidate responses. Experienced markers applied the new methodology using the new tools created by the BOE. To provide candidates with a better understanding of how the new evaluation process works, this report explains the methodology in some detail, describes how it was applied at the Mock Marking Centre, and sets out some important lessons learned  lessons that the BOE believes will be of benefit to candidates. The information regarding the new methodology and its implications applies to the Uniform Evaluation to be written by CA candidates in 2003. Background Evaluation geared to the Vision CA

The CICA Board of Directors concluded in the late 1990s that the Canadian CA profession faced changes of such magnitude that it needed to articulate a vision to guide the profession in the 21st century. The resulting Vision Report set out the following Mission and Vision statements describing the profession’s purpose and direction: Mission: Our mission is to enhance decision-making and improve organizational performance through financial management, assurance and other specialized services. We act with integrity, objectivity and a commitment to excellence and the public interest. Vision: We will be the leaders in creating, validating and interpreting information that measures and enhances organizational performance, and be the obvious choice for financial management, assurance and other specialized services.

Preparing for the 2003 UFE Understanding the Evaluation Methodology June 2002

3 The Board of Directors subsequently approved the adoption of a competency-based approach to CA qualification as a key element in fulfilling the Mission and achieving the Vision. This approach specifies expectations in terms of learning outcomes, or what an individual can do or accomplish. The...
tracking img