Understanding the Evaluation Methodology
E D U C A T I O N
Preparing for the 2003 UFE Understanding the Evaluation Methodology
JUNE 2002
TABLE OF CONTENTS
I II III IV V INTRODUCTION ...............................................................................................................2 THE MOCK MARKING CENTRE ....................................................................................4 THE BOTTOM LINE: PASS/FAIL ...................................................................................8 BOE CONCLUSIONS ON THE METHODOLOGY.......................................................14 COMMENTARY ON CANDIDATE PERFORMANCE .................................................15
APPENDIX A MOCK MARKING CENTRE SIMULATIONS AND EVALUATION GUIDES...........................................................................................................19 APPENDIX B CANDIDATE PERFORMANCE ON PRIMARY INDICATORS BY COMPETENCY AREA.................................................................................156 APPENDIX C CANDIDATE PERFORMANCE ON PRIMARY AND SECONDARY INDICATORS BY SIMULATION...............................................................159
Copyright 2002 The Canadian Institute of Chartered Accountants 277 Wellington Street West, Toronto, Canada M5V 3H2 Printed and bound in Canada
Preparing for the 2003 UFE Understanding the Evaluation Methodology June 2002
2
I
INTRODUCTION
Overview In March 2002 the CICA published “Preparing for the 2003 UFE: An Introduction to the New Uniform Evaluation Process.” That publication explains the change in the CA professional education to focus on competence. It also briefly describes the new Uniform Evaluation process that will be used to assess whether candidates possess the level of competence expected of entrylevel CAs. The Board of Evaluators (BOE) was charged with the responsibility of developing a methodology for evaluating competence. Given the nature and magnitude of the changes, the BOE decided to test the new
Preparing for the 2003 UFE Understanding the Evaluation Methodology
JUNE 2002
TABLE OF CONTENTS
I II III IV V INTRODUCTION ...............................................................................................................2 THE MOCK MARKING CENTRE ....................................................................................4 THE BOTTOM LINE: PASS/FAIL ...................................................................................8 BOE CONCLUSIONS ON THE METHODOLOGY.......................................................14 COMMENTARY ON CANDIDATE PERFORMANCE .................................................15
APPENDIX A MOCK MARKING CENTRE SIMULATIONS AND EVALUATION GUIDES...........................................................................................................19 APPENDIX B CANDIDATE PERFORMANCE ON PRIMARY INDICATORS BY COMPETENCY AREA.................................................................................156 APPENDIX C CANDIDATE PERFORMANCE ON PRIMARY AND SECONDARY INDICATORS BY SIMULATION...............................................................159
Copyright 2002 The Canadian Institute of Chartered Accountants 277 Wellington Street West, Toronto, Canada M5V 3H2 Printed and bound in Canada
Preparing for the 2003 UFE Understanding the Evaluation Methodology June 2002
2
I
INTRODUCTION
Overview In March 2002 the CICA published “Preparing for the 2003 UFE: An Introduction to the New Uniform Evaluation Process.” That publication explains the change in the CA professional education to focus on competence. It also briefly describes the new Uniform Evaluation process that will be used to assess whether candidates possess the level of competence expected of entrylevel CAs. The Board of Evaluators (BOE) was charged with the responsibility of developing a methodology for evaluating competence. Given the nature and magnitude of the changes, the BOE decided to test the new