top-rated free essay

Quality and Validity in Test

By Sotoza1 Sep 13, 2013 804 Words
Test Validity

1

Introduction
Validity is arguably the most important criteria for the quality of a test. The term validity refers to whether or not the test measures what it claims to measure. On a test with high validity the items will be closely linked to the test’s intended focus. For many certification and licensure tests this means that the items will be highly related to a specific job or occupation. If a test has poor validity then it does not measure the job-related content and competencies it ought to. When this is the case, there is no justification for using the test results for their intended purpose. There are several ways to estimate the validity of a test including content validity, concurrent validity, and predictive validity. The face validity of a test is sometimes also mentioned.

Types of Validity
Content Validity While there are several types of validity, the most important type for most certification and licensure programs is probably that of content validity. Content validity is a logical process where connections between the test items and the job-related tasks are established. If a thorough test development process was followed, a job analysis was properly conducted, an appropriate set of test specifications were developed, and item writing guidelines were carefully followed, then the content validity of the test is likely to be very high. Content validity is typically estimated by gathering a group of subject matter experts (SMEs) together to review the test items. Specifically, these SMEs are given the list of content areas specified in the test blueprint, along with the test items intended to be based on each content area. The SMEs are then asked to indicate whether or not they agree that each item is appropriately matched to the content area indicated. Any items that the SMEs identify as being inadequately matched to the test blueprint, or flawed in any other way, are either revised or dropped from the test. Concurrent Validity Another important method for investigating the validity of a test is concurrent validity. Concurrent validity is a statistical method using correlation, rather than a logical method. Examinees who are known to be either masters or non-masters on the content measured by the test are identified, and the test is administered to them under realistic exam conditions. Once the tests have been scored, the relationship is estimated between the Professional Testing Inc. © PTI 2006

Test Validity

2

examinees’ known status as either masters or non-masters and their classification as masters or non-masters (i.e., pass or fail) based on the test. This type of validity provides evidence that the test is classifying examinees correctly. The stronger the correlation is, the greater the concurrent validity of the test is. Predictive Validity Another statistical approach to validity is predictive validity. This approach is similar to concurrent validity, in that it measures the relationship between examinees' performances on the test and their actual status as masters or non-masters. However, with predictive validity, it is the relationship of test scores to an examinee's future performance as a master or non-master that is estimated. In other words, predictive validity considers the question, "How well does the test predict examinees' future status as masters or non-masters?" For this type of validity, the correlation that is computed is between the examinees' classifications as master or non-master based on the test and their later performance, perhaps on the job. This type of validity is especially useful for test purposes such as selection or admissions. Face Validity One additional type of validity that you may hear mentioned is face validity. Like content validity, face validity is determined by a review of the items and not through the use of statistical analyses. Unlike content validity, face validity is not investigated through formal procedures and is not determined by subject matter experts. Instead, anyone who looks over the test, including examinees and other stakeholders, may develop an informal opinion as to whether or not the test is measuring what it is supposed to measure. While it is clearly of some value to have the test appear to be valid, face validity alone is insufficient for establishing that the test is measuring what it claims to measure. A well developed exam program will include formal studies into other, more substantive types of validity. Summary The validity of a test is critical because, without sufficient validity, test scores have no meaning. The evidence you collect and document about the validity of your test is also your best legal defense should the exam program ever be challenged in a court of law. While there are several ways to estimate validity, for many certification and licensure exam programs the most important type of validity to establish is content validity.

Professional Testing Inc. © PTI 2006

Cite This Document

Related Documents

  • The Validity Test

    ...Validity Test This is just a test to see if this site works. In science and statistics, validity is the extent to which a concept,[1] conclusion or measurement is well-founded and corresponds accurately to the real world. The word "valid" is derived from the Latin validus, meaning strong. The validity of a measurement tool (for example, a...

    Read More
  • Validity

    ...Validity A really important aspect that has emerged in our project is validity which must be put into consideration when developing and evaluating a language test, since it will allow us to evaluate the utility and appropriateness of the test for our particular purpose and context. Therefore, the validity of a test can only be established thr...

    Read More
  • VALIDITY

    ...Validity is about the extent to which a piece of research in finding out what the research is finding out what the researcher intents to find out. The idea of validity means that something is true and can be believed. When people say ‘that’s a valid point”, they mean that the point is relevant, meaningful and believable. It is concerned...

    Read More
  • Test Reliability and Validity

    ...Dan Eble PSYC 105 G Dr. Waterstreet Test Reliability and Validity Correlations are important in establishing test reliability and related test validity. Test reliability has four methods of testing. The first is the test-retest method, which is when the same test is given to students at two different occasions and the scores are then ...

    Read More
  • The Validity of Standardized Tests

    ...inaccurately assess a student's mastery of subject material. I intend to research the validity of standardized tests in school. The standardized tests can include the Stanford 9, PSAT, SAT, CRCT, etc. I chose this topic because I feel that educators and political leaders place an undue amount of importance on it. A flaw in standardized testing...

    Read More
  • Test Critique

    ... James P. VanDemark Psyc4310- Tests and Measurements (36357) Dr. Trina Gordon Hall April 19, 2014 Name of Test: The Myers-Briggs Type Indicator® The Name of the Test: Include also the date it was originally developed as well as the date of the current version. This should be done in a narrative form under the subheading The test critique i...

    Read More
  • Tests and Measurements in Psychology

    ...Alicia Tucker – 55362 PSY 312 – Tests and Measurements in Psychology 1. What is the Lake Wobegon Effect and how does it arise? In Garrison Keillor’s fictional town of Lake Wobegon, “all the women are strong, all the men are good-looking, and all the children are above average.” (Gregory, 2011). The Lake Wobegon effect is a natural...

    Read More
  • Validity and Reliability

    ...psychologists stress the need for validity and reliability throughout the selection process. Explain how this can be achieved and critically examine the practical case for and against such rigour in selection, in practice, in an English context. In your essay, examine other perspectives dictating features of the selection process and if and how ...

    Read More

Discover the Best Free Essays on StudyMode

Conquer writer's block once and for all.

High Quality Essays

Our library contains thousands of carefully selected free research papers and essays.

Popular Topics

No matter the topic you're researching, chances are we have it covered.