Cameron+Ponton+-+Criterion-Referenced+Tests

pdf

School

Morehouse College *

*We aren’t endorsed by this school

Course

455

Subject

Accounting

Date

Apr 3, 2024

Type

pdf

Pages

3

Uploaded by CaptainScienceSeahorse32

Report
Criterion-Referenced Tests: Cut Scores, Reliability, and Validity 1. What is the theoretical range of values for Kappa? a. −1 to 1 b. 0 to 1 c. −1 to 0 d. −2 to 2 2. The following data were obtained from a criterion-referenced test that was administered on two days. Calculate the percent agreement for the results. Trial 1 pass Trial 1 fail Total Trial 2 pass 12 8 20 Trial 2 fail 9 11 20 Total 21 19 40 a. .50 b. .58 c. .80 d. .85 3. What is the reliability (i.e., percent agreement) for the following test? Monday Tuesday Pass (0) Fail (1) Total Pass (0) 15 8 23 Fail (1) 15 15 30 Total 30 23 53 a. .35 b. .57 c. .65 d. .76 4. The judgment, normative, empirical, and combination approaches are used for what purposes related to criterion-referenced standards? 5. What word does NOT belong with the others? a. absolute b. criterion c. pass d. relative 6. Determine what aspect of measurement accuracy is being assessed by calculating the relationship between two tests. For each item, choose one of the following: 15 pass-pass agreements 15 fail-fail agreements Total agreements: 30 Sum of all four cells: 53 Percent agreement: (30/53) x 100 = 56.6% 12 pass-pass agreements 11 fail-fail agreements Total agreements: 23 Sum of all four cells: 40 Percent agreement: (23/40) x 100 = 57.5% Judgemental: Based on the beliefs or experience of experts Normative: Uses norm-referenced data to set standards with a theoretically accepted criterion Empirical: Uses an external criterion measure; cutoff scores directly based on data available to this external attribute Combination: Involves using all available options: experts, prior experience, empirical data, and norms
a. if construct validity is being assessed b. if concurrent validity is being assessed c. if equivalence validity is being assessed d. if stability is being assessed ___ test A with test A ___ test A with test B ___ test A with criterion test ___ test B given to contrasting groups 7. Four statistics were calculated during the examination of the reliability of a criterion-related test. The values of the statistics were 140.6, 77%, .57, and .52. Identify which values are probably chi- square, Kappa, phi, and P. a. chi-square = ______ b. Kappa = ______ c. phi = ______ d. P = ______ 8. Label (a) and (b) so that the following table is a criterion-referenced reliability example. a. ______ b. ______ (b) (a) Pass Fail Pass X X Fail X X 9. Label (a) and (b) so that the following table is a criterion-referenced validity example. a. ______ b. ______ (b) (a) Pass Fail Pass X X Fail X X .52 .57 77% 140.6 A D B C Day 2 Day 1
10. Based on the data in the table that follows, what is the percent agreement on this criterion- referenced test? Pass Fail Pass 40 20 Fail 20 20 40 pass-pass agreements 20 fail-fail agreements Total agreements: 60 Sum of all four cells: 100 Percent agreement: (60/100) x 100% = 60%. 60 60 40 40 100
Your preview ends here
Eager to read complete document? Join bartleby learn and gain access to the full version
  • Access to all documents
  • Unlimited textbook solutions
  • 24/7 expert homework help