Syllabus head (iv) — Educational measurement and evaluation | Chapter 1 of 18 | FINAL EDITION
70questions, every one explained
11items in the 2022 paper drew on this chapter
Why this chapter matters
In the 11 December 2022 Vice Principal paper, Educational Measurement & Evaluation supplied about 36 of 120 questions — roughly 90 of 300 marks. It was the largest single block in the paper, larger than language and reasoning combined.
This chapter covers the conceptual half of that block: what measurement and evaluation are, how tests are judged, and the twin pillars of validity and reliability. Chapters 2 and 3 cover item analysis/test construction and educational statistics respectively.
Questions from the 2022 paper answered by this chapter alone: Q69, Q73, Q74, Q76, Q97, Q98, Q99, Q100, Q103, Q104, Q105 — eleven questions, 27.5 marks, from one chapter.
Every one of those eleven is reproduced in the question bank at the end, marked [PYQ 2022].
Three questions from this chapter, solved
Every one of the 70 items is written this way — the answer, and why each wrong option is wrong.
Consider the following pairs:
Instance
Measurement Scale
1. Number of items a student answers correctly in a test comprising 20 items
Ratio Scale
2. Number assigned to different groups of students each of which solved a certain problem by a different method
Nominal Scale
Which of the above pairs is/are correctly matched?
(a) Both 1 and 2
(b) 2 only
(c) 1 only
(d) Neither 1 nor 2
Answer (b).
2 only. Numbers used merely to label method-groups → nominal. The count of items answered correctly is a raw test score, and test scores are interval, not ratio: zero correct is not zero knowledge, and 10 correct is not twice the ability of 5 correct. (a) and (c) read "zero correct" as a true zero — the trap; (d) wrongly rejects the nominal pair.
Consider the following statements about the Kuder-Richardson formulas:
KR-21 assumes that all items are of equal difficulty.
When item difficulties vary, KR-21 gives a higher estimate than KR-20.
KR-20 requires the Spearman-Brown correction to be applied afterwards.
Which of the statements given above is/are correct?
(a) 1 only
(b) 1 and 2 only
(c) 2 and 3 only
(d) 1, 2 and 3
Answer (a).
1 only. Statement 1 is true — equal item difficulty is KR-21's defining assumption. Statement 2 is inverted — KR-21 gives a lower (conservative) estimate when difficulties vary: KR-21 ≤ KR-20. Statement 3 is false — KR-20 estimates whole-test reliability directly; no correction needed.
Consider the following statements:
A test cannot be valid unless it is reliable.
A test that has some validity for one purpose is always valid for another purpose.
A reliable test may not necessarily be valid.
Select the correct answer using the code given below:
(a) 1 only
(b) 2 and 3
(c) 2 only
(d) 1 and 3
Answer (d).
1 and 3. Statement 1 is true — reliability is a necessary condition for validity. Statement 2 is false — validity is purpose-specific; a test valid for one purpose is not automatically valid for another. Statement 3 is true — the miscalibrated-scale case.
THE FOUR FOUNDATIONAL CONCEPTS
Almost every year, one question turns on the difference between measurement, assessment, evaluation and testing. Candidates lose it because they treat the words as synonyms. They are not.
A.1 Test
A test is an instrument — a set of questions or tasks administered under standard conditions to elicit a sample of behaviour. It is a tool, nothing more. A question paper is a test. A thermometer is the physical analogue.
A.2 Measurement
Measurement is the assignment of numerals to objects, events or traits according to rules.
That definition is Stevens's (1946) and is the one Indian textbooks reproduce. Three things follow from it:
Measurement is purely quantitative. It produces a number and stops.
It answers the question "How much?"
It carries no judgement. "Ravi scored 62 out of 100" is a measurement. It says nothing about whether 62 is good.
A.3 Assessment
Assessment is the process of gathering and interpreting evidence of learning.
Assessment is broader than measurement because it admits qualitative evidence — observation, anecdotal records, portfolios, conversations with the child — not just numbers. Assessment is a process, whereas measurement is an act.
A.4 Evaluation
Evaluation is the process of making a value judgement about the worth, quality or effectiveness of something, on the basis of measurement and assessment, against stated objectives.
Evaluation is the broadest of the four:
It answers "How good?" or "Of what worth?"
It is quantitative + qualitative
It necessarily involves criteria and a judgement
It leads to decisions — promote, retain, remediate, revise the syllabus
"Ravi scored 62" is measurement. "Ravi has achieved the expected standard in Mathematics but needs support in geometry, and should move to Class IX" is evaluation.
A caution worth knowing. Some Western writers reverse the last two and treat evaluation as a subset of assessment. Indian textbooks and Indian recruitment exams treat EVALUATION as the broadest term. Answer accordingly.
A.6 Summary table
Test
Measurement
Assessment
Evaluation
Nature
Instrument
Act
Process
Process + judgement
Data
—
Quantitative
Quantitative + qualitative
Quantitative + qualitative
Question answered
—
How much?
What is happening?
How good? What worth?
Judgement involved
No
No
Interpretive
Yes — central
Scope
Narrowest
Narrow
Broad
Broadest
Output
Responses
A score
An interpretation
A decision
The examiner's angle
The standard item is: "Which of the following is the broadest term?" or "Assigning numerals to attributes according to rules is called ___." The distractors are always the other three words. A second variant asks you to place the four in ascending order of scope.
Trap: an option reading "evaluation is purely quantitative." It is not — that is measurement.
