1. A Brief Introduction to Testing Development
教育部课程教材研究所研究员
李静纯
2007年6月14日 北京 大兴

2. PART 1 Test Construction

3. What is Testing construction?
The whole process of testing
A certain purpose for the curriculum
The three periods
The planning
The desighning of the whole test
Constructing a test for the purpose
Writing all the tasks for the test
Administration

4. Operationalization （编制） Administration （实施）
The three periods
Design （设计）
Operationalization （编制）
Administration （实施）

5. The first period: Design
What do you want to test?
What are your testing objectives?
How many items can you involve in the test?
How do you want to balance your items?
What is your construct validity?
What is the impact on your students?
How many students are to involve in the test?

6. The first period: Design
How well will your students do the test?
Are you going to make them happy or sad,
successful or bored, strong or weak?
Are you going to test the students or the teacher or both?
What problems do you want to find and solve?
JEST REMEMBER TO KEEP THE QUESTIONS UP!

7. The second period: Operationalization
Writing the test blueprint
Forming the structure of the test
Designing the tasks
Writing the items
Revising and constructing the whole test
Scoring
Editing

8. The test BLUEPRINT TEST STRUCTURE:
The number of parts, tasks and items
The functions of the parts and tasks
Sequence of the parts, tasks and items
Relative importance of parts, tasks and items
The format of the test
The number of pages
The size of the test book

9. The test BLUEPRINT Features:
Purpose: CLEAR: particular, practical, formative, local
Definition of construction
Setting: when, where, weather, social attitudes and
expectations, government supporting, etc.
Timing
Instruction (in Chinese or in English, or both?)
Characteristics of INPUT
Characteristics of expected responses (OUTPUT)
Scoring method

10. The test BLUEPRINT TEST STRUCTURE:
The number of parts, tasks and items
The functions of the parts and tasks
Sequence of the parts, tasks and items
Relative importance of parts, tasks and items
The format of the test
The number of pages
The size of the test book

11. The third period: Administration
What is the best time?
What is the time?
Who manage the testing?
Are they well experienced?
How are they trained?
What environment is the test taken in?
What data is going to be collected?
How is the data going to be coded?
How is the data going to be valued?
How is the data going to be used for the future?

12. The third period: Administration
UNDERSTANDING THE KEY CONCEPTS:
Content validity ()
Are they well experienced?
How are they trained?
What environment is the test taken in?
What data is going to be collected?
How is the data going to be coded?
How is the data going to be valued?
How is the data going to be used for the future?

13. The third period: Administration Understanding the key concepts
Content validity
Criterion related
validity
Predictive validity
Surface validity
Construct validity
Reliability:
Obtained score
True score
Error of measurement
Split-half reliability
Split-half reliability
Difficulty level
Discrimination
Central tendency:
Mean (平均值)
Media (中数)
Mode (众数)
Frequency distribution
(频数分布)
Remember the 18 terms.
They are useful for ever!

14. PART 2 Standards for testing development

15. The American Standard for Testing development
CANDIDATES
Number of the candidates
Learning level
Characteristics of the group
Characteristics of individuals

16. The American Standard for Testing development
CONTENT
Range (范围)
Objectives (目标)
Flexibility (灵活性)
Accuracy (准确性)
Appropriation (适应性)

17. Appropriation is very important!
Daily teaching testing
Daily learning testing
Last testing this testing
The text book testing
Formative
assessment testing
Daily scoring testing scoring

18. The American Standard for Testing development
Administration:
Scoring (赋分)
Scoring system (赋分系统)
Timing (时间安排)
Difficulty leveling (难度比例)
Sequence of the tasks (难度次序)
Effective operation (高效运作)
Instruction (指示语)
Correlation (试题相关性)

19. PART 3 Test writing

20. Type 1 Multiple choice

21. Elements of multiple choice
Stem
Look! Nancy is ______________ a kite in the park A. fly B. flies C. flying
Distractors
Options
The hey

22. Elements of multiple choice
Look! Nancy is ______________ a kite in the park fly B. flies C. flying (青海省西宁市湟中县)
This item is situational and meaning.

23. Look. Nancy is ______________ a kite in the park fly. B. flies. C
Look! Nancy is ______________ a kite in the park fly B. flies C. flying Can we make it better?
Look! Nancy ______________ a kite in the park fly B. flies C. is flying

24. What’s the matter with him. HIs arm hurts. His shoulder hurts
What’s the matter with him? HIs arm hurts His shoulder hurts His finger hurts 北京大兴区
Picture 1
What’s the matter with him? His ear hurts HIs foot hurts HIs finger hurts
Picture 2

25. _________ is it? It’s my mother’s A. What B. Where C. Whose 鹤蜂县
_________ is it? It’s my mother’s A. What B. Who C. Whose
_________ it? It’s my mother’s A. What’s B. Who’s C. Whose is

26. Look! The monkey has a long ___________ A. short B. tail C. leg
Look at the elephant! It has a ______nose and ________ ears A. long, long B. big, big C. long, big
Look at the elephant! It has a ______nose and ________ ears A. small, big B. little, round C. long, big

27. Type 2 Items of completion

28. She has a cat. She likes playing with it
She has a cat. She likes playing with it. But She’s seven now and her father tells her to go to school. The teachers do not let her take the cat to the classroom. She has to leave it at home. So she doesn’t want to listen to her teachers and can’t answer questions. Now Class Three is having math. “What’s two and two, Sue?” She can’t answer. “Your mother gives you two pencils. I give you two, too. How manypencils do you have?” “Five, Miss Green. “You’re wrong! You have four.” I don’t think so. I have one in my pencil- box.”

29. She has a cat. She likes playing with it
She has a cat. She likes playing with it. But She’s seven now and her father tells her to go to school. The teachers do not let her take the cat to the classroom. She has to leave it at home. So she doesn’t want to listen to her teachers and can’t answer questions. Now Class Three is having math. “What’s two and two, Sue?” She can’t answer. “Your mother gives you two pencils. I give you two, too. How many pencils do you have?” “Five, Miss Green.” “You’re wrong! You have four.” I don’t think so. I have one in my pencil- box.”

30. cat to the classroom. She has to leave it at home
cat to the classroom. She has to leave it at home. So she doesn’t want to listen to her teachers and can’t answer questions. Now Class Three is having math. “What’s two and two, Sue?” She can’t answer. “Your mother gives you two pencils. I give you two, too. How manypencils do you have?” “Five, Miss Green.” “You’re wrong! You have four.” I don’t think so. I have one in my pencil- box.”

31. She has a cat. She likes playing with it
She has a cat. She likes playing with it. But She’s seven now and her father tells her to go to school. The teachers do not let her take the cat to the classroom. She has to leave it at home. So she doesn’t want to listen to her teachers and can’t answer questions. Now Class Three is having math. “What’s two and two, Sue?” She can’t answer. “Your mother gives you two pencils. I give you two, too. How manypencils do you have?” “Five, Miss Green.” “You’re wrong! You have four.” I don’t think so. I have one in my pencil- box.”

32. She has a cat. She likes playing with it
She has a cat. She likes playing with it. But She’s seven now and her father tells her to go to school. The teachers do not let her take the cat to the classroom. She has to leave it at home. So she doesn’t want to listen to her teachers and can’t answer questions. Now Class Three is having math. “What’s two and two, Sue?” She can’t answer. “Your mother gives you two pencils. I give you two, too. How manypencils do you have?” “Five, Miss Green.” “You’re wrong! You have four.” I don’t think so. I have one in my pencil- box.”

33. She has a cat. She likes playing with it
She has a cat. She likes playing with it. But She’s seven now and her father tells her to go to school. The teachers do not let her take the cat to the classroom. She has to leave it at home. So she doesn’t want to listen to her teachers and can’t answer questions. Now Class Three is having math. “What’s two and two, Sue?” She can’t answer. “Your mother gives you two pencils. I give you two, too. How manypencils do you have?” “Five, Miss Green. “You’re wrong! You have four.” I don’t think so. I have one in my pencil- box.”

34. She has a cat. She likes playing with it
She has a cat. She likes playing with it. But She’s seven now and her father tells her to go to school. The teachers do not let her take the cat to the classroom. She has to leave it at home. So she doesn’t want to listen to her teachers and can’t answer questions. Now Class Three is having math. “What’s two and two, Sue?” She can’t answer. “Your mother gives you two pencils. I give you two, too. How many pencils do you have?” “Five, Miss Green. “You’re wrong! You have four.” I don’t think so. I have one in my pencil- box.”

35. She has a cat. She likes playing with it
She has a cat. She likes playing with it. But She’s seven now and her father tells her to go to school. The teachers do not let her take the dog to the classroom. She has to leave it at school. So she doesn’t want to listen to her teachers and can’t answer questions. Now Class Three is having music. “What’s two and five, Sue?” She can’t answer. “Your mother gives you two pencils. I give you two, too. How many pencils do you have?” “Six, Miss Green. “You’re wrong! You have four.” I don’t think so. I have two in my pencil- box.”

36. Type 3 True-false items

37. She has a cat. She likes playing with it
She has a cat. She likes playing with it. But She’s seven now and her father tells her to go to school. The teachers do not let her take the cat to the classroom. She has to leave it at home. So she doesn’t want to listen to her teachers and can’t answer questions. Now Class Three is having math. “What’s two and two, Sue?” She can’t answer. “Your mother gives you two pencils. I give you two, too. How manypencils do you have?” “Five, Miss Green. “You’re wrong! You have four.” I don’t think so. I have one in my pencil- box.”

38. Sue has a dog. 2. Sue’s seven now. She has to leave it at school
Sue has a dog Sue’s seven now. She has to leave it at school. Sue and her classmate are having math “How many pencils do you have?” her teacher asks her.

39. Sue doesn’t listen to her father. 2. The maths teacher asks a question
Sue doesn’t listen to her father The maths teacher asks a question. Sue thinks two and two is four Sue is not very clever Sue likes her cat and doesn’t like her math teacher. Can you another set of sentences?

40. Sue is seven and she wants to go to school. 2
Sue is seven and she wants to go to school The maths teacher asks an easy question. Sue thinks two and two is four Sue is not interested at math Sue likes her cat and doesn’t like her math teacher.

41. Type 4 Matching items

42. Logic of the matching item
people
people

43. Logic of the matching item
people
things

44. Logic of the matching item
people
action

45. Logic of the matching item
people
clothes

46. Logic of the matching item
people
places

47. Logic of the matching item
people
subject