Test Design Rules: Traditional Versus Online Hello class, my name is Donna Cutler. Today’s lesson will be an overview of guidelines utilized in paper and online assessments. Donna Cutler University of North Alabama Evaluation Methods in Collegiate Nursing Education NU 606 Dr. Wendy Darby July 11, 2017

What’s the Difference? Paper Tests & Online Tests You may be asking your self: What is the difference between these two modes of testing. According to Oermann & Gaberson there isn’t a drastic one. And there are a number of commonalities that both methodologies share. Paper Tests & Online Tests What’s the Difference?

Commonalities of Online and Paper Assessments Measure individual achievement. Utilize multiple methods of assessments such as written assignments and tests. Test format arranged with questions progressing from easy to hard. The material is presented in the order it is taught. The purpose and directions are well stated. Established academic honesty policy. Utilization of proctors and other measures to deter and prevent cheating. Use of scoring rubrics that define goals, clear guidelines and grading criteria. Lets review these commonalities Measure individual achievement. Utilize multiple methods of assessments Test format arranged with questions progressing from easy to hard. The material is presented in the order it is taught. The purpose and directions are well stated. Established academic honesty policy. Utilization of proctors and other measures to deter and prevent cheating. Use of scoring rubrics

Now that we have gone over the commonalities, we will move onto the variations. While online and traditional assessment processes have apparent separable differences, physical presence being the most obvious, let’s take a look at the differences a little more closely.

Variations between the two modes of assessment are: Online is dependent on technology versus traditional which may use but is not. Asynchonous versus synchronous Remote versus physical proctors Open book tests utilizing resources not usually permitted in traditional modes. Online requires more feedback then traditional education Assignments may need adjusting to fit online structure, assignments don’t need adjusting for technology Online assessments are based on open book exams, papers, power-points, peer critique while traditional are typically based on written work, tests and presentations. Well organized rubrics in online assessments whereas there is less emphasis on them in the traditional setting. Assessment incorporates online discussion boards while in classroom discussions are usually not graded.

Security & Academic Honesty Security Measures Teacher: One of the biggest concerns of online testing is the challenge of preventing academic dishonesty (Oermann & Gaberson, 2014, p. 206). How can the teacher be assured that the student who is enrolled in the course is the actual student taking the test? We will examine a few high and low-security measures employed to deter cheating.

Security & Academic Honesty We are going to examine some low and high technology used for academic security. Low technology measures include clear academic policies, atmosphere of trust, test questions strategies and timed tests. High Technology measures include browser security programs, remote proctoring, password protection and biometric fingerprint scanners

Grading & Assessments Class Discussion Rubric Teacher: Most discussion questions focus on Bloom’s Taxonomy to evaluate students’ comprehension of the content and their ability to convey that knowledge in the class discussion (Craig, 2017). Analytic grading rubrics demonstrate how points will be distributed among the expected performance competencies.

Grading Rubric Here is an example of a grading rubric which is heavily relied on in online learning.

Summary Concern for security and academic honesty Reliance on grading rubrics Increased need for feedback Variety of assessments modes In summary, there are several key commonalities between online and in class assessments. Key differences are: Concern for Security and Academic honesty Reliance on grading rubrics Increased need for feedback Variety of assessments modes

References Oermann, M. H., & Gaberson, K. B. (2014). Evaluation and Testing in Nursing Education (4 ed.). New York: Springer Publishing Company. Paper test graphic. Pixabay. CC0 Public Domain. https://pixabay.com/p-303928/?no_redirect Computer monitor graphic. Pixabay. CC0 Public Domain. https://pixabay.com/p-33039/?no_redirect Wittmann-Price, R. A., Godshall, M., & Wilson, L. 2013 (2 ed.). New York, NY: Springer Publishing Company. Classroomgraphic. Pixabay. CC0 Public Domain. https://pixabay.com/p-42275/?no_redirect

Thank-you dcuter@una.com Thank-you for taking the time to review my power-point presentation. If you have any questions please feel free to contact me at dcuter@una.com.