Chapter 16 The Computer in Assessment Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

The Computer in Assessment Tremendous growth in measurement instruments created for administration, scoring, and interpretation by the computer.Tremendous growth in measurement instruments created for administration, scoring, and interpretation by the computer. The Internet is also changing the current landscape and the future of testing by providing 24/7 access, ease-of-use, and immediate scoring.The Internet is also changing the current landscape and the future of testing by providing 24/7 access, ease-of-use, and immediate scoring. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

The computer is currently used for: Test administrationTest administration Test scoringTest scoring Computing normsComputing norms Assessing reliabilityAssessing reliability Assessing validityAssessing validity Providing interpretative feedbackProviding interpretative feedback Computing factor analysis and other statistics needed in testingComputing factor analysis and other statistics needed in testing Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Advantages of Computer-based Testing Reproduce closely the instructions and presentation formats of pencil-and-paper versionsReproduce closely the instructions and presentation formats of pencil-and-paper versions More cost effectiveMore cost effective Provide immediate feedbackProvide immediate feedback 24/7 access24/7 access Extensive written reportsExtensive written reports Adaptive testingAdaptive testing Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Are computer-based tests and traditional tests the same? Studies have compared computerized administration of psychological instruments with standard tests and have found a high degree of similarity between the two formats. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Potential Problems and Limitations of Computer-based Tests May depersonalize the clientMay depersonalize the client Compromise the confidentiality of clientsCompromise the confidentiality of clients Use of computerized narrative reports by unqualified personsUse of computerized narrative reports by unqualified persons Individuals may be uncomfortable using the computerIndividuals may be uncomfortable using the computer Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Computer-Adaptive Testing Presents the test taker with a test specifically tailored for his or her individual ability levelPresents the test taker with a test specifically tailored for his or her individual ability level Chooses the test taker’s next test item based upon the answer of the last itemChooses the test taker’s next test item based upon the answer of the last item If the test taker answers the question correctly, he/she is given a more difficult itemIf the test taker answers the question correctly, he/she is given a more difficult item Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Computer-based Personality Testing MMPI: most researched of computer-based testsMMPI: most researched of computer-based tests Computer-based personality tests can generate test narratives and reportsComputer-based personality tests can generate test narratives and reports Tend to be more reliable than the interpretations of individualsTend to be more reliable than the interpretations of individuals Due to its objective nature, computer-generated test results may be easier for clients to hearDue to its objective nature, computer-generated test results may be easier for clients to hear Computer-generated test reports may be more comprehensive then individual clinicians’ reportsComputer-generated test reports may be more comprehensive then individual clinicians’ reports Computer-generated test reports provide more objective informationComputer-generated test reports provide more objective information Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Internet-based Assessment There are hundreds of assessment-related websites.There are hundreds of assessment-related websites. Internet-based assessment websites vary in content, quality, and function.Internet-based assessment websites vary in content, quality, and function. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Advantages of Internet-based Assessment The large population accessThe large population access Less costLess cost The possibility of providing the tools around the clock, without any time limitationThe possibility of providing the tools around the clock, without any time limitation The completely voluntary participation, which usually improves respondents’ motivationThe completely voluntary participation, which usually improves respondents’ motivation Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Concerns about Internet-based Assessment Concerns about the reliability and validity of the data collectedConcerns about the reliability and validity of the data collected Although many people have access to the Internet, not everyone does, which can be a confounding variable in a research studyAlthough many people have access to the Internet, not everyone does, which can be a confounding variable in a research study Questions regarding test securityQuestions regarding test security Nearly impossible to positively identify a person taking an online assessment if the test is not taken at a special siteNearly impossible to positively identify a person taking an online assessment if the test is not taken at a special site No human contact while participants received feedback/resultsNo human contact while participants received feedback/results Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Electronic Portfolios A portfolio is essentially a collection of a student’s work that can be used to demonstrate his or her skills and accomplishments.A portfolio is essentially a collection of a student’s work that can be used to demonstrate his or her skills and accomplishments. With traditional portfolios, folders, boxes, or 3-ring binders hold papers, pictures, cassette tapes, and more.With traditional portfolios, folders, boxes, or 3-ring binders hold papers, pictures, cassette tapes, and more. With electronic portfolios, information can be stored digitally on a computer hard drive or some sort of removable media (pen drive, floppy disk, CD, etc.). Sound, pictures, graphics, and video can be easily added to an electronic portfolio. With electronic portfolios, information can be stored digitally on a computer hard drive or some sort of removable media (pen drive, floppy disk, CD, etc.). Sound, pictures, graphics, and video can be easily added to an electronic portfolio. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.

Computer Simulation In Testing Computer simulations are the technique of representing the real world by a computer program.Computer simulations are the technique of representing the real world by a computer program. Long-established technique for conducting training and assessing the readiness of individuals, crews, teams, groups, and units to perform military operations.Long-established technique for conducting training and assessing the readiness of individuals, crews, teams, groups, and units to perform military operations. Rather than taking individuals through a series of test items, assessments involving computer simulations immerse them in situations like the ones for which they are being selected or prepared.Rather than taking individuals through a series of test items, assessments involving computer simulations immerse them in situations like the ones for which they are being selected or prepared. Robert J. Drummond and Karyn Dayle Jones Assessment Procedures for Counselors and Helping Professionals, 6 th edition Copyright ©2006 by Pearson Education, Inc. Upper Saddle River, New Jersey All rights reserved.