Access to this resource requires purchase

uLearn Course Image

How to Evaluate and Review a Test: Reflections of a Long-Time Mental Measurements Yearbook Reviewer (80 min.) LEARNING OBJECTIVES: 1. Describe the typical process Mental Measurements Yearbook reviewers use for evaluating a test and completing a test review. 2. Identify the parts of the review that are relatively easy to complete. 3. Discuss four particularly thorny issues in completing a review. ABSTRACT: This introductory-level webinar outlines thought processes that might be involved in completing a Mental Measurements Yearbook review of a test. Some parts of the review process present little difficulty. Other parts entail considerable challenge. Identifying the test's purpose and describing the test's materials and processes usually present little difficulty. Perhaps surprisingly, evaluating the standardization (the norms) is often straightforward. Four aspects of the review process frequently present special challenges. First, many test manuals present an overwhelming amount of data on reliability and validity. The reviewer must sort through all this information and formulate overall conclusions that can be conveyed in relatively succinct language. Second, many tests provide a host of scores. An important, and sometimes tricky, part of the review process is spotting all the scores (and suggested interpretations) and determining if adequate technical information is available for all of them. Third, fairness has emerged as a major concern, now ranking with the traditional "big three" of norms, reliability, and validity. Many tests have not yet adequately treated this subject. Some have covered it, but only in the most cursory manner. Fourth, in formulating an overall conclusion about the test, the reviewer faces the difficult task of deciding whether to comment exclusively about the test under review or to place it in the wider context of other tests in the same domain. (Length: 80 minutes) USER RATING: 4.6 out of 5 STARS (8) "Very practical information for conducting test reviews, as well as training my students to conduct test reviews." BIO: Thomas P. Hogan, Ph.D. is Distinguished Professor of Psychology at the University of Scranton, where he previously served as Dean of the Graduate School, Director of Research, and Interim Provost/Academic Vice President. He was formerly Associate Vice Chancellor for Graduate and Professional Programs, University of Wisconsin-Green Bay and Co-Director of the statewide Wisconsin Assessment Center. He has an extensive history as a reviewer for the Mental Measurements Yearbook, completing his first review in 1978 and contributing 15 reviews in eight different yearbooks. He was recognized as a Distinguished Mental Measurements Yearbook Reviewer in 2014. He is the author or co-author of four books on measurement and research methods, several nationally used standardized tests, and over 200 published articles, chapters, and presentations related to psychological and educational measurement. He has won all three of his university's teaching awards. He frequently serves organizations on matters of test design, evaluation, and interpretation. He is a long-time member of the American Psychological Association, American Statistical Association, American Educational Research Association, and National Council on Measurement in Education. He holds a bachelor degree from John Carroll University and both master and doctoral degrees in Psychology from Fordham University, with a specialization in Psychometrics. American Psychological Association (APA) Buros Center for Testing is approved by the American Psychological Association (APA) to sponsor continuing education for psychologists. Buros Center for Testing maintains responsibility for this program and its content. National Association of School Psychologists (NASP) Buros Center for Testing is approved by the National Association of School Psychologists (NASP) to sponsor continuing education for psychologists.Buros Center for Testing maintains responsibility for this program and its content. There is no known commercial support for this program. INSTRUCTIONAL SUPPLEMENTS PROVIDED WHEN PURCHASED FOR A COURSE: PowerPoint slides References/additional readings Comprehension quiz with answer key Discussion questions Timestamps for presentation content For a brief preview of this video, click link below.
VIDEO PREVIEW

Purchase Information

TWO PURCHASE OPTIONS: For single-user access and continuing education credit, click below. For multi-user access for a course, go to https://marketplace.unl.edu/buros/course-video-purchase.html ($100 for first video purchase, $80 for subsequent video purchases).