Skip to Content

Handbook on Measurement, Assessment, and Evaluation in Higher Education

Edited by Charles Secolsky, D. Brian Denison

Routledge – 2012 – 682 pages

Purchasing Options:

  • Add to CartPaperback: $125.95
    978-0-415-88076-3
    December 19th 2011
  • Add to CartHardback: $300.00
    978-0-415-88075-6
    December 20th 2011

Description

Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The Handbook on Measurement, Assessment, and Evaluation in Higher Education provides higher education administrators, student affairs personnel, institutional researchers who generate and analyze data, and faculty with an integrated handbook of theory, method, and application. This valuable resource brings together applied terminology, analytical perspectives, and methodological advances from the fields of measurement, assessment, and evaluation to facilitate informed decision-making in higher education.

Special Features:

  • Contributing Authors are world-renowned scholars across the fields of measurement, assessment, and evaluation, including: Robert E. Stake, Trudy W. Banta, Michael J. Kolen, Noreen M. Webb, Kurt Geisinger, Robert J. Mislevy, Ronald K. Hambleton, Rebecca Zwick, John Creswell, and Margaret D. LeCompte.
  • Depth of Coverage includes classroom assessment and student outcomes; assessment techniques for accountability and accreditation; test theory, item response theory, validity and reliability; qualitative, quantitative and mixed-methods evaluation; context and ethics of assessment.
  • Questions and Exercises follow each Section to reinforce the valuable concepts and insights presented in the preceding chapters.

Bridging the gap between practice in higher education with advances in measurement, assessment, and evaluation, this book enables educational decision-makers to engage in more sound professional judgment. This handbook provides higher education administrators with both high-level and detailed views into contemporary theories and practices, supplemented with guidance on how to apply them for the benefit of students and institutions.

Reviews

"The Handbook on Measurement, Assessment and Evaluation in Higher Education is coming out at a precarious and important moment in the history of American higher education—and, as a result, will become a critical resource to higher education leaders and assessment and teaching and learning practitioners. The fields of assessment, evaluation, and educational measurement continue to mature and, as a result, if used wisely, can dramatically improve educational outcomes. At the same time, higher education institutions are under enormous pressure from outside constituents to demonstrate their value to their students and to taxpayers and members of the public. The analysis and advice offered in this handbook will be extremely valuable as educational leaders work to respond to calls for greater accountability and work to improve their institution’s ability to use assessment data to improve programs."

-Debra Humphreys, Vice President for Communications and Public Affairs, Association of American Colleges and Universities

"This Handbook provides a comprehensive and practical synthesis of the methods used to measure and improve higher education at every level. Pressures for accountability and accreditation have forced colleges and universities to devote greater analytical attention to measuring goal attainment, evaluating academic programs and student services, and assessing student learning outcomes. Drawing upon an impressive array of contributors from diverse disciplinary perspectives, Secolsky and Denison have assembled chapters that, in the aggregate, represent the best of what we know about measuring, assessing, and evaluating our institutions, programs, and students. Thus, the volume deserves frequent reference and space on the book shelf of every researcher, campus administrator, faculty member, and higher education policy maker."

-J. Fredericks Volkwein, Professor Emeritus of Education, Pennsylvania State University

"This is a timely and important book. At a moment in our history when public problems are commonly reduced to oversimplifications that make them harder, not easier, to resolve, this brave new text by Secolsky and Denison presents -- in a highly accessible way -- the full complement of factors in higher education that need to be considered in evaluating student learning outcomes. The authors have produced an intelligent, complete, authoritative, realistic and useful piece of work that may well be a model for evaluating complex social issues generally."

-Eleanor Chelimsky, Former Director of Program Evaluation, U.S. Government Accountability Office

"A working knowledge of measuring collegiate learning and evaluating academic effectiveness is as indispensable for today’s university administrator as reading a budget. For the scholar of English literature or the chemist thrust into the role of Dean, accreditation site visitor, or assessment committee chair, this volume delivers the basics of this vast field in a manner that is easy to grasp and apply. Keep it handy."

-Peter Ewell, Vice President of the National Center For Higher Education Management Systems

Contents

List of Figures

List of Tables

Foreword, Edward J. Yaw

Preface: Improving Institutional Decision-Making Through Educational Measurement, Assessment, and Evaluation, Charles Secolsky and D. Brian Denison

Acknowledgements

Section 1 Assessment and Evaluation in Higher Education

Introduction to Section 1, Charles Secolsky and D. Brian Denison

1. Assessing the Quality of a University—Particularly its Teaching, Robert E. Stake, Gloria Contreras, and Isabel Arbesú

2. Classroom-Level Assessment: Aligning Pedagogical Practices to Enhance Student Learning, Kathryne Drezek McConnell and Peter E. Doolittle

3. Student Learning Outcomes Assessment at the Program and Institutional Levels, Thomas Judd and Bruce Keith

4. The Bottom Line: Will Faculty USE Assessment Findings?, Trudy W. Banta and Gary R. Pike

5. The Perennial Challenges of Accountability, James C. Palmer

6. Using National, State, and Local Data for Administrative Decision-Making, Sathasivam ‘Kris’ Krishnan, Chengbo Yin, William Mahler, Albertha Lawson, Michael Harris, and Karen Ruedinger

7. Empowerment Evaluation and Accreditation Case Examples: California Institute of Integral Studies and Stanford University, David Fetterman

8. Benchmarking in Higher Education, Jeffrey Seybert, Ellen Weed, and Trudy Bers

Questions and Exercises for Section 1

Section 2 Theories and Technical Aspects of Educational Measurement

Introduction to Section 2, Charles Secolsky and D. Brian Denison

9. Classical Test Theory and Higher Education: Five Questions, Elizabeth Schaughency, Jeffrey Smith, Jacques van der Meer, and David Berg

10. Generalizability Theory in Assessment Contexts, Noreen M. Webb, Richard Shavelson, and Jeffrey Steedle

11. Item Response Theory in Measurement, Assessment, And Evaluation for Higher Education, Steven J. Osterlind and Ze Wang

12. Scaling, Norming, and Equating, Michael J. Kolen and Amy B. Hendrickson

13. Reliability, Bruce Thompson and Tammi Vacha-Haase

14. The Validation of Tests in Higher Education, Kurt Geisinger, Leslie H. Shaw, and Carina McCormick

15. Statistical Modeling in Measurement, Assessment, and Evaluation for Higher Education, Steven J. Osterlind and Ze Wang

16. Issues in the Analysis of Change, D. Betsy McCoach, Karen Rambo, and Megan Welsh

Questions and Exercises for Section 2

Section 3 Test Construction and Development

Introduction to Section 3, Louise Yarnall

17. Building Content and Statistical Test Specifications, Tawnya Knupp and Deborah Harris

18. Evidence-Centered Design in Assessment Development, Geneva Haertel, Ellen Wentland, Louise Yarnall, and Robert J. Mislevy

19. The Assessment of 21st-Century Skills in Community College Career and Technician Education Programs, Louise Yarnall and Jane Ostrander

20. Item Analysis Procedures for Classroom Assessments in Higher Education, Jerome C. Clauser and Ronald K. Hambleton

21. Using Content Specialists for Detecting Item and Test Unfairness, Sydell Carlton

22. Computer-Based Testing in Higher Education, Robert Dolan and Kelly Burling

Questions and Exercises for Section 3

Section 4 Testing and Assessment for Decision-Making

Introduction to Section 4, Charles Secolsky and D. Brian Denison

23. Setting and Validating Cut Scores for Tests, Mary J. Pitoniak and Deanna L. Morgan

24. College Placement Testing of Entering Students, Deanna L. Morgan

25. Admissions Testing in Higher Education, Rebecca Zwick

26. Postsecondary Writing Assessment, Peggy O’Neill and Sandra Murphy

27. Authentic Assessment Validation: A Heuristic Rubrics Cube, Jion Liou Yen and Kevin Hynes

28. Cognitive Diagnostic Method: Rule Space, Q-Matrix Theory and Applications, Kikumi Tatsuoka, Anthony E. Kelly, Curtis Tatsuoka, and Michael Dean

Questions and Excercises for Section 4

Section 5 Approaches to Evaluation in Higher Education

Introduction to Section 5, Thomas E. Grayson

29. Program Evaluation in Higher Education, Thomas E. Grayson

30. Qualitative Evaluation, Christopher Pondish

31. Naturalistic Evaluation, David A. Erlandson

32. Responsive Evaluation, Kelly Godfrey and Doreen B. Finkelstein

33. Case Studies and Validity, Edith Cisneros-Cohernour

34. Mixed Methods Specialists in Action: Linking Mixed Methods Research to Learning and Classroom Assessment, Delwyn Harnisch, John Creswell, and Timothy Guetterman

35. Survey Use in Academic Contexts: Considerations and Guidelines, Ellen Wentland

Questions and Exercises for Section 5

Section 6 Issues in Assessment and Evaluation in Higher Education

Introduction to Section 6, April L. Zenisky

36. Using Data to Find Common Ground Between Secondary and Postsecondary Accommodations for Students with Disabilities, Manju Banerjee and Martha L. Thurlow

37. Testing and Evaluation of English-Language Learners in Higher Education, Young Yee Kim, James Hart, Jamal Abedi, and Alan Vanneman

38. Evaluation of Teacher Quality, Stephanie L. Knight

39. Reporting Assessment Results in Higher Education, April L. Zenisky and Jerold S. Laguilles

40. Presenting Learning Outcomes Assessment Results to Foster Use, Staci J. Provezis and Natasha A. Jankowski

41. Revisiting Reliability and Validity in Higher Education Research and Program Evaluation, Margaret D. LeCompte and Dorothy Aguilera-Black Bear

42. Ethical Assessment and Institutional Advancement: Connecting Good Practice with the Need to Move Campuses Forward, Ashley Finley

Questions and Exercises for Section 6

Concluding Remarks, Charles Secolsky and D. Brian Denison

About the Contributors

 

Author Bio

Charles Secolsky is Director of Institutional Research and Planning at County College of Morris, New Jersey.

D. Brian Denison is Institutional Research Analyst at Champlain Regional College, Quebec, Canada.

Name: Handbook on Measurement, Assessment, and Evaluation in Higher Education (Paperback)Routledge 
Description: Edited by Charles Secolsky, D. Brian Denison. Increased demands for colleges and universities to engage in outcomes assessment for accountability purposes have accelerated the need to bridge the gap between higher education practice and the fields of measurement, assessment, and evaluation. The...
Categories: Higher Education, Educational Research