Assessment Mapping

With the performance outcomes (POs) developed, the next step is to figure out how to assess each of the POs. A useful approach is to build an “Assessment Map” that specifies how each PO will be measured. This mapping exercise helps ensure the POs are assessed in a systematic and thoughtful manner, employing multiple methods and measures.

Example Assessment Map:

arrow heading from top to bottom

Assessment Planning for POs
 (*D = Direct Assessment; I = Indirect Assessment)

Performance Outcome Assessment Method Criteria for Success Time Frame Responsible Parties

PO1: The Division of Academic Affairs will receive appropriate IT support to implement a campus-wide assessment system.

 Advise selection of university assessment online tool (D)
Acquire online tool (D)
Facilitate initial setup of online tool (D)

Successful identification and

acquisition of online tool

Fiscal

Year


Administration



PO2: Classrooms and appropriate study spaces will have innovative teaching and learning technology resources.		 Install appropriate teaching and learning technologies in all general use classrooms (D)
Document the number of applicable classrooms that receive innovative teaching and learning technology (D)
Conduct a survey with instructors using classrooms with new technology to evaluate its efficacy (I)

90% of classrooms on campus are equipped with appropriate technology


80% of the survey respondents rate the new technology as “effective” to promote student-centered pedagogy




2014 - 2017



Academic

Technology

Services


PO3: IT staff will be provided with professional development opportunities to enhance engagement and promote career advancement.		 Provide training programs and other professional development opportunities to all IT staff (D)
Conduct annual climate survey to identify strengths and weaknesses related to staff retention and engagement (I)		 95% of IT staff participate in at least 1 professional development opportunity per year
80% of survey respondents report to be “satisfied” with IT climate

Fiscal

Year


Administration



PO4: The University will have comprehensive campus-wide network coverage and capacity that meets its needs.		 Develop and implement a multi-year WiFi and network expansion plan for optimal coverage and capacity throughout the campus (D)
Conduct annual survey of campus community to capture their perception of WiFi and network capacity (I)
90% of campus has sufficient WiFi coverage

80% of survey respondents report to be “satisfied” with the WiFi and network capacity

2015
-
2017
IT Project

Management

and

Infrastructure

Ideally for each PO:

  • Assessment involves both direct and indirect measures, and triangulation between quantitative and qualitative methods.
  • Think about assessment methods that can yield data for multiple POs
Direct Assessment Indirect Assessment
  • Standardized exams
  • Locally developed exams
  • Questions embedded into regular course exams
  • Review by an external examiner
  • Oral exams/Presentations
  • Minute papers
  • Portfolios
  • Behavioral observations
  • Simulations
  • Project evaluations
  • Performance appraisals
  • Think-aloud problem-solving
  • Concept maps
  • Retention rate
  • Graduation rate
  • Degree Attainment

Gap analysis (delivered services vs. actual requirements)
Analysis of service usage
Analysis of error rates, processing time
  • Student self-reflection essays
  • Written surveys and questionnaires:
    • Student perception
    • Alumni perception
    • Employer perception of program
  • Exit and other interviews
  • Focus groups
  • Course evaluation

Dollar value to the local economy (e.g. research)
Comparisons to best practices in the profession
Funds raised in response to outreach efforts
Review of website hits and downloads
Percentage of requests for services fulfilled
Percentage of external stakeholders served
Compliance with industry standards