Library:Developing an Assessment Program

Developing an Assessment Program - Key Considerations

According to McDavid and Hawthorn (2006), when developing an assessment study, some key things to consider include:

Stakeholders
Purpose of the assessment
Program Background
Environment
Previous Data

The purpose of considering these issues in your assessment is to ensure you collect all the information necessary to, “...measure key constructs in the program logic” (McDavid and Hawthorn, 2006, p. 31)). When developing an assessment program, it needs to be structured. Working through the issues above helps to clarify what it is you wish to accomplish with what you already know. The table below outlines the information you should have before developing an assessment.

Reporting and Support	Who is the audience for the evaluation report? This section outlines the core stakeholders in the assessment. The stakeholders include individuals who are internal (e.g. librarians, department heads, LibExec) and external to the library (e.g. Faculty members, department heads). These stakeholders should guide the all processes related to the assessment development and should guide the questions you answer with the assessment data collected.
	What are the issues driving the evaluation? This section answers the question of “why.” Why are you developing an assessment program and what factors are influencing the evaluation (e.g. Strategic plan, evaluation of teaching programs in your unit, etc.).
	What resources are available to do the evaluation? This section will guide the kind of program you develop. Knowing the types of resources available, such as human or monetary, will impact the kind of assessment program commitment. Resources should also include time investments you are feasibly able to give to the assessment program from development to reporting.
Program Information	What are the features of the course/program? How is the library currently involved in the course/program? Include all forms of contact. For example, in-person workshops, online guides and tutorials, etc. What is the core content covered by the library for the course/program? Who are the faculty and how are they involved in the library collaboration?
Assessment Design	What do we want to assess? This section outllines what you want to know from your assessment (e.g. Student knowledge of searching for primary resources). You must consider the objectives and goals of your assessment to be able to articulate what you want to assess. How are you using the information? If this information is meant to guide program development and practice ...
	What assessment results are already available and can they be re-used? This section answers the question of what assessment practices you have already engaged in and what you already learned about the course, program, participants, etc. that you are assessing? This provides you with guidance on what new information you want to gather and how this information may be complimentary to previous assessment data that can help you in learning more about what/who you are assessing.
	Which research design alternatives are desirable and appropriate for the assessment objectives? To answer this question you will need to learn about assessment styles and tools. A focus group will provide you with different information than a survey. Each assessment style is suitable for variety of objectives but may be less useful for others (e.g. Using a survey to understand student navigation of a website). It would be useful to discuss your potential approaches with the Assessment Librarian.
	Which evaluation strategy is least problematical? This is an important question to answer. As you work through developing your assessment, questions of resourcing and time will impact the assessment design. Evaluating the type of assessment that will, a) gather the minimal amount of data you need to fulfill the evaluations purpose and, b) require the minimal amount of supports, may be the most feasible choice.

Use the following template to brainstorm the information necessary for developing your assessment program: File:Key Considerations for Developing a Library Assessment Template.docx

References

McDavid, J.C. & Hawthorn, L.R.L. (2005) Program Evaluation and Performance Measurement: An Introduction to Practice. London: Sage Publications.