Documentation:LMS Handson Lab Guide

From UBC Wiki

LMS Evaluation Lab Procedures Guide

Welcome to the LMS Evaluation Lab!

As an Observer, you are integral to the success of UBC’s LMS evaluation and selection process. You will be relied upon to provide first class customer service, accurate and educated computer assistance, and a spirit and enthusiasm for teamwork.

Purpose of this Guide

The purpose of this orientation guide is to orient Observers to their role and responsibilities in the LMS Evaluation Lab. To this end, this guide is intended as a general reference.

You can also download a PDF of this guide.

Background

UBC’s core enterprise learning management system is WebCT/Blackboard Vista. Blackboard, the vendor, has stated that support for Vista will end in January 2013 and UBC’s current license is up for renewal in June 2012. These two events prompted the university to reassess its learning management system requirements. The objective of the hands-on testing sessions is to evaluate the ease of use and functionality of each product. In addition, they will ensure that the selected product will meet our teaching and learning needs. Details regarding the LMS Selection project can be found on the LTAC website: http://ltac.ubc.ca/

Roles & Responsibilities

Role

The role of the observer is to manage, help, and guide Evaluators in the hands-on process of evaluating the two short-listed Learning Management Systems - Blackboard and Moodle.

Responsibilities

  • Ensure that the computers in the labs are turned-on and evaluators can access the desktop and required software.
  • Distribute the evaluation rubrics and surveys to each evaluator prior to the start of each session.
  • Provide the ‘Introduction’ prior to start of each session.
  • Provide assistance to the evaluators when required.
  • Ensure that the task-based rubrics and surveys are collected from evaluators prior to them leaving the lab session.
  • Assist with testing the Chat feature.
  • Provide support for lab software and hardware as needed.
  • At the end of your lab session, fill out the Observer Form (time permitting)
  • Remember that labs must have coverage at all times.
  • Last but not least, observers must remain neutral and unbiased when interacting with evaluators, and may not interfere in any way with the testing procedures

Evaluation Guidelines

  • The evaluation should take approximately 1 hour to complete.
  • Evaluators can take as much time as they have available unless there is time restrictions stipulated by the schedules.
  • Evaluators should test the areas/functions that are of interest to them and then test the others as time permits.

During the Evaluation Session: Step-by-Step

Step 1

Ensure that the computers in the labs are turned-on and evaluators can access the desktop and required software.

Step 2

Distribute or provide instructions on completing the evaluation rubrics and surveys (as directed by your faculty coordinators) prior to the start of the evaluator's session. Ensure that the correct forms (student vs. faculty) and directions are provided to the evaluators.

Step 3

Provide the login account information and evaluation site information as directed by your faculty coordinator.

Step 4

Provide the following Introduction to evaluators:

"UBC’s core enterprise learning management system is WebCT/Blackboard Vista. Blackboard, the vendor, has stated that support for Vista will end in January 2013 and UBC’s current license is up for renewal in June 2012. Therefore, the university has undertaken a process to assess its learning management system requirements. We would like to ensure that the next system meets the teaching and learning needs of UBC. We appreciate your participation in the evaluation process and your input in assisting us in selecting the right product.

Please take as much time as you need for the evaluation. If your time is limited, please test the areas that are of priority to you.

We recognize that we are asking you to test these products without having participated in any training sessions in their use. If you need some help during the evaluation process, screencasts are available at http://ltac.ubc.ca/resources/screencasts/ for both LMS options. Each screencast describes a specific tool or feature.

Also, please complete the evaluation rubrics and the surveys that have been handed-out to you and dropped them by at [your drop off location] once you are done"

OPTIONAL

Getting started guides are also available for testers:


Step 5

If the evaluators are having difficulties completing the tasks on the evaluation rubrics, advise them that screencasts have been created to provide step-by-step instructions.

Step 6

Collect the completed evaluation rubrics and surveys and forward them to [as directed by your faculty coordinator].

Step 7

Time permitting, complete the Observer Form

Conflicts

As both a representative of the university and an authority figure in the lab, you have the responsibility to act professionally when dealing with people who may have attitudes that differ from your own or others. Knowing how to handle difficult situations properly is a key part of the role of the observer.

  • For minor conflicts, try to come to an acceptable resolution through reasonable discussion.
  • Sometimes it is enough to “agree to disagree” to prevent unnecessary escalation of a problem.
  • If the conflict is not readily resolvable and becomes disruptive to the lab, contact [as directed by your faculty coordinator].

Troubleshooting Resources

  • Should you encounter any problems with either hardware or software that you are unable to resolve, please call [as directed by your faculty coordinator].
  • If a situation arises that you cannot handle, please call at [as directed by your faculty coordinator].

Blank Course Testing Policy

If an evaluator feels they would like to have further hands-on testing in Moodle and Blackboard, a request can be sent to sandra.yee@ubc.ca.