Documentation:Digital Tattoo Case Studies Project/Education/Assessment

From UBC Wiki
Jump to: navigation, search

This is for our draft notes related to assessment (pre-post) for the DT Case studies - classroom implementation.

Goal for assessment

  • to assess change related to confidence in decision making specific to social media as a new professional.
  • to assess changes related to knowledge and awareness of the risks and opportunities of using technology in and out of classrooms as a new professional.

Questions/ Thoughts

  • how robust should the assessment be? In context of pre-assessment and post assessment?
  • duplication of questions - pre and post? Goal to document change?
  • comment boxes or some opportunity for people to have reflection.
  • questions about technology use - only in relation to decision making
  • assessing social media practices based on new awareness.

Questions for Teacher Candidates

  • how prepared are you to be held to a higher standard - as a new teacher?
  • how prepared do you feel to enter into the workforce with the expectations that are laid out for you?

Issues about preparedness

  • pre-assessment may indicate overconfidence or underconfidence
  • post assessment may ask students to compare how confident they felt at the beginning and after.

Logistics

  • single survey or multiple?
  • funding for student to continue - Sept - Dec.
  • ask Rod and John to send out pre-session notice re: device on hand

Suggested Questions: Pre-survey

The newest draft (July 26) is available at this link: https://survey.ubc.ca/s/digital_tattoo_pre/

The questions are also written below:

Note: Some of the current questions address social media but not technology as a whole, as I wanted to avoid double-barreled questions. How should other uses of technology be addressed in the surveys?


1. I understand the meaning of the term “digital identity.”

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree
  • I’m not sure


2. I feel confident in my ability to make decisions about my digital identity.

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree


3. I am aware of the benefits of using social media and technology as a teacher.(Double-barreled?)

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree


4. I am aware of the risks of using social media and technology as a teacher. (Double-barreled?)

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree


5. As a teacher, I plan to use social media for personal and/or professional purposes.

  • Both personal and professional purposes
  • Personal purposes only
  • Professional purposes only
  • Neither personal nor professional purposes
  • I'm not sure


6. I believe that my current use of social media meets the standards of a new teacher.

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree
  • I’m not sure


7. I intend to make changes to my digital identity as I transition from student to teacher.

  • Definitely
  • Probably
  • Maybe
  • Probably not
  • Definitely not
  • I have already done so


8. I have enough knowledge to make informed decisions about my use of social media as a teacher. (Too similar to question 1?)

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree
  • I’m not sure


9. I am prepared to navigate issues related to my digital identity that may arise in the future.

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree
  • I’m not sure


Question: Do we want to gauge students' understanding of the term "digital identity" in the surveys?


Older questions:

  • In what ways are teachers held to a higher standard? (select all that apply)
  • political views
  • attitudes & values
  • public behavior
  • Is it worth being more specific about broad categories? For example, "public behaviour" could refer to attire, drinking, crude language, etc. when outside of school, but it could also refer to things like protests and attendance at other public events. Do we want to keep all of these together in one category?
  • Do we want to include this question even though it is not directly related to confidence or decision-making?
  • How aware are you of policies related to teachers' professional conduct?
  • not at all
  • somewhat
  • very
  • How aware are you of the benefits of social media use for teachers?
  • not at all
  • somewhat
  • very
  • How aware are you of the risks associated with social media use for teacher?
  • not at all
  • somewhat
  • very
  • I feel I have enough information to make decisions about my online presence on social media.
  • not at all
  • somewhat
  • very
  • I feel confident in my ability to make decisions about my social media presence as I transition from student to professional.
  • not at all
  • somewhat
  • very
  • I have taken steps to align my social media presence to my goals as an emerging professional.
  • not yet
  • some
  • many
  • Do you feel prepared to navigate any issues related to social media that may arise?
  • not at all
  • somewhat
  • very

Draft

A draft of the pre-assessment survey is available at the following link: Teacher Candidates - DT Pre-Assessment Survey.

Suggested Questions: Post-survey

The newest draft (July 26) is available at this link: https://survey.ubc.ca/s/digital_tattoo_post/

The questions are also written below:

Note: Some of the current questions address social media but not technology as a whole, as I wanted to avoid double-barreled questions. How should other uses of technology be addressed in the surveys?


1. I feel more confident in my ability to make decisions about my digital identity (identities?) after participating in this workshop.

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree


2. This workshop had made me more aware of the benefits of using social media and technology as a teacher.

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree


3. This workshop had made me more aware of the risks of using social media and technology as a teacher.

  • Strongly agree
  • Agree
  • Neither agree nor disagree
  • Disagree
  • Strongly disagree


4. As a teacher, I plan to use social media for personal and/or professional purposes.

  • Both personal and professional purposes
  • Personal purposes only
  • Professional purposes only
  • Neither personal nor professional purposes
  • I'm not sure


5. After completing this workshop, I believe that my digital identity (identities?) already meets the standards of a new teacher.

  • Strongly agree
  • Agree
  • Neither agree nor disagree
  • Disagree
  • Strongly disagree
  • I'm not sure


6. As a result of this workshop, I plan to do one or more of the following:

  • Create one or more new social media accounts
  • Delete one or more of my current social media accounts
  • Make changes to one or more of my current social media accounts
  • I plan to make no changes to my use of social media
  • Other: ____________________

Or

6. Following this workshop, I intend to make changes to my digital identity (identities?) as I transition from student to teacher.

  • Definitely
  • Probably
  • Maybe
  • Probably not
  • Definitely not
  • I have already made all necessary changes


7. I have enough knowledge and resources to make informed decisions about my digital identity (identities?) as a teacher. (Too similar to question 1?)

  • Strongly agree
  • Agree
  • Neither agree nor disagree
  • Disagree
  • Strongly disagree
  • I'm not sure


8. I am prepared to navigate issues related to my digital identity that may arise in the future.

  • Strongly agree
  • Agree
  • Neither agree nor disagree/Neutral
  • Disagree
  • Strongly disagree
  • I’m not sure


9. I will access the the resources provided to me in this workshop in the future.

  • Definitely
  • Probably
  • Maybe
  • Probably not
  • Definitely not


10. Do you have any other thoughts you would like to share with us? [open response]


Question: Do we want to gauge students' understanding of the term "digital identity" in the surveys?


Older questions begin here:

  • How strongly do you feel that you have taken/will take steps to align my social media presence to my goals as an emerging professional?


  • Now that you have discussed one of the case studies, rate your confidence in your ability to think through making various decisions
  • very
  • some
  • not at all
  • How likely are you to access the other case studies for your own professional development?
  • very
  • some
  • not at all
Add links to teaching resources and digital tattoo in post survey assessment::


Draft (July 14):

Post-Workshop Survey


Select the answers that best reflect your responses to the following statements.

("As a result of this workshop..." for some of the questions?)

1. I am _________ aware of policies and guidelines related to a teacher’s use of social media.

  • very
  • somewhat
  • not at all

2. I understand ___________ of the benefits of using social media as a teacher.

  • many
  • some
  • none

3. I understand ___________ of the risks of using social media as a teacher.

  • many
  • a few
  • none


4. I have _____________ of the information I need to make decisions related to the use of social media as a teacher. (reframe to having “enough” information?)

  • all
  • some
  • none

5. I feel ____________ confident making decisions about my use of social media as I transition from student to teacher.

  • very
  • somewhat
  • not at all

How has this workshop impacted your level of confidence?

  • It has made me more confident.
  • It has made me less confident.
  • It has not impacted my level of confidence.

6. I feel ____________ prepared to navigate any issues related to my digital identity that may arise in the future.

  • very
  • somewhat
  • not at all

7. I will take steps to align my digital identity with my goals as an emerging professional.

  • Yes
  • No
  • Maybe
  • I have already done so

8. I plan to access the resources provided to me in this workshop in the future.

  • Yes
  • No
  • Maybe

9. I plan to access the case studies I did not read during this workshop in the future.

  • Yes
  • No
  • Maybe

New Options for Questions:

Do you intend to use social media as a teacher for either personal or professional reasons? (Before question 4) Definitely Probably Maybe Probably not Definitely not (Don’t know)

Could have questions that focus more on the workshop instead:

This workshop has made me feel more confident about my ability to make decisions related to the use of social media.

  • Strongly agree
  • Somewhat agree
  • Neither agree nor disagree/Neutral
  • Somewhat disagree
  • Strongly disagree
  • Don’t know(?)

or Did this workshop make you feel more confident making decisions about your use of social media as a teacher?

  • Helped significantly
  • Helped somewhat
  • Didn’t really help
  • Didn’t help at all

As a result of this workshop, do you plan to do any of the following?

  • Create one or more social media accounts
  • Delete one or more social media accounts
  • Make changes to one or more of my current social media accounts (or my use of current social media accounts?)
  • I plan to make no changes to my use of social media
  • Other: ____________________

Do you intend to make changes to your digital identity as you transition from student to teacher?

  • Definitely
  • Probably
  • Maybe
  • Probably not
  • Definitely not

Do you feel prepared to make these changes as a result of this workshop?

  • I feel prepared.
  • I feel somewhat prepared.
  • I don’t know/Neutral
  • I feel somewhat unprepared.
  • I feel unprepared.


Alternative: Could phrase questions as “Choose which statement you most agree with” as was done in the following question:

Which ONE of the opinions best represents your view about abortion in the first 3 months of pregnancy?

  • Abortion should never be allowed.
  • Abortion should be allowed ONLY if the life and health of the woman is in danger.
  • Abortion should be allowed if, due to personal reasons, the woman would have difficulty in caring for the child.
  • Abortion should be allowed for ANY reason, because no one should be forced to continue a pregnancy

(Question from: https://open.library.ubc.ca/cIRcle/collections/facultyresearchandpublications/52383/items/1.0074725)


E.g. Select the statement with which you most agree.

  • I feel VERY confident making decisions about my use of social media as I transition from student to teacher.
  • I feel SOMEWHAT confident making decisions about my use of social media as I transition from student to teacher.
  • I DO NOT feel confident making decisions about my use of social media as I transition from student to teacher.


Alternative: Could provide scale for questions.

E.g. Using the scale provided, rate the degree to which you agree with the following statement: “I feel confident making decisions about my use of social media as I transition from student to teacher.”

  • 1 (Not confident)
  • 2
  • 3
  • 4
  • 5 (Extremely confident)