Documentation:Digital Tattoo Case Studies Project/Education/Assessment

This is for our draft notes related to assessment (pre-post) for the DT Case studies - classroom implementation.

Goal for assessment

to assess change related to confidence in decision making specific to social media as a new professional.
to assess changes related to knowledge and awareness of the risks and opportunities of using technology in and out of classrooms as a new professional.

Questions/ Thoughts

how robust should the assessment be? In context of pre-assessment and post assessment?
duplication of questions - pre and post? Goal to document change?
comment boxes or some opportunity for people to have reflection.
questions about technology use - only in relation to decision making
assessing social media practices based on new awareness.

Questions for Teacher Candidates

how prepared are you to be held to a higher standard - as a new teacher?
how prepared do you feel to enter into the workforce with the expectations that are laid out for you?

Issues about preparedness

pre-assessment may indicate overconfidence or underconfidence
post assessment may ask students to compare how confident they felt at the beginning and after.

Logistics

single survey or multiple?
funding for student to continue - Sept - Dec.
ask Rod and John to send out pre-session notice re: device on hand

Suggested Questions: Post-survey

The newest draft (July 26) is available at this link: https://survey.ubc.ca/s/digital_tattoo_post/

The questions are also written below:

Note: Some of the current questions address social media but not technology as a whole, as I wanted to avoid double-barreled questions. How should other uses of technology be addressed in the surveys?

1. I feel more confident in my ability to make decisions about my digital identity (identities?) after participating in this workshop.

Strongly agree
Agree
Neither agree nor disagree/Neutral
Disagree
Strongly disagree

2. This workshop had made me more aware of the benefits of using social media and technology as a teacher.

Strongly agree
Agree
Neither agree nor disagree/Neutral
Disagree
Strongly disagree

3. This workshop had made me more aware of the risks of using social media and technology as a teacher.

Strongly agree
Agree
Neither agree nor disagree
Disagree
Strongly disagree

4. As a teacher, I plan to use social media for personal and/or professional purposes.

Both personal and professional purposes
Personal purposes only
Professional purposes only
Neither personal nor professional purposes
I'm not sure

5. After completing this workshop, I believe that my digital identity (identities?) already meets the standards of a new teacher.

Strongly agree
Agree
Neither agree nor disagree
Disagree
Strongly disagree
I'm not sure

6. As a result of this workshop, I plan to do one or more of the following:

Create one or more new social media accounts
Delete one or more of my current social media accounts
Make changes to one or more of my current social media accounts
I plan to make no changes to my use of social media
Other: ____________________

Or

6. Following this workshop, I intend to make changes to my digital identity (identities?) as I transition from student to teacher.

Definitely
Probably
Maybe
Probably not
Definitely not
I have already made all necessary changes

7. I have enough knowledge and resources to make informed decisions about my digital identity (identities?) as a teacher. (Too similar to question 1?)

Strongly agree
Agree
Neither agree nor disagree
Disagree
Strongly disagree
I'm not sure

8. I am prepared to navigate issues related to my digital identity that may arise in the future.

Strongly agree
Agree
Neither agree nor disagree/Neutral
Disagree
Strongly disagree
I’m not sure

9. I will access the the resources provided to me in this workshop in the future.

Definitely
Probably
Maybe
Probably not
Definitely not

10. Do you have any other thoughts you would like to share with us? [open response]

Question: Do we want to gauge students' understanding of the term "digital identity" in the surveys?

Older questions begin here:

How strongly do you feel that you have taken/will take steps to align my social media presence to my goals as an emerging professional?

Now that you have discussed one of the case studies, rate your confidence in your ability to think through making various decisions

very
some
not at all

How likely are you to access the other case studies for your own professional development?

very
some
not at all

Add links to teaching resources and digital tattoo in post survey assessment::

Draft (July 14):

Post-Workshop Survey

Select the answers that best reflect your responses to the following statements.

("As a result of this workshop..." for some of the questions?)

1. I am _________ aware of policies and guidelines related to a teacher’s use of social media.

very
somewhat
not at all

2. I understand ___________ of the benefits of using social media as a teacher.

many
some
none

3. I understand ___________ of the risks of using social media as a teacher.

many
a few
none

4. I have _____________ of the information I need to make decisions related to the use of social media as a teacher. (reframe to having “enough” information?)

all
some
none

5. I feel ____________ confident making decisions about my use of social media as I transition from student to teacher.

very
somewhat
not at all

How has this workshop impacted your level of confidence?

It has made me more confident.
It has made me less confident.
It has not impacted my level of confidence.

6. I feel ____________ prepared to navigate any issues related to my digital identity that may arise in the future.

very
somewhat
not at all

7. I will take steps to align my digital identity with my goals as an emerging professional.

Yes
No
Maybe
I have already done so

8. I plan to access the resources provided to me in this workshop in the future.

Yes
No
Maybe

9. I plan to access the case studies I did not read during this workshop in the future.

Yes
No
Maybe

New Options for Questions:

Do you intend to use social media as a teacher for either personal or professional reasons? (Before question 4) Definitely Probably Maybe Probably not Definitely not (Don’t know)

Could have questions that focus more on the workshop instead:

This workshop has made me feel more confident about my ability to make decisions related to the use of social media.

Strongly agree
Somewhat agree
Neither agree nor disagree/Neutral
Somewhat disagree
Strongly disagree
Don’t know(?)

or Did this workshop make you feel more confident making decisions about your use of social media as a teacher?

Helped significantly
Helped somewhat
Didn’t really help
Didn’t help at all

As a result of this workshop, do you plan to do any of the following?

Create one or more social media accounts
Delete one or more social media accounts
Make changes to one or more of my current social media accounts (or my use of current social media accounts?)
I plan to make no changes to my use of social media
Other: ____________________

Do you intend to make changes to your digital identity as you transition from student to teacher?

Definitely
Probably
Maybe
Probably not
Definitely not

Do you feel prepared to make these changes as a result of this workshop?

I feel prepared.
I feel somewhat prepared.
I don’t know/Neutral
I feel somewhat unprepared.
I feel unprepared.

Alternative: Could phrase questions as “Choose which statement you most agree with” as was done in the following question:

Which ONE of the opinions best represents your view about abortion in the first 3 months of pregnancy?

Abortion should never be allowed.
Abortion should be allowed ONLY if the life and health of the woman is in danger.
Abortion should be allowed if, due to personal reasons, the woman would have difficulty in caring for the child.
Abortion should be allowed for ANY reason, because no one should be forced to continue a pregnancy

(Question from: https://open.library.ubc.ca/cIRcle/collections/facultyresearchandpublications/52383/items/1.0074725)

E.g. Select the statement with which you most agree.

I feel VERY confident making decisions about my use of social media as I transition from student to teacher.
I feel SOMEWHAT confident making decisions about my use of social media as I transition from student to teacher.
I DO NOT feel confident making decisions about my use of social media as I transition from student to teacher.

Alternative: Could provide scale for questions.

E.g. Using the scale provided, rate the degree to which you agree with the following statement: “I feel confident making decisions about my use of social media as I transition from student to teacher.”

1 (Not confident)
2
3
4
5 (Extremely confident)