Using Qualtrics Survey Analysis

Selection of Evaluation Participants
Using Qualtrics Survey Software, an electronic survey was created to conduct an evaluation on the effectiveness of an intervention video. The survey design was a combination of a pre-post test, with addition of a retrospective pre-assessment design. Facebook and personal networks were the source of recruitment. Multiple Facebook messages were posted on the main page as well as on specialty groups. As an incentive, one dollar would be donated to a non-profit organization for every survey completed. For ease and to ensure parental consent was not needed, only those who were age 18 and older were allowed to volunteer to complete the survey. Overall, 42 participants completed the survey. Of the sample size,
The introduction stated the purpose of the survey, deadline, incentive, instructions to complete the survey, and the disclaimer. The disclaimer was posted before the survey to let participants know the contents and opinions in the video was of the presenters and to offer an additional resource on sushi making. The disclaimer stated “I am not responsible for the contents contained in this video. The views are those of the presenter. If you would like more information on making sushi, please search for your local sushi class. If you are in the bay area, you can visit www.breakthroughsushi.com for sushi making courses.” The next section consisted of demographic information. Participants were asked to identify their gender, if they had experience with making sushi, and if so, their experience level.
The first section of the survey was the pre-test. Four knowledge based questions were asked. Participants answered this survey prior to watching the video to test their knowledge on making sushi. After answering the pre-test questions, participants watched a 3.5 minute video on “How to Make Sushi rolls. Following the video, participants answered the post-test questions which included the same four knowledge based questions in the pre-test and a retrospective pre-test of three skill-based self-efficacy questions. Appendix A shows the specific questions participants were asked to
The pre-test mean knowledge scores regarding sushi measurements is .50 (sd=.35) and the post-test mean knowledge scores is .77 (sd=.35). The pre-test mean knowledge scores statistically differ from the post-test mean knowledge scores (t(41)=-3.99, p<.001 (two-tailed)). However, male (m= .81, sd= .35) and female (m= .88, sd= .22) overall post-test mean knowledge scores did not significantly differ from each other (z= -.31, p=.814(two-tailed)). Table 2 summarizes the median and statistics of the participants’ confidence