The aim of the pilot was to undertake a usability analysis. The module contractors had run a functionality test but no pre-pilot usability testing had been carried out with any learners.
Each of the participants completed a post pilot evaluation form, largely aimed at getting feedback on ease of use and usefulness. Selections of 'enjoyable', 'interesting' and 'well paced' were selected by at least half the participants. Asked about their 'learning style', respondents confirmed earlier findings from the pre-pilot questionnaires. Greatest scores were given to 'I like to learn at my own pace', 'I like to be able to go back to check things I'm not sure about' and 'I like to be able to ask questions'. Similar patterns of confidence and experience using computers mirrored the pre-pilot questionnaire results. Interestingly, while 17 said they liked to try new ways of learning, only just over one-third said 'I like to decide when, where and how long I'll be learning'. This could be interpreted as confirming the lack of self-efficacy among many of the learners as evidenced in comments on the pre-pilot questionnaire.
Overall the feedback on the ease of use of the module was positive with an overwhelming majority enjoying the experience. About half came with expectations that the experience would be different - in which case, it was positive and appears to have overruled any negative pre-conceptions. 16 of the 25 completely agreed that covering this course content in an e-learning programme made it more interesting. 15 of the 25 showed the same high level of agreement to doing more e-learning 'like this'. With regard to perceived usefulness, a small number were unable to completely agree about the value of the 'game' in understanding the material better but only 4 completely disagreed on its value. Two-thirds said they understood everything. 12 of the 25 said they learned a lot, with a further 10 stating they learned something. Just over half said they'd be able to use all that they'd learned in their job. A small number aimed to learn enough to complete the tutorial while 15 out the 25 said that it was very important to them to get the answers to the questions right first time.
...continue to lessons learned?
|
