Gamifying Undergraduate Teaching: a true story of students and zombies

Dr Rebecca Sharpe giving her lectureDr Rebecca Sharpe from Bangor University in Wales, was our keynote speaker for the first day of our  staff development winter school. Dr Sharpe, a proud Kiwi living in Wales, brought her passion and enthusiasm of her teaching into her very honest keynote. Having worked with fellow New Zealanders, Dr Pip Ferguson and Prof Mark Brown, this is something we have just come to expect from the land of the Hakka.

Like so many other lecturers Dr Sharpe has a love for her subject and wants to pass it on to her students but for one reason or another has noticed a drop in attendance and general engagement from her students in recent times. Therefore she decided to try something new – she brought zombies into her classroom. I originally heard about Rebecca through colleagues and she seemed a perfect match for DSTEP – a psychology lecturer who actively practices gamification. Despite a Sherlock Holmes type search on Google I had no idea of the volume of time and effort that she put into this initiative. Not only did she introduce personalised learning journeys by giving students the choices of which path to choose, tracked their progress and offered students different “levels” depending on their engagement, she enlisted the help of friends from her voluntary drama society and acted out entire scenes. She mapped out her syllabus to storyline similar to a Hollywood movie, highlighting opportunities from the script to relate to theories from psychology. She then asked her students who played roles of generals, doctors and civilians to use their knowledge of these theories to make choices in which direction to go next. I sat back in awe listening to her talking about actors with scripts and buying camouflage gear and other such props to portray scenes of soldiers defending against a zombie attack. But at the same time I was fearful that is the direction where my lecturers would want to go, moving more from gamification to game based learning. I won’t lie, if someone offered me the resources to replicate this I can’t say that I wouldn’t give it a chance but the challenge with initiatives like this is sustainability. How do you keep it going in year 2, 3 and 4. What is the knock on effect it has on her colleagues, the other lecturers on the programme? Will students demand/expect this level of educational entertainment in every class? Even aside from those concerns, what do you do next year – more zombies or switch to Aliens or something more peaceful like a Disney fairytale. Students are smart and strategic learners so unless you change something like this every year they will get to know what to expect and learn how to “game the system”. Therefore reducing the impact of what you are trying to do.

Furthermore the whole essence of DSTEP (Developing Staff to Enhance Programmes) is the first two letters of the acronym”developing staff” . I was concerned that staff would ask for project funds to pay actors and buy props.

Thankfully all of these concerns were immediately  addressed in the discussion once the Q&A session started after the presentation. Rebecca did admit that she had the same concerns with regards to sustainability and the staff, while recognising the excellent work Rebecca has carried out, we’re interested in the gamification elements of the work more than the game based learning elements.

As an added bonus Rebecca has expressed a desire to keep in touch with colleagues from DCU and we will actively seek opportunities for collaboration going forward. Therefore I am delighted the Rebecca took the time to come over to Ireland and very thankful to the National Forum for this opportunity. Time and effort very well spent

 

Are all students into it? #gamification

A series of focus groups were recently conducted by the Teaching Enhancement Unit at DCU, with students enrolled on entry and advanced level research methods and statistics courses on the BSc in Psychology. These focuses groups were part of a larger scale research project (D-Step) which aims to develop staff to enhance students’ experiences of learning statistics through gamification.

From these focus groups it emerged that across levels, students have mixed experiences of learning statistics. The entry level students expressed negative expectations, yet they reported positive experiences of learning statistics, with one student stating:

“research methods was the thing that I was dreading the most and it’s actually one of the classes that I look forward to the most, I really enjoy it.”

Positive experience despite negative expectations appeared to stem from a safe learning environment, where students are free to learn through trial and error. A gamified approach to teaching statistics employed by their lecturer seemed to be the essential ingredient in creating this environment.

On the other hand, advanced level students expressed negative experiences of learning statistics and research methods. These negative experiences stemmed from a learning environment which is created by a traditional approach to teaching statistics and research methods. Students felt that this environment was not conducing to learning and resulted in an “awful” experience.

Across levels students were open to gamification as a tool for enhancing their learning experiences. Students could see how gamification fit with the teaching of statistics and its potential for transforming the learning environment. One student stated:

“Using this tactic in research would be the most beneficial… it’s building blocks and you really need to know… understand from day 1 what you are doing and why you’re doing it.”

The game elements that students were most interested in was a freedom to make mistakes, rapid feedback, rewards, avatars, and time restrictions.

Despite being open to gamification, students also express concerns about the peer comparison. Students do not like peer comparison and are concerned that it will alter the class culture by creating a tense competitive rather than cooperative learning environment. One student stated:

“I wouldn’t like the competitive nature of it. Like, I know in normal games it is fun, but when you are comparing, like we don’t like, our class isn’t like that, we don’t talk about results… so, I think that it could create an element of tension.”

If gamification were to be implemented it has to be designed in a way that it addresses the learning needs of students. Students expressed that they need statistics to be broken down into steps to increase comprehension and ease anxiety, and they also need to be able to practice statistics without consequences. One student stated:

“It’s a practical subject, so if it is going to be practical it needs to be practiced.”

Students also report that they need more interaction with peers and they see advantages in collaborative peer support for statistics. Rapid feedback cycles are also valued by students as a mean to helping them perform better, achieve goals and re-evaluate their lesson. Although students do not like peer comparison, they express the need for a ranking system which uses standardised scores without introducing leader boards.

In relation to rewards, students expressed that they will need real and not token rewards to be motivated to engage with gamification. The rewards students are most motivated by are grades:

“The only thing that I would really be rewarded by though is if I completed a certain amount that you get a percentage you know off your grade”

The findings from these focus groups will be used to inform gamified software for teaching statistics that caters to students learning needs and concerns in relation to gamification.

Gamification – what do staff think?

A series of focus groups were recently conducted by the Teaching Enhancement Unit at DCU, with lecturing staff teaching on Psychology, Education and Business courses. These focus groups were part of a larger scale research project (D-Step), which aims to develop staff to enhance students’ experiences of learning research methods and statistics through gamification.

It emerged that although a handful are already using gamification to enhance their teaching, the majority of lecturing staff are unaware of what gamification is and seem to mistake it for game based learning. Game based learning is the application of an established game such as “Who Wants to Be a Millionaire” to an educational context. Whereas, gamification is the application of game design features such as points, levels, rewards and leader-boards, to non-game contexts such as education. Despite not knowing much about gamification, there was a strong sense of openness toward gamification as a useful teaching tool.

Those who have experience of using gamification expressed that it is an excellent tool for transforming learning into a fun, engaging and motivating process. After describing an application of gamification, one participant described how the students:

“Would score it as the best experience of, learning experience of the two years of their programme, consistently”

Gamification was also perceived as a powerful teaching tool for feedback and monitoring, amongst those who have used it. One person described:

“It was very useful as a learning tool, for me to be able to go back to them in real time with that evidence base, and say to them you are telling me you don’t know this, or you haven’t quite got it. So, I am going to go over it for that reason.”

The fit of gamification with the teaching of research methods and statistics was expressed across all disciplines. Lecturing staff discussed useful applications of gamification to identifying a research gap, evaluating sources, referencing, and statistical computations.

Lecturing staff found the ideas of self-directed learning paths, feedback, and freedom to make mistakes in gamification the most interesting. When discussing the power of gamification to transform failure, one person stated:

“why when you play a game you can motivate people despite failing 10-15 times, but then when they fail analysis of variance they don’t want to go back to it”

Despite seeing the fit of gamification with the teaching of research methods, concerns surrounding the negative impact of peer comparison, student perceptions of gamification and time constraints emerged. Lecturers were concerned that peer comparison would negatively impact students who are falling behind, and, that it may foster externalized motivation based on points rather than internalized motivation based on personal enjoyment. There was also a concern that students would perceive gamification as being silly and that this may result in less engagement from mature students with families or those undertaking part time employment. It was also expressed that gamification could place extra demands on the lecturer as well as it could take from valuable teaching time, one person described:

“The concern might be that so much is involved on behalf of the lecturer, you are becoming now game designer and the student now is their time being taken away from the learning by being a player?”

Perceived barriers to implementing gamification also emerged amongst staff, which included high cost of gamification, lack of suitability to large groups, technological support and beliefs that gamification cannot facilitate deep learning.

Before gamification can be implemented it appeared that staff require additional training, as their digital capacity for implemented gamification in loop is limited. The majority of lecturers use loop as a digital archive, with only a few experimenting with more engaging tools such as quizzes. Despite the limited digital capacity there was a strong desire amongst staff to improve their digital capacity to enhance their teaching. To implement gamification in their classroom, staff reported training needs in relation to theory, technology, understanding student motivations and personal experience of gamification. Most expressed that they would prefer face to face training, but that it is not always feasible so a blended approach would be the most suitable.

Making your course content look good

It’s easy when you know how, but it is getting that “know how” is the challenge. We were very lucky to have Pete Sparkes from University of Sussex teaching and learning unit to come over and provide  workshop to staff as part of the DSTEP project.

Pete works as a learning technologist in Sussex and works with lecturers to help them make their course pages engaging for students. In this instance we invited Pete over to show us how to with a few simple tips and tricks make Moodle “Lessons” and “Books” more look like professional webpages instead of plain Moodle pages.

Illustrated example of code change
Example of what a Moodle page could like after and before code was applied

Simply by inserting a little bit of what is known as HTML code into your course page you can transform the way it looks (as illustrated in the picture above). What was even more impressive was that Pete showed us how you can embed what is known as a “style sheet” on your course page and it will automatically make the changes to the look and feel of the page without lecturers having to know how to use HTML code. There is huge potential with this and from a personal viewpoint my next step is to engage with our Communications and Marketing department to come up with a “stylesheet” that matches our new branding that will be launched shortly.

We had a full house at the workshop and the staff really engaged with the ideas that Pete showcased. They left with the enthusiasm and ambition that I have grown to expect from DCU, excited with ideas on how they can improve the learning experience for students.  In terms of sustainability Pete was incredibly generous, he has provided all of his workshop materials including some worked examples. The workshop material is now freely available under Creative Commons as a Moodle lesson. To access this content please contact mark.glynn@dcu.ie

Making your learning content interactive through H5P

Once of the common criticisms of VLE’s is that staff just use them as document repositories and dump their powerpoints and PDF’s up there. While these files can prove useful, it offers limited opportunity for the student to engage with the course outside of class times.

In an effort to measure impact of our project we have focussed the workshops that we provide so that staff can make their course pages more engaging.  It is for this reason that we have chosen to add H5P to our VLE for the coming year. There are numerous activities in Moodle that can encourage engagement but this year we are excited with the introduction of H5P*. This activity is based on an open source piece of software used to create web based content. There are numerous features available through H5P with several features particularly of interest to educators.  One that immediately stands out is the ability to embed a video from Youtube into your course page and then add in questions and overlay information on top of the video, even though you don’t own the original video posted on Youtube. This allows a lecturer to insert “engagement points” on the videos to check a students understanding or to supplement the content in the videos. The lecturer also has the ability to prevent the student progressing in the video until they have successfully complete any questions presented to them. So there is huge potential with H5P for lecturers and over the next few months we will provide a variety of workshops on how to use H5P.

h5p MCQ example
An example of a video stopping and the user prompted with a MCQ

In terms of sustainability the material created to supplement the workshops that will be delivered will be able as online learning resources available to all staff throughout the entire sector. The will be created under Creative Commons licences that will allow them to be used or modified if required.

 

*H5P is available through http://www.H5P.org and you can build content directly on this website if you don’t have Moodle. 

 

 

Enhancing our Programmes: How far have we come?

This week marks our first reporting back to the Forum on our progress since receiving the funding for DSTEP. For internal reasons we have started slower than we had planned in so far as the project was due to start in January but with the exception of one workshop in January it didn’t really get going until March. So we are playing catch up in terms of meeting the metrics and milestones that we identified in our submission.

The knock on affect of starting late is that the semester was fully underway before we could start to work with the staff and logistically speaking there are only a few small windows in the academic year when it is practical to provide staff development.  So even though we had a 3 month delay in starting it actually pushed our staff development aspect back by 5-6 months. To address this we swapped around a few priorities on our work plan and used this time during the semester to create resources for the staff connected to this project. Therefore despite the delay in starting we are more than confident that we will “catch up” over the next few months.  Our target is that by the end of January 2018 we will have caught up with our original targets which includes a full suite of workshops delivered during the semester break.

 

Effective online quiz design

It’s quite easy to make an online quiz but not so easy to create an effective quiz. Depending on the platform that you use to provide the online quiz, the statistics that you have access can be incredibly powerful. In our instance, with Moodle, in addition to the standard data of a breakdown of students answers, two very useful figures are produced. The Facility index for each question (how easy the question is) and the Discrimination index (can the question differentiate between an “A” student and a “D” student). The short screencast below shows you how to access these statistics on Moodle.

But the first question for you should be  – how to a write a good question – to give me a good score for the facility index and discrimination indexes. This is why we had our first official workshop of the project provided by Dr David Walker, Head of Teaching Enhanced Learning in University of Sussex along with his colleague Tony Coombes. It was an engaging workshop on “what makes a good question” in terms of creating quiz questions for students.

 

In terms of sustainability David and Tony have very kindly kindly made their slides available for everyone to use. This includes the sample exercises within the presentation. Specifically related to this project, staff have already identified the opportunity for inserting quizzes into their modules and will aim to produce content in the coming months.

Laying the foundations – getting ready for DSTEP and beyond

A strong part of the feedback received from the review panel with the Forum was the apparent emphasis on programme re-development (introducing gamification) and how this was not the purpose of this funding. As the presentation to the panel was recorded but the Q&A was not I am delighted to share with you the panel accepted our justification that we put forward. We argued that if a staff member wanted to gamify their course, they need to have the foundations  in place. Those foundations are only achieved through CPD. For example if they wanted to  provide a student with a personalised learning pathway (a common gamification technique), they would have to know how to create online content, provide conditional access to course content and then provide a personalised engagement dashboard to illustrate to the learner “where they are” on their learning pathway. So to implement one element of gamification requires three separate workshops.

For now we are behind schedule and reality is that it may be the end of the semester before we can get the focus groups up and running to determine the staff requirements. However we can quietly work in the background to build instructional resources to support staff when the time comes to roll out the workshops and the one-one professional development sessions. We also will work on