Supporting student understanding of pharmacology by the use of Audience Response Units

Project Duration

January 2009 - April 2011

Funder

University of Nottingham – Centre for Integrative Learning

Funding

£10,000

Aims

Non-medical prescribing (NMP) is a six month course for nurses and certain allied health professionals. It is critical that these students develop a good understanding of pharmacology; however, many students are mature learners with little or no formal biological science knowledge and struggle with the pharmacology component. The implications for patient safety are profound, therefore we encourage students not just to memorise enough pharmacology to pass the exam but to be able to integrate it into clinical practice. Audience response technology (ART), such as the KeePad system (KS) has been shown to promote an active approach to learning and provide instant formative feedback.

• The aim of the first part of this project was to incorporate and evaluate the use the KS in promoting pharmacology understanding in NMP students.
• The aim of the second part of this project was to evaluate the use of individualised ART handsets and formative feedback of ART scores. This study investigated student perceptions of such a system and the relationship between formative feedback results and exam performance.

Methods

Part 1 
Questions were incorporated into eight pharmacology lectures, comprising a mix of basic and clinical pharmacology, using TurningPoint software. Student (n = 33) responses to questions were recorded using the KS software and the percentage of students getting the question incorrect and correct was made immediately available in the lecture in graphical form. Survey data collected from these students investigated student perceptions on the use of the system generally and specifically as a learning tool. More in depth discussion of the usefulness of the KS was derived from a focus group comprising 5 students.

Part 2
Four successive cohorts of Non-Medical Prescribing students (n=107) had access to the individualised ART system and three of these groups (n=72) completed a questionnaire about their perceptions of using ART. Semi-structured interviews were carried out with a purposive sample of seven students who achieved a range of scores on the formative feedback. Using data from all four cohorts of students, the relationship between mean ART scores and summative pharmacology exam score was examined using a non-parametric correlation.

Outcomes and Findings

Part 1
100% of students enjoyed using the KS and felt it promoted their understanding of key concepts; 92% stated that it helped identify their learning needs and 87% agreed that the technology was useful in promoting integration of concepts. The most prevalent theme within feedback was that of identifying their own learning needs. Analysis of data from the focus group generated similar themes, with the addition of improving teaching. Repeated questioning produced a significant increase (p < 0.05) in student knowledge of specific pharmacological concepts.

The use of ART enhanced non-medical prescribing students' experience of pharmacology teaching. Student perceptions were that this system increased their ability to identify learning needs and promoted understanding and integration of concepts. Students also reported that the technology aided exam revision and reduced associated anxiety

Part 2
Questionnaire and interview data suggested that the use of ART enhanced the classroom environment, motivated students and promoted learning. Questionnaire data demonstrated that students found the formative feedback helpful for identifying their learning needs (95.6%), guiding their independent study (86.8%), and as a revision tool (88.3%). Interviewees particularly valued the objectivity of the individualised feedback which helped them to self-manage their learning. Interviewees' initial anxiety about revealing their level of pharmacology knowledge to the lecturer and to themselves reduced over time as students focused on the learning benefits associated with the feedback.A significant positive correlation was found between students' formative feedback scores and their summative pharmacology exam scores (Spearman's rho = 0.71, N=107, p<.01).

Despite initial anxiety about the use of individualised ART units, students rated the helpfulness of the individualised handsets and personalised formative feedback highly. The significant correlation between ART response scores and student exam scores suggests that formative feedback can provide students with a useful reference point in terms of their level of exam-readiness.