9. Resources
Please select any of the folllowing buttons to view further information related to this learning resource.
Glossary
| Term | Definition |
|---|---|
| Construct | A hypothetical concept or traA hypothetical concept or trait that the questionnaire is developed to assess or measure. it that the questionnaire is developed to assess or measure. A hypothetical concept or trait that the questionnaire is developed to assess or measure. |
| Correlation | It refers to a linear relationship between two variables in which any change in one variable impose a change in other variable either positively or negatively. |
| External validity | It refers to the extent to which the study results could be generalised over different populations, contexts and times. |
| Internal validity | It refers to how the study design inferring the true relationship between independent and dependent variables. |
| Reliability | It is the evaluation of reproducibility of results of a questionnaire and consistency of its items to measure certain construct. |
| Validity | The degree to which the study tool measures what is intended to measure. |
Resources
| Developing questionnaires for educational research |
|---|
| Anthony R. Artino Jr., Jeffrey S. La Rochelle, Kent J. Dezee & Hunter Gehlbach Developing questionnaires for educational research: AMEE Guide No. 87, Medical Teacher. 2014: 36:6, 463-474, DOI: 10.3109/0142159X.2014.889814 |
| Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine |
| Tsang S, Royse CF, Terkawi AS. Guidelines for developing, translating, and validating a questionnaire in perioperative and pain medicine. Saudi J Anaesth. 2017;11(Suppl 1):S80-S89. doi:10.4103/sja.SJA_203_17 |
| How to … Write and Analyse a Questionnaire |
| Williams A. How to … Write and Analyse a Questionnaire. Journal of Orthodontics. 2003;30(3):245-252. doi:1093/ortho.30.3.245 |
| Methods for pre-testing and piloting survey questions: illustrations from the KENQOL survey of health-related quality of life |
| Bowden A, Fox-Rushby JA, Nyandieka L, Wanjau J. Methods for pre-testing and piloting survey questions: illustrations from the KENQOL survey of health-related quality of life. Health Policy Plan. 2002 Sep;17(3):322-30. doi: 10.1093/heapol/17.3.322. PMID: 12135999. |
| Objectifying content validity: Conducting a content validity study in social work research |
| Doris McGartland Rubio, PhD, Marla Berg-Weger, PhD, LCSW, Susan S. Tebb, PhD, E. Suzanne Lee, PhD, Shannon Rauch, MS, Objectifying content validity: Conducting a content validity study in social work research, Social Work Research, Volume 27, Issue 2, June 2003, Pages 94–104 |
| Piloting |
| Pilot a questionnaire |
| Pretesting and pilot testing |
| Ruel, E., Wagner III, W. & Gillespie, B. (2016). Pretesting and pilot testing. In Ruel, E., Wagner III, W., & Gillespie, B. The practice of survey research(pp. 101-119). Thousand Oaks, CA: SAGE Publications, Inc doi: 10.4135/9781483391700 |
| Principles and methods of validity and reliability testing of questionnaires used in social and health science researches |
| Bolarinwa OA. Principles and methods of validity and reliability testing of questionnaires used in social and health science researches. Niger Postgrad Med J 2015;22:195-201 |
| Selecting, designing, and developing your questionnaire |
| Boynton PM, Greenhalgh T. Selecting, designing, and developing your questionnaire. BMJ. 2004;328(7451):1312-1315. doi:10.1136/bmj.328.7451.1312 |
| The quality of measurement: reliability and validity |
| Ruel, E., Wagner III, W. & Gillespie, B. (2016). The quality of measurement: reliability and validity. In Ruel, E., Wagner III, W., & Gillespie, B. The practice of survey research (pp. 78-100). Thousand Oaks, CA: SAGE Publications, Inc doi: 10.4135/9781483391700 |
| Validity |
| Validity video link |
Learning outcomes
By completing this resource you will be able to:
Understand the importance and how to determine the reliability and validity of a questionnaire
This resource was developed by:
Content authors: Ahmed Sharaf, Kardelen Dolgungöz, Asiya Said Al Hasni and Burak Kundakci
Narrator: Gill Langmack
Project mentors: Heather Wharrad, Nilgün Göktepe and Richard Windle
Project developers: Seda Akgül, Melike Ekerim, Amanda Hill and Michael Taylor
Peer Reviewers Gill Langmack, Arzu Baygül, Sarah Fields Richard
Funding: This work was part of the THRESHOLD project “Training Health Researchers by Experience-Sharing, Harnessing Online Learning Development”, funded under the Newton Fund Research Environment Links, Turkey & UK, British Council.
The THRESHOLD project team:
Name: Seda Akgül
Role in Project: Learning Technologist
Background: Seda is an Educational Technologist at Koç University.
Name: Jennifer Akuamoah-Boateng
Role in Project: Student Author - University of Nottingham
Background: Jennifer is a PhD student at the School of Health Sciences pursuing her PhD in Midwifery. Her research interests are respectful maternity care, woman-centred care, the midwifery models of care and the development of training programmes for the improvement of maternity care in lower-middle income countries.
Name: Dr Emmanuel Asante
Role in Project: Student Author - University of Nottingham
Background: PhD Health Studies
Name: Fatma Atkan
Role in Project: Student Author - Koç University
Background: This project provided the opportunity to share information as a team with doctoral students from different university. And, it also enabled me to learn about mixed method research and to develop material using visualization techniques of this research method.
Name: Vildan Çakar
Role in Project: Student Author - Koç University
Background: Vildan graduated from Hacettepe University School of Nursing in Ankara, Turkey. She worked as a medical-surgical nurse, infection control nurse and wound care nurse specialist. Since 2018, while she has been continuing her PhD studies in Nursing at Koç University, Turkey. She also has been serving as a research and teaching assistant at the same university.
Name: Erdinc Demirer
Role in Project: Student Author and Content Reviewer - Koç University
Background: Clinical Research Nurse at Koç University Hospital.
Name: Kardelen Dolgungöz
Role in Project: Student Author - Koç University
Background: Master degree from Koç university. I started the PhD in Koç university at 2020. Psychiatric nursing.
Name: Rachael Drewery
Role in Project: Student Author - University of Nottingham
Background: Rachael is a nurse and doctoral researcher at the University of Nottingham. Her research uses conversation analysis to investigate compassion in nurse-patient interaction. Rachael's research interests include communication in health care encounters, the translation of policy into health care practice and the application of qualitative research methods.
Name: Melike Ekerim
Role in Project: Learning Technologist
Background: Melike is an educational technologist at Koç University. Designing and developing e-learning contents by considering instructional and multimedia design principles is one of her main interests as well as providing pedagogical and technical support to the campus community.
Name: Dr Sarah Elizabeth Field-Richards
Role in Project: Staff Author and Content Reviewer- University of Nottingham
Background: Sarah Field-Richards is a Registered Nurse and Research Fellow in the School of Health Sciences, University of Nottingham. Her research interests include sociology of professions, organisational sociology, compassion and workplace wellbeing.
Name: Assistant Professor Nilgün Göktepe
Role in Project: Project Lead
Background: Nilgün is an Assistant Professor of Nursing Management in Koç University School of Nursing. She is also an educator and course coordinator for Koç University Semahat Arsel Nursing Education and Research Center. She is interested in nursing management, leadership, productivity, work environment, continue education in nursing and educational methods.
Name: Seyma Gözaydınoğlu
Role in Project: Student Author - Koç University
Background: I am happy to be a part of this project.
Name: Eyşan Hanzade Umaç
Role in Project: Student Author - Koç University
Background: I am doctorate student at Koc University. I study about Child Health and Disease and I have exprience on quantitavive research methods. Additionally thanks to this project, I had be experience about qualitative research methods.
Name: Amanda Hill
Role in Project: Project Coordinator and Developer
Background: Amanda is Digital Development Officer in the Health E-learning and Media (HELM) team, at the University of Nottingham. She has extensive international project management and stakeholder engagement experience. She is a passionate advocate for barrier free learning.
Name: Dr Ada Hui
Role in Project: Staff Author and Content Reviewer- University of Nottingham
Background: Ada is an Assistant Professor in Mental Health and Deputy Director of Postgraduate Research at the University of Nottingham. With an interdisciplinary background in sociology and mental health, Ada leads research studies examining institutional injustice amongst marginalised communities, and teaches across undergraduate and postgraduate curriculum.
Name: Lydia Jones
Role in Project: Technical Support and Audio Coordinator
Background: Lydia has worked in the HELM team at the University of Nottingham for 14 years and is currently the eLearning and Project Development Officer. She has many years’ experience in project management and audio/video production.
Name: Burak Kundakci
Role in Project: Student Author - University of Nottingham
Background: I graduated as a physiotherapist in 2012. I did my master's in Physiotherapy (Advancing Neuromusculoskeletal Practice) at UoN. Currently, I am a PhD student in Academic Rheumatology.
Name: Bahar Madran
Role in Project: Student Author - Koç University
Background: PhD candidate at Public Health Field.
Name: Abdulrahman Muslihi
Role in Project: Student Author - University of Nottingham
Background: Muslihi, Abdul is a PhD student at the University of Nottingham and a lecturer at Jazan University. He is the former coordinator of E-Learning unit at Faculty of Public Health and Tropical Medicine at Jazan University. His research interests include utilising online tools to enhance patients social support.
Name: Öykü Öztürk
Role in Project: Student Author - Koç University
Background: I am phd student in Koc Universty , meanwhile I attend this Project such as student.
Name: Dr Cherry Poussa
Role in Project: Content Reviewer
Background: Cherry is the Head of Digital Learning Support Services in the School of Health Sciences, University of Nottingham. She manages the Health E-learning and Media (HELM) team and supports the technical and budgetary aspects HELM projects. Her broad research interests are in the field of human-computer interaction and specifically in web-based learning self-efficacy.
Name: Asiya Said Al Hasni
Role in Project: Student Author and Content Reviewer- University of Nottingham
Background: Asiya is Acdemic staff in Higher Institute of Health Specialities (HIHS) in Oman. Member of curriculum development committee in the institute. PhD student in University of Nottingham. Her research and development interests include open multimedia learning content pedagogy and reuse, stakeholder involvement in content development and student generated content.
Name: Seda Sarikose
Role in Project: Student Author - Koç University
Background: I was lucky to be involved in this study. I learned a lot from our friends at Nottingham University. I've learned things about different research methods. The only challenge of the project was to arrange online meetings due to the pandemic. It would be much more useful to have meetings face-to-face.
Name: Ahmed Sharaf
Role in Project: Student Author and Content Reviewer- University of Nottingham
Background: Ahmed is a PhD candidate at the School of Health Sciences at the university of Nottingham as well as an assistant lecturer of Community Nursing at the University of Alexandria in Egypt. His research and development interests include; qualitative and qualitative methodologies, questionnaire design, Health research content development, and Palliative and end of life care research.
Name: Mara Sprengel-Smith
Role in Project: Project Finance Coordinator
Background: Mara Sprengel-Smith is the Contract Delivery Support Officer in the School of Health Sciences, University of Nottingham. She provides budget monitoring, contractual, financial reporting, and project management support to a portfolio of student mobility and Erasmus+ research projects, as well as coordinating educational contracts, CPD and business development.
Name: Michael Taylor
Role in Project: Lead Project Developer and Academic Designer
Background: Mike is an experienced Open Educational Practioner and Academic Designer and has worked on many International co-collaborative projects. Mike's interests include open multimedia learning content pedagogy and reuse, stakeholder involvement in content development, co-creation development practices and student generated content.
Name: Dr Kader Tekkas Kerman
Role in Project: Content Reviewer
Background: Dr. Kader Tekkas Kerman is an assistant professor of public health nursing at Koc University School of Nursing. Her research interest focuses on assessing and promoting health of vulnerable populations including those women and children; chronically ill and disabled; immigrant and refugees. She is experienced on innovative methods, active learning techniques and output-based training models in education, and curriculum development.
Name: Dr Y. Abigail Tronco Hernandez
Role in Project: Staff Author - University of Nottingham
Background: Abigail recently completed a PhD in Health studies, her research was focused on Nutrition Education and has implications for healthcare students. She is a postgraduate research assistant in the School of Nursing working on a project to improve GPs education on mental health. Her research interests include health education, health promotion and nutritional care in the workplace and for people who have been affected by COVID-19.
Name: Professor Heather Wharrad
Role in Project: Project Lead
Background: Heather is Professor of e-Learning and Health Informatics at the University of Nottingham and co-academic lead for the HELM team. Her research and development interests include pedagogical co-design of digital learning in healthcare contexts and capacity building in open digital education. She leads national and international projects in digital learning and has published widely in this field.
Name: Professor Richard Windle
Role in Project: Project Lead
Background: Richard is Professor of Digital learning at the University of Nottingham and co-academic lead for the HELM team. As well as leading online curriculum development, his research and development interests include open multimedia learning content pedagogy and reuse, stakeholder involvement in content development and student generated content.
Name: Zuhal Zeybekoglu
Role in Project: Project Lead
Background: Zuhal is the Manager of Office of Learning and Teaching at Koc University. She designs and delivers faculty development programs, supports academic programs in curriculum evaluation and conducts SoTL projects. She holds Ph.D. in education and her research interest mainly focuses on improving learning and teaching in higher education.
Contact: helm@nottingham.ac.uk
Learning Object Copyright and Terms of Use
All Learning Objects developed by the University of Nottingham School of Health Sciences, and their aggregate parts (eg text, animations), are copyright of the School of Health Sciences, University of Nottingham. Learning Objects are available for use under the Creative Commons Attribution-NonCommercial 3.0 Unported License and the conditions below.
Terms of Use
Private individuals, and publicly-funded educational and other institutions, may link to and use the Learning Objects on this site without restriction for non-commercial educational purposes. Use of any Learning Objects for any commercial purpose, or by any profit-making commercial entity, is not permitted without our express permission. If you wish to use a Learning Object for any commercial, revenue-generating or non-educational purpose, you must contact us to negotiate terms of use and payment.
We much prefer that you use this and other Learning Objects by linking to them on this website as:
- this ensures you're always using the most up-to-date version
- we gain data on usage of the Learning Objects, from access statistics and user feedback forms
Local circumstances, such as network security policies, may constrain your ability to link to external sites, or may impair the usability of our objects. If you're unable to run our Learning Objects 'from source' for these or other reasons, please contact us with a brief explanation of your circumstances and we may provide you with specified Learning Objects as an IMS Content Package.
Modification
Modification to adapt Learning Objects to local circumstances is permitted, with the following restrictions:
- The modified version must clearly display the University of Nottingham logo, and the School copyright notice.
- The modified version must not be distributed outside the modifying institution without the express permission of the School.
Contacts
If you have any queries about our Learning Objects, please contact helm@nottingham.ac.uk
Attribution
Please use the attribution below if you wish to refer to our learning objects. If you use Firefox, you can install the useful OpenAttribute add-on to allow you to easily copy and reference these and other materials marked as Creative Commons.
Learning Objects for Healthcare by School of Health Sciences, University of Nottingham is licensed under a Creative Commons Attribution-NonCommercial 3.0 Unported License.