Piloting

Often people wonder whether a pilot study is qualitative or quantitative. The answer is a pilot study is a preliminary small-scale study of qualitative, quantitative and clinical study to be conducted. The aim is to test the feasibility of the study, be it qualitative, quantitative or clinical. Pilot studies or piloting have been described as small-scale, preliminary studies which aim to investigate whether crucial components of a main study – usually a randomized controlled trial (RCT) – will be feasible. For example, pilot studies may be used to predict an appropriate sample size for the full-scale project and/or improve upon various aspects of the study design.

The pilot research must guide how to proceed with the actual research and whether or not certain changes must be made to the original protocol. A pilot study can evaluate the feasibility of recruitment, randomisation, retention, assessment procedures, new methods, and implementation and acceptability of the new intervention.

A pilot study is conducted before the start of the main large-scale research. It is to test system readiness and estimate costs and feasibility with the allocated resources. Malmqvist et al (2019) argue the need to conduct pilot studies clinical and randomized studies.

Pilot studies can provide more information on the following aspects:

Process: Assess the feasibility of the key steps of the main study, which include the recruitment rate of study participants, retention levels, and eligibility criteria
Acceptability: Acceptability of the proposed intervention to the target group or participants.
Resources: Assess the actual time, materials and funds that will be required to complete the main study
Management: Data management, personnel who collect, capture and analyse the data

Benefits of a pilot study

Researchers determine ahead if the research method is reliable and therefore replicable in other settings
Researchers determine whether the main study will be feasible given the time and resources set aside for the research project
Gives researchers an opportunity to make changes in the protocol before the roll out of the main study
Allows researchers an opportunity to allocate suitable monitoring resources if there are critical concerns observed during piloting

Methodology of a pilot study

Piloting is regarded as the most neglected part of research, and for this reason, Malmqvist et al. documented the methodological process of conducting a pilot study. Approach the pilot / introspective study chronologically, that is, look at the stages of the research in this order:

(1) Designing the pilot study, (2) Planning and preparation of data collection, (3) Data collection, and (4) Data analysis and findings.

Designing the Pilot Study

Gather a research team with all stakeholders, including the representatives of the study respondents and design the pilot together.

Planning and Preparation of Data Collection

Select sample study sites
Identify study leaders for the sites
Select sample age groups to participate in the study
Sample each of the data collection tools

Data Collection

Conduct the sample interviews with the groups of participants (parents,
students, community members, etc.)
Video record the interviews to enable quality evaluation
Review documents

Data Analysis and Findings

Assess the usefulness of the data collection procedures and instruments,
Assess the interviewers’ way of conducting the study, with a substantial focus
on the management of the interviews, and
Assess the content of the interviewees’ answers.

OTHER THINGS TO CONSIDER

Evidence in Governance and Politics research, evaluation, and learning network ( egap ) identified the following issues that need to be considered when conducting a pilot study:

Theory development	Research Design
Refining the research questions and hypotheses Determining initial plausibility of theorized mechanisms Identifying additional research questions of interest Exploring unknowns related to your research questions and hypotheses	Answering research questions Determining construction and strength of treatments Determining number, levels, and timing of treatments Considering alternative and/or multiple measures of participant response to treatment

Measurement	Sample
Refining the research questions and hypotheses Determining initial plausibility of theorized mechanisms Identifying additional research questions of interest Exploring unknowns related to your research questions and hypotheses	Answering research questions Determining construction and strength of treatments Determining number, levels, and timing of treatments Considering alternative and/or multiple measures of participant response to treatment

Logistics	Analysis
Refining the research questions and hypotheses Determining initial plausibility of theorized mechanisms Identifying additional research questions of interest Exploring unknowns related to your research questions and hypotheses	Answering research questions Determining construction and strength of treatments Determining number, levels, and timing of treatments Considering alternative and/or multiple measures of participant response to treatment

BY YOLISWA NTSEPE (MA, PhD)
ADOLESCENT PROGRAMMES MANAGER

UPDATED NOV 22, 2023

TABLE OF CONTENTS:

REFERENCES & ADDITIONAL RESOURCES:

Conducting the Pilot Study: A Neglected Part of the Research Process? Methodological Findings Supporting the Importance of Piloting in Qualitative Research Studies. https://journals.sagepub.com/doi/pdf/10.1177/1609406919878341

A network for students interested in evidence-based health care.
https://s4be.cochrane.org/
https://www.enago.com/academy/pilot-study-defines-a-good-research-design/ .