© RWJF 2008
P.O. Box 2316 College Road East and Route 1
Princeton, NJ 08543
-->Citation: Cohen D, Crabtree B. "Qualitative Research Guidelines Project." July 2006.
Structured and unstructured interviews, the pros and cons of unstructured interviews, when would you use unstructured interviews, the unstructured interview process.
Of the three types of interviews in qualitative research , the unstructured interview is the most free-flowing. It provides the greatest flexibility in gathering participants' answers in a social interaction that resembles a natural conversation. While all interviews involve collecting data in the form of the respondents' own words as they answer the interviewer's questions, the unstructured interview offers researchers the most freedom to explore participants' responses as deeply as they need to meet their research objectives .
In this article, we will look at what researchers do to plan , conduct, and analyze unstructured interviews in qualitative studies.
An unstructured interview (sometimes known as a non-directive interview) stands in contrast to a structured interview . Structured interviews have a rigid protocol that includes a set of predetermined questions. The interviewer asks the same questions to all participants so they can have neatly organized and comparable data across participants.
Structured interviews are ideal when researchers have a clear notion of which questions should be asked and there is no need to stay open to exploring other potential directions which participants might bring up. Unstructured interviews, on the other hand, permit researchers to ask spontaneous probing questions to gain deeper understanding of unexpected things that could emerge during the interview.
An unstructured interview is a free-flowing conversation between a researcher and participant. The interviewer has a broad research question that guides their interest in conducting the interview , but the interview questions are not decided beforehand. Rather, the researcher poses questions to the participant in the moment, depending on the flow of the conversation.
Researchers who employ unstructured interviews acknowledge that each respondent will have different insights that can only be uncovered by asking questions tailored to each individual they interview. Unstructured interview questions are then determined over the course of the interview as researcher and respondent interact with each other. This allows the researcher to collect open-ended data and take advantage of opportunities that arise to probe further into respondents' perspectives or experiences about key topics or phenomena.
Keep in mind that a semi-structured interview can be a good compromise between structured and unstructured interviews. If you need the flexibility of a natural conversation setting and the structure provided by a set of predetermined questions, then semi-structured interviews might be the best option for your research.
The strategy that you adopt for conducting interviews is going to depend on the research questions in your study as well as the particular circumstances of the research context and interview respondents. Let's look at some of the key advantages and disadvantages of unstructured interviews.
In a nutshell, an unstructured interview is an open-ended interaction that can move in any direction that arises as the researcher and participant engage in the conversation. To be sure, the interviewer has a set research objective in mind when conducting the interview. However, unstructured interviews have a natural flow and give interview respondents agency over the interaction. In situations where respondents feel they can control the interaction, they may be more open to providing more in-depth answers to interview questions.
As a result, the data collected from an unstructured interview can allow the researcher to dig deeper into the perspectives of respondents. The depth of the knowledge gained from unstructured interviews can prove valuable in gaining an insider perspective of social customs and cultural practices, especially when there is limited current understanding or theory that could meaningfully inform what kinds of questions are worth asking.
Unstructured interviews flow in different and, oftentimes, unanticipated directions, which can pose challenges when it comes to analyzing all the data and making comparisons across participants. For example, each participant you interview may focus on different aspects of the phenomenon you are studying. While each of these aspects can contribute meaningful understanding to your phenomenon, integrating all these different perspectives into a coherent theory or story might be difficult.
On the other hand, since unstructured interviews can move in unexpected directions, there is also the risk that the interviewer loses the thread of an important research topic or the conversation explores unrelated tangents. Researchers should take care to balance the need for the interview to flow naturally and the objective of gathering valuable information from respondents.
Intuitive data analysis is just a click away with ATLAS.ti. Start with a free trial today.
It is important to conduct interviews that are more suitable to your particular study and research objectives . This section looks at some of the considerations that you should keep in mind when deciding if an unstructured interview is best for your research.
Unstructured interviews are best suited for exploratory research that adopts an inductive approach to developing theory. If the goal of your research is to establish a deep understanding of a culture or custom where there is insufficient theoretical development , then your study can engage in a concept known as thick description, which involves exploring the respondent's answers to grasp the nuances and interpretations of a particular social concept.
The influence of the interviewer plays a major role in using unstructured interviews. Think about an interview study that explores sensitive topics like hospice care or migrant work. A structured interview or even a semi-structured interview might not be the most appropriate form of interview when you are trying to gain the respondent's trust. After all, direct questions on controversial issues can make people hesitant to provide open, detailed answers.
If a prerequisite to collecting a respondent's answers is to establish rapport, then you could consider using interviews that don't rely on standardized questions to collect data . The flow of an unstructured interview has the potential to make the interview respondent comfortable with the interviewer, who can then judge in the moment of data collection when to ask probing questions or focus on building rapport.
Structured interviews and semi-structured interviews offer more rigidity in terms of asking a set of predetermined questions. In cases where you have a collection of questions you want to ask, semi-structured interviews can be used to ask these same questions to all participants while remaining open to asking additional questions if the need arises. If you already know exactly which questions you want to ask and it is important to gather consistent data from all participants to aid subsequent comparisons, structured interviews can be the most appropriate approach.
Although unstructured interviews do not follow a predetermined flow, they also do not consist of simply talking with a respondent. In other words, unstructured interviews also depend on a clear research methodology . Indeed, as unrehearsed as they may seem, unstructured interviews are still an intentional research tool designed to collect data in a deliberate and rigorous manner. In this section, we'll look at the various stages of an unstructured interview study from design to research reporting .
As mentioned previously, the manner in which you conduct unstructured interviews depends on your research questions and interview respondents. If you are looking to explore a particular topic, it's important to define the object of inquiry as clearly as possible. What does existing scholarship say about the cultural practice you are looking to study? What is it about your given social phenomenon that you are trying to understand? Should your study look at the decisions people make about that phenomenon, the thinking behind it, or something else?
While an unstructured interview does not necessarily have a standardized set of questions to ask respondents, an interviewer should always have a set of topics in mind that are worth exploring. While there shouldn't be a set order to interview questions in an unstructured format, it benefits the interviewer to have a defined set of objectives to meet over the course of an interview.
The affective dimensions of an unstructured interview study are also important when considering how to conduct interviews . The unstructured format allows the researcher to decide when to be more direct or conservative in their questioning, depending on how open they think the respondent is in answering questions. When establishing who your respondents are and how they are likely to interact with you, you can make intentional and informed decisions about how to make the best of the conversational nature of unstructured interviews.
The data collection stage of an unstructured interview study can be the most fraught (and most interesting!) part of the research process. Without set questions in mind, the interview can explore any part of the respondent's experience or perspective that emerges. In an interaction that resembles an everyday conversation, it is up to the interviewer to successfully navigate a dynamic and fluid social situation to elicit valuable information from the respondent.
The general goal when conducting unstructured interviews is to encourage the respondent to craft as detailed a narrative as possible on the topic of interest. The interviewer's rapport with the respondent and the comfort level respondents have when the interviewer asks questions are crucial to eliciting relevant information in comprehensive detail. Direct questions have the potential to gather the more pertinent details, but it is also important to avoid leading questions that encourage socially desirable responses (e.g., "You've never shoplifted before, right?"). It is also helpful to begin with simpler questions to build rapport before moving on to potentially more sensitive questions. The interviewer should take care to balance the questions they ask to respondents depending on their relationship with them.
Because of the unrestricted nature of unstructured interviews, you have a lot of space to reflect on and make changes to your interview strategy as you interview further respondents. Perhaps you discovered there is a particular form of questioning that is more conducive to collecting rich answers from your respondents. Or maybe there is a certain topic that turned out to be more controversial or taboo than you first thought.
Because you are not bound to ask a predetermined set of questions in an unstructured interview format, you can benefit from reflecting on past data collection to inform future data collection as your study progresses. Utilize this opportunity to maximize the interview strategies that worked best and reconsider those that didn't work out. Ultimately, the goal of this reflection is to capture the richest data possible to generate a meaningful analysis.
As you conduct interviews, you can simultaneously engage in data analysis . Your reflections of ongoing data collection will bring to mind key themes and preliminary insights that can inform subsequent data collection and analysis. Your notes during and after interviews can form the basis of a set of themes and topics that you can use to code your interview data. You can thus create a list of preliminary codes to guide your initial analysis, but you can still remain open to creating additional codes as you delve deeper into your analysis process.
Typically, interview data is transcribed so the researcher can comfortably search and segment the text for important phrases and meaningful insights. Working with interview transcriptions also makes it easier to manage all your data and draw connections across your different participants. That being said, with qualitative data analysis software such as ATLAS.ti, you can analyze both multimedia recordings and transcripts, and you can even sync the two together so you can fluidly move between the raw recording and the transcribed text.
The objective of data analysis is usually to explore and understand patterns across interview respondents. You might identify an interesting anecdote from one respondent or observe commonalities that are shared across multiple respondents.
You can choose the coding strategy that best suits your research question as you look at your interviews. For example, a thematic analysis can be followed to explore shared perspectives or experiences across respondents. Or, if you want to understand and compare how participants talk about the phenomenon you are studying, you can employ discursive coding to analyze how participants build their stories.
There are many coding approaches you can choose from, but it is always important to be systematic and transparent to persuade your research audience of the key insights in your interview data. As the name suggests, unstructured interviews are among the least predictable and most dynamic methods of qualitative research , so it is up to the researcher to develop a carefully crafted research study to identify key insights in an empirical manner.
From interviews to observations, conduct qualitative research with our powerful interface. Download a free trial today.
Folklore interviews, oral history interviews, user experience (ux).
The decision to conduct interviews, and the type of interviewing to use, should flow from, or align with, the methodological paradigm chosen for your study, whether that paradigm is interpretivist, critical, positivist, or participative in nature (or a combination of these).
An interdisciplinary scientific program within the Institute for Quantitative Social Science which encourages and facilitates research and instruction in the theory and practice of survey research. The primary mission of PSR is to provide survey research resources to enhance the quality of teaching and research at Harvard.
Except where otherwise noted, this work is subject to a Creative Commons Attribution 4.0 International License , which allows anyone to share and adapt our material as long as proper attribution is given. For details and exceptions, see the Harvard Library Copyright Policy ©2021 Presidents and Fellows of Harvard College.
Run a free plagiarism check in 10 minutes, generate accurate citations for free.
Methodology
Published on June 19, 2020 by Pritha Bhandari . Revised on June 22, 2023.
Qualitative research involves collecting and analyzing non-numerical data (e.g., text, video, or audio) to understand concepts, opinions, or experiences. It can be used to gather in-depth insights into a problem or generate new ideas for research.
Qualitative research is the opposite of quantitative research , which involves collecting and analyzing numerical data for statistical analysis.
Qualitative research is commonly used in the humanities and social sciences, in subjects such as anthropology, sociology, education, health sciences, history, etc.
Approaches to qualitative research, qualitative research methods, qualitative data analysis, advantages of qualitative research, disadvantages of qualitative research, other interesting articles, frequently asked questions about qualitative research.
Qualitative research is used to understand how people experience the world. While there are many approaches to qualitative research, they tend to be flexible and focus on retaining rich meaning when interpreting data.
Common approaches include grounded theory, ethnography , action research , phenomenological research, and narrative research. They share some similarities, but emphasize different aims and perspectives.
Approach | What does it involve? |
---|---|
Grounded theory | Researchers collect rich data on a topic of interest and develop theories . |
Researchers immerse themselves in groups or organizations to understand their cultures. | |
Action research | Researchers and participants collaboratively link theory to practice to drive social change. |
Phenomenological research | Researchers investigate a phenomenon or event by describing and interpreting participants’ lived experiences. |
Narrative research | Researchers examine how stories are told to understand how participants perceive and make sense of their experiences. |
Note that qualitative research is at risk for certain research biases including the Hawthorne effect , observer bias , recall bias , and social desirability bias . While not always totally avoidable, awareness of potential biases as you collect and analyze your data can prevent them from impacting your work too much.
Discover proofreading & editing
Each of the research approaches involve using one or more data collection methods . These are some of the most common qualitative methods:
Qualitative researchers often consider themselves “instruments” in research because all observations, interpretations and analyses are filtered through their own personal lens.
For this reason, when writing up your methodology for qualitative research, it’s important to reflect on your approach and to thoroughly explain the choices you made in collecting and analyzing the data.
Qualitative data can take the form of texts, photos, videos and audio. For example, you might be working with interview transcripts, survey responses, fieldnotes, or recordings from natural settings.
Most types of qualitative data analysis share the same five steps:
There are several specific approaches to analyzing qualitative data. Although these methods share similar processes, they emphasize different concepts.
Approach | When to use | Example |
---|---|---|
To describe and categorize common words, phrases, and ideas in qualitative data. | A market researcher could perform content analysis to find out what kind of language is used in descriptions of therapeutic apps. | |
To identify and interpret patterns and themes in qualitative data. | A psychologist could apply thematic analysis to travel blogs to explore how tourism shapes self-identity. | |
To examine the content, structure, and design of texts. | A media researcher could use textual analysis to understand how news coverage of celebrities has changed in the past decade. | |
To study communication and how language is used to achieve effects in specific contexts. | A political scientist could use discourse analysis to study how politicians generate trust in election campaigns. |
Qualitative research often tries to preserve the voice and perspective of participants and can be adjusted as new research questions arise. Qualitative research is good for:
The data collection and analysis process can be adapted as new ideas or patterns emerge. They are not rigidly decided beforehand.
Data collection occurs in real-world contexts or in naturalistic ways.
Detailed descriptions of people’s experiences, feelings and perceptions can be used in designing, testing or improving systems or products.
Open-ended responses mean that researchers can uncover novel problems or opportunities that they wouldn’t have thought of otherwise.
Researchers must consider practical and theoretical limitations in analyzing and interpreting their data. Qualitative research suffers from:
The real-world setting often makes qualitative research unreliable because of uncontrolled factors that affect the data.
Due to the researcher’s primary role in analyzing and interpreting data, qualitative research cannot be replicated . The researcher decides what is important and what is irrelevant in data analysis, so interpretations of the same data can vary greatly.
Small samples are often used to gather detailed data about specific contexts. Despite rigorous analysis procedures, it is difficult to draw generalizable conclusions because the data may be biased and unrepresentative of the wider population .
Although software can be used to manage and record large amounts of text, data analysis often has to be checked or performed manually.
If you want to know more about statistics , methodology , or research bias , make sure to check out some of our other articles with explanations and examples.
Research bias
Quantitative research deals with numbers and statistics, while qualitative research deals with words and meanings.
Quantitative methods allow you to systematically measure variables and test hypotheses . Qualitative methods allow you to explore concepts and experiences in more detail.
There are five common approaches to qualitative research :
Data collection is the systematic process by which observations or measurements are gathered in research. It is used in many different contexts by academics, governments, businesses, and other organizations.
There are various approaches to qualitative data analysis , but they all share five steps in common:
The specifics of each step depend on the focus of the analysis. Some common approaches include textual analysis , thematic analysis , and discourse analysis .
If you want to cite this source, you can copy and paste the citation or click the “Cite this Scribbr article” button to automatically add the citation to our free Citation Generator.
Bhandari, P. (2023, June 22). What Is Qualitative Research? | Methods & Examples. Scribbr. Retrieved September 6, 2024, from https://www.scribbr.com/methodology/qualitative-research/
Other students also liked, qualitative vs. quantitative research | differences, examples & methods, how to do thematic analysis | step-by-step guide & examples, what is your plagiarism score.
Thank you for visiting nature.com. You are using a browser version with limited support for CSS. To obtain the best experience, we recommend you use a more up to date browser (or turn off compatibility mode in Internet Explorer). In the meantime, to ensure continued support, we are displaying the site without styles and JavaScript.
British Dental Journal volume 225 , pages 668–672 ( 2018 ) Cite this article
32k Accesses
63 Citations
20 Altmetric
Metrics details
Highlights that qualitative research is used increasingly in dentistry. Interviews and focus groups remain the most common qualitative methods of data collection.
Suggests the advent of digital technologies has transformed how qualitative research can now be undertaken.
Suggests interviews and focus groups can offer significant, meaningful insight into participants' experiences, beliefs and perspectives, which can help to inform developments in dental practice.
Qualitative research is used increasingly in dentistry, due to its potential to provide meaningful, in-depth insights into participants' experiences, perspectives, beliefs and behaviours. These insights can subsequently help to inform developments in dental practice and further related research. The most common methods of data collection used in qualitative research are interviews and focus groups. While these are primarily conducted face-to-face, the ongoing evolution of digital technologies, such as video chat and online forums, has further transformed these methods of data collection. This paper therefore discusses interviews and focus groups in detail, outlines how they can be used in practice, how digital technologies can further inform the data collection process, and what these methods can offer dentistry.
You have full access to this article via your institution.
A review of technical and quality assessment considerations of audio-visual and web-conferencing focus groups in qualitative health research, introduction.
Traditionally, research in dentistry has primarily been quantitative in nature. 1 However, in recent years, there has been a growing interest in qualitative research within the profession, due to its potential to further inform developments in practice, policy, education and training. Consequently, in 2008, the British Dental Journal (BDJ) published a four paper qualitative research series, 2 , 3 , 4 , 5 to help increase awareness and understanding of this particular methodological approach.
Since the papers were originally published, two scoping reviews have demonstrated the ongoing proliferation in the use of qualitative research within the field of oral healthcare. 1 , 6 To date, the original four paper series continue to be well cited and two of the main papers remain widely accessed among the BDJ readership. 2 , 3 The potential value of well-conducted qualitative research to evidence-based practice is now also widely recognised by service providers, policy makers, funding bodies and those who commission, support and use healthcare research.
Besides increasing standalone use, qualitative methods are now also routinely incorporated into larger mixed method study designs, such as clinical trials, as they can offer additional, meaningful insights into complex problems that simply could not be provided by quantitative methods alone. Qualitative methods can also be used to further facilitate in-depth understanding of important aspects of clinical trial processes, such as recruitment. For example, Ellis et al . investigated why edentulous older patients, dissatisfied with conventional dentures, decline implant treatment, despite its established efficacy, and frequently refuse to participate in related randomised clinical trials, even when financial constraints are removed. 7 Through the use of focus groups in Canada and the UK, the authors found that fears of pain and potential complications, along with perceived embarrassment, exacerbated by age, are common reasons why older patients typically refuse dental implants. 7
The last decade has also seen further developments in qualitative research, due to the ongoing evolution of digital technologies. These developments have transformed how researchers can access and share information, communicate and collaborate, recruit and engage participants, collect and analyse data and disseminate and translate research findings. 8 Where appropriate, such technologies are therefore capable of extending and enhancing how qualitative research is undertaken. 9 For example, it is now possible to collect qualitative data via instant messaging, email or online/video chat, using appropriate online platforms.
These innovative approaches to research are therefore cost-effective, convenient, reduce geographical constraints and are often useful for accessing 'hard to reach' participants (for example, those who are immobile or socially isolated). 8 , 9 However, digital technologies are still relatively new and constantly evolving and therefore present a variety of pragmatic and methodological challenges. Furthermore, given their very nature, their use in many qualitative studies and/or with certain participant groups may be inappropriate and should therefore always be carefully considered. While it is beyond the scope of this paper to provide a detailed explication regarding the use of digital technologies in qualitative research, insight is provided into how such technologies can be used to facilitate the data collection process in interviews and focus groups.
In light of such developments, it is perhaps therefore timely to update the main paper 3 of the original BDJ series. As with the previous publications, this paper has been purposely written in an accessible style, to enhance readability, particularly for those who are new to qualitative research. While the focus remains on the most common qualitative methods of data collection – interviews and focus groups – appropriate revisions have been made to provide a novel perspective, and should therefore be helpful to those who would like to know more about qualitative research. This paper specifically focuses on undertaking qualitative research with adult participants only.
Qualitative research is an approach that focuses on people and their experiences, behaviours and opinions. 10 , 11 The qualitative researcher seeks to answer questions of 'how' and 'why', providing detailed insight and understanding, 11 which quantitative methods cannot reach. 12 Within qualitative research, there are distinct methodologies influencing how the researcher approaches the research question, data collection and data analysis. 13 For example, phenomenological studies focus on the lived experience of individuals, explored through their description of the phenomenon. Ethnographic studies explore the culture of a group and typically involve the use of multiple methods to uncover the issues. 14
While methodology is the 'thinking tool', the methods are the 'doing tools'; 13 the ways in which data are collected and analysed. There are multiple qualitative data collection methods, including interviews, focus groups, observations, documentary analysis, participant diaries, photography and videography. Two of the most commonly used qualitative methods are interviews and focus groups, which are explored in this article. The data generated through these methods can be analysed in one of many ways, according to the methodological approach chosen. A common approach is thematic data analysis, involving the identification of themes and subthemes across the data set. Further information on approaches to qualitative data analysis has been discussed elsewhere. 1
Qualitative research is an evolving and adaptable approach, used by different disciplines for different purposes. Traditionally, qualitative data, specifically interviews, focus groups and observations, have been collected face-to-face with participants. In more recent years, digital technologies have contributed to the ongoing evolution of qualitative research. Digital technologies offer researchers different ways of recruiting participants and collecting data, and offer participants opportunities to be involved in research that is not necessarily face-to-face.
Research interviews are a fundamental qualitative research method 15 and are utilised across methodological approaches. Interviews enable the researcher to learn in depth about the perspectives, experiences, beliefs and motivations of the participant. 3 , 16 Examples include, exploring patients' perspectives of fear/anxiety triggers in dental treatment, 17 patients' experiences of oral health and diabetes, 18 and dental students' motivations for their choice of career. 19
Interviews may be structured, semi-structured or unstructured, 3 according to the purpose of the study, with less structured interviews facilitating a more in depth and flexible interviewing approach. 20 Structured interviews are similar to verbal questionnaires and are used if the researcher requires clarification on a topic; however they produce less in-depth data about a participant's experience. 3 Unstructured interviews may be used when little is known about a topic and involves the researcher asking an opening question; 3 the participant then leads the discussion. 20 Semi-structured interviews are commonly used in healthcare research, enabling the researcher to ask predetermined questions, 20 while ensuring the participant discusses issues they feel are important.
Interviews can be undertaken face-to-face or using digital methods when the researcher and participant are in different locations. Audio-recording the interview, with the consent of the participant, is essential for all interviews regardless of the medium as it enables accurate transcription; the process of turning the audio file into a word-for-word transcript. This transcript is the data, which the researcher then analyses according to the chosen approach.
Qualitative studies often utilise one-to-one, face-to-face interviews with research participants. This involves arranging a mutually convenient time and place to meet the participant, signing a consent form and audio-recording the interview. However, digital technologies have expanded the potential for interviews in research, enabling individuals to participate in qualitative research regardless of location.
Telephone interviews can be a useful alternative to face-to-face interviews and are commonly used in qualitative research. They enable participants from different geographical areas to participate and may be less onerous for participants than meeting a researcher in person. 15 A qualitative study explored patients' perspectives of dental implants and utilised telephone interviews due to the quality of the data that could be yielded. 21 The researcher needs to consider how they will audio record the interview, which can be facilitated by purchasing a recorder that connects directly to the telephone. One potential disadvantage of telephone interviews is the inability of the interviewer and researcher to see each other. This is resolved using software for audio and video calls online – such as Skype – to conduct interviews with participants in qualitative studies. Advantages of this approach include being able to see the participant if video calls are used, enabling observation of non-verbal communication, and the software can be free to use. However, participants are required to have a device and internet connection, as well as being computer literate, potentially limiting who can participate in the study. One qualitative study explored the role of dental hygienists in reducing oral health disparities in Canada. 22 The researcher conducted interviews using Skype, which enabled dental hygienists from across Canada to be interviewed within the research budget, accommodating the participants' schedules. 22
A less commonly used approach to qualitative interviews is the use of social virtual worlds. A qualitative study accessed a social virtual world – Second Life – to explore the health literacy skills of individuals who use social virtual worlds to access health information. 23 The researcher created an avatar and interview room, and undertook interviews with participants using voice and text methods. 23 This approach to recruitment and data collection enables individuals from diverse geographical locations to participate, while remaining anonymous if they wish. Furthermore, for interviews conducted using text methods, transcription of the interview is not required as the researcher can save the written conversation with the participant, with the participant's consent. However, the researcher and participant need to be familiar with how the social virtual world works to engage in an interview this way.
Ensuring informed consent before any interview is a fundamental aspect of the research process. Participants in research must be afforded autonomy and respect; consent should be informed and voluntary. 24 Individuals should have the opportunity to read an information sheet about the study, ask questions, understand how their data will be stored and used, and know that they are free to withdraw at any point without reprisal. The qualitative researcher should take written consent before undertaking the interview. In a face-to-face interview, this is straightforward: the researcher and participant both sign copies of the consent form, keeping one each. However, this approach is less straightforward when the researcher and participant do not meet in person. A recent protocol paper outlined an approach for taking consent for telephone interviews, which involved: audio recording the participant agreeing to each point on the consent form; the researcher signing the consent form and keeping a copy; and posting a copy to the participant. 25 This process could be replicated in other interview studies using digital methods.
There are advantages and disadvantages of using face-to-face and digital methods for research interviews. Ultimately, for both approaches, the quality of the interview is determined by the researcher. 16 Appropriate training and preparation are thus required. Healthcare professionals can use their interpersonal communication skills when undertaking a research interview, particularly questioning, listening and conversing. 3 However, the purpose of an interview is to gain information about the study topic, 26 rather than offering help and advice. 3 The researcher therefore needs to listen attentively to participants, enabling them to describe their experience without interruption. 3 The use of active listening skills also help to facilitate the interview. 14 Spradley outlined elements and strategies for research interviews, 27 which are a useful guide for qualitative researchers:
Greeting and explaining the project/interview
Asking descriptive (broad), structural (explore response to descriptive) and contrast (difference between) questions
Asymmetry between the researcher and participant talking
Expressing interest and cultural ignorance
Repeating, restating and incorporating the participant's words when asking questions
Creating hypothetical situations
Asking friendly questions
Knowing when to leave.
For semi-structured interviews, a topic guide (also called an interview schedule) is used to guide the content of the interview – an example of a topic guide is outlined in Box 1 . The topic guide, usually based on the research questions, existing literature and, for healthcare professionals, their clinical experience, is developed by the research team. The topic guide should include open ended questions that elicit in-depth information, and offer participants the opportunity to talk about issues important to them. This is vital in qualitative research where the researcher is interested in exploring the experiences and perspectives of participants. It can be useful for qualitative researchers to pilot the topic guide with the first participants, 10 to ensure the questions are relevant and understandable, and amending the questions if required.
Regardless of the medium of interview, the researcher must consider the setting of the interview. For face-to-face interviews, this could be in the participant's home, in an office or another mutually convenient location. A quiet location is preferable to promote confidentiality, enable the researcher and participant to concentrate on the conversation, and to facilitate accurate audio-recording of the interview. For interviews using digital methods the same principles apply: a quiet, private space where the researcher and participant feel comfortable and confident to participate in an interview.
Study focus: Parents' experiences of brushing their child's (aged 0–5) teeth
1. Can you tell me about your experience of cleaning your child's teeth?
How old was your child when you started cleaning their teeth?
Why did you start cleaning their teeth at that point?
How often do you brush their teeth?
What do you use to brush their teeth and why?
2. Could you explain how you find cleaning your child's teeth?
Do you find anything difficult?
What makes cleaning their teeth easier for you?
3. How has your experience of cleaning your child's teeth changed over time?
Has it become easier or harder?
Have you changed how often and how you clean their teeth? If so, why?
4. Could you describe how your child finds having their teeth cleaned?
What do they enjoy about having their teeth cleaned?
Is there anything they find upsetting about having their teeth cleaned?
5. Where do you look for information/advice about cleaning your child's teeth?
What did your health visitor tell you about cleaning your child's teeth? (If anything)
What has the dentist told you about caring for your child's teeth? (If visited)
Have any family members given you advice about how to clean your child's teeth? If so, what did they tell you? Did you follow their advice?
6. Is there anything else you would like to discuss about this?
A focus group is a moderated group discussion on a pre-defined topic, for research purposes. 28 , 29 While not aligned to a particular qualitative methodology (for example, grounded theory or phenomenology) as such, focus groups are used increasingly in healthcare research, as they are useful for exploring collective perspectives, attitudes, behaviours and experiences. Consequently, they can yield rich, in-depth data and illuminate agreement and inconsistencies 28 within and, where appropriate, between groups. Examples include public perceptions of dental implants and subsequent impact on help-seeking and decision making, 30 and general dental practitioners' views on patient safety in dentistry. 31
Focus groups can be used alone or in conjunction with other methods, such as interviews or observations, and can therefore help to confirm, extend or enrich understanding and provide alternative insights. 28 The social interaction between participants often results in lively discussion and can therefore facilitate the collection of rich, meaningful data. However, they are complex to organise and manage, due to the number of participants, and may also be inappropriate for exploring particularly sensitive issues that many participants may feel uncomfortable about discussing in a group environment.
Focus groups are primarily undertaken face-to-face but can now also be undertaken online, using appropriate technologies such as email, bulletin boards, online research communities, chat rooms, discussion forums, social media and video conferencing. 32 Using such technologies, data collection can also be synchronous (for example, online discussions in 'real time') or, unlike traditional face-to-face focus groups, asynchronous (for example, online/email discussions in 'non-real time'). While many of the fundamental principles of focus group research are the same, regardless of how they are conducted, a number of subtle nuances are associated with the online medium. 32 Some of which are discussed further in the following sections.
Some key considerations associated with face-to-face focus groups are: how many participants are required; should participants within each group know each other (or not) and how many focus groups are needed within a single study? These issues are much debated and there is no definitive answer. However, the number of focus groups required will largely depend on the topic area, the depth and breadth of data needed, the desired level of participation required 29 and the necessity (or not) for data saturation.
The optimum group size is around six to eight participants (excluding researchers) but can work effectively with between three and 14 participants. 3 If the group is too small, it may limit discussion, but if it is too large, it may become disorganised and difficult to manage. It is, however, prudent to over-recruit for a focus group by approximately two to three participants, to allow for potential non-attenders. For many researchers, particularly novice researchers, group size may also be informed by pragmatic considerations, such as the type of study, resources available and moderator experience. 28 Similar size and mix considerations exist for online focus groups. Typically, synchronous online focus groups will have around three to eight participants but, as the discussion does not happen simultaneously, asynchronous groups may have as many as 10–30 participants. 33
The topic area and potential group interaction should guide group composition considerations. Pre-existing groups, where participants know each other (for example, work colleagues) may be easier to recruit, have shared experiences and may enjoy a familiarity, which facilitates discussion and/or the ability to challenge each other courteously. 3 However, if there is a potential power imbalance within the group or if existing group norms and hierarchies may adversely affect the ability of participants to speak freely, then 'stranger groups' (that is, where participants do not already know each other) may be more appropriate. 34 , 35
Face-to-face focus groups should normally be conducted by two researchers; a moderator and an observer. 28 The moderator facilitates group discussion, while the observer typically monitors group dynamics, behaviours, non-verbal cues, seating arrangements and speaking order, which is essential for transcription and analysis. The same principles of informed consent, as discussed in the interview section, also apply to focus groups, regardless of medium. However, the consent process for online discussions will probably be managed somewhat differently. For example, while an appropriate participant information leaflet (and consent form) would still be required, the process is likely to be managed electronically (for example, via email) and would need to specifically address issues relating to technology (for example, anonymity and use, storage and access to online data). 32
The venue in which a face to face focus group is conducted should be of a suitable size, private, quiet, free from distractions and in a collectively convenient location. It should also be conducted at a time appropriate for participants, 28 as this is likely to promote attendance. As with interviews, the same ethical considerations apply (as discussed earlier). However, online focus groups may present additional ethical challenges associated with issues such as informed consent, appropriate access and secure data storage. Further guidance can be found elsewhere. 8 , 32
Before the focus group commences, the researchers should establish rapport with participants, as this will help to put them at ease and result in a more meaningful discussion. Consequently, researchers should introduce themselves, provide further clarity about the study and how the process will work in practice and outline the 'ground rules'. Ground rules are designed to assist, not hinder, group discussion and typically include: 3 , 28 , 29
Discussions within the group are confidential to the group
Only one person can speak at a time
All participants should have sufficient opportunity to contribute
There should be no unnecessary interruptions while someone is speaking
Everyone can be expected to be listened to and their views respected
Challenging contrary opinions is appropriate, but ridiculing is not.
Moderating a focus group requires considered management and good interpersonal skills to help guide the discussion and, where appropriate, keep it sufficiently focused. Avoid, therefore, participating, leading, expressing personal opinions or correcting participants' knowledge 3 , 28 as this may bias the process. A relaxed, interested demeanour will also help participants to feel comfortable and promote candid discourse. Moderators should also prevent the discussion being dominated by any one person, ensure differences of opinions are discussed fairly and, if required, encourage reticent participants to contribute. 3 Asking open questions, reflecting on significant issues, inviting further debate, probing responses accordingly, and seeking further clarification, as and where appropriate, will help to obtain sufficient depth and insight into the topic area.
Moderating online focus groups requires comparable skills, particularly if the discussion is synchronous, as the discussion may be dominated by those who can type proficiently. 36 It is therefore important that sufficient time and respect is accorded to those who may not be able to type as quickly. Asynchronous discussions are usually less problematic in this respect, as interactions are less instant. However, moderating an asynchronous discussion presents additional challenges, particularly if participants are geographically dispersed, as they may be online at different times. Consequently, the moderator will not always be present and the discussion may therefore need to occur over several days, which can be difficult to manage and facilitate and invariably requires considerable flexibility. 32 It is also worth recognising that establishing rapport with participants via online medium is often more challenging than via face-to-face and may therefore require additional time, skills, effort and consideration.
As with research interviews, focus groups should be guided by an appropriate interview schedule, as discussed earlier in the paper. For example, the schedule will usually be informed by the review of the literature and study aims, and will merely provide a topic guide to help inform subsequent discussions. To provide a verbatim account of the discussion, focus groups must be recorded, using an audio-recorder with a good quality multi-directional microphone. While videotaping is possible, some participants may find it obtrusive, 3 which may adversely affect group dynamics. The use (or not) of a video recorder, should therefore be carefully considered.
At the end of the focus group, a few minutes should be spent rounding up and reflecting on the discussion. 28 Depending on the topic area, it is possible that some participants may have revealed deeply personal issues and may therefore require further help and support, such as a constructive debrief or possibly even referral on to a relevant third party. It is also possible that some participants may feel that the discussion did not adequately reflect their views and, consequently, may no longer wish to be associated with the study. 28 Such occurrences are likely to be uncommon, but should they arise, it is important to further discuss any concerns and, if appropriate, offer them the opportunity to withdraw (including any data relating to them) from the study. Immediately after the discussion, researchers should compile notes regarding thoughts and ideas about the focus group, which can assist with data analysis and, if appropriate, any further data collection.
Qualitative research is increasingly being utilised within dental research to explore the experiences, perspectives, motivations and beliefs of participants. The contributions of qualitative research to evidence-based practice are increasingly being recognised, both as standalone research and as part of larger mixed-method studies, including clinical trials. Interviews and focus groups remain commonly used data collection methods in qualitative research, and with the advent of digital technologies, their utilisation continues to evolve. However, digital methods of qualitative data collection present additional methodological, ethical and practical considerations, but also potentially offer considerable flexibility to participants and researchers. Consequently, regardless of format, qualitative methods have significant potential to inform important areas of dental practice, policy and further related research.
Gussy M, Dickson-Swift V, Adams J . A scoping review of qualitative research in peer-reviewed dental publications. Int J Dent Hygiene 2013; 11 : 174–179.
Article Google Scholar
Burnard P, Gill P, Stewart K, Treasure E, Chadwick B . Analysing and presenting qualitative data. Br Dent J 2008; 204 : 429–432.
Gill P, Stewart K, Treasure E, Chadwick B . Methods of data collection in qualitative research: interviews and focus groups. Br Dent J 2008; 204 : 291–295.
Gill P, Stewart K, Treasure E, Chadwick B . Conducting qualitative interviews with school children in dental research. Br Dent J 2008; 204 : 371–374.
Stewart K, Gill P, Chadwick B, Treasure E . Qualitative research in dentistry. Br Dent J 2008; 204 : 235–239.
Masood M, Thaliath E, Bower E, Newton J . An appraisal of the quality of published qualitative dental research. Community Dent Oral Epidemiol 2011; 39 : 193–203.
Ellis J, Levine A, Bedos C et al. Refusal of implant supported mandibular overdentures by elderly patients. Gerodontology 2011; 28 : 62–68.
Macfarlane S, Bucknall T . Digital Technologies in Research. In Gerrish K, Lathlean J (editors) The Research Process in Nursing . 7th edition. pp. 71–86. Oxford: Wiley Blackwell; 2015.
Google Scholar
Lee R, Fielding N, Blank G . Online Research Methods in the Social Sciences: An Editorial Introduction. In Fielding N, Lee R, Blank G (editors) The Sage Handbook of Online Research Methods . pp. 3–16. London: Sage Publications; 2016.
Creswell J . Qualitative inquiry and research design: Choosing among five designs . Thousand Oaks, CA: Sage, 1998.
Guest G, Namey E, Mitchell M . Qualitative research: Defining and designing In Guest G, Namey E, Mitchell M (editors) Collecting Qualitative Data: A Field Manual For Applied Research . pp. 1–40. London: Sage Publications, 2013.
Chapter Google Scholar
Pope C, Mays N . Qualitative research: Reaching the parts other methods cannot reach: an introduction to qualitative methods in health and health services research. BMJ 1995; 311 : 42–45.
Giddings L, Grant B . A Trojan Horse for positivism? A critique of mixed methods research. Adv Nurs Sci 2007; 30 : 52–60.
Hammersley M, Atkinson P . Ethnography: Principles in Practice . London: Routledge, 1995.
Oltmann S . Qualitative interviews: A methodological discussion of the interviewer and respondent contexts Forum Qualitative Sozialforschung/Forum: Qualitative Social Research. 2016; 17 : Art. 15.
Patton M . Qualitative Research and Evaluation Methods . Thousand Oaks, CA: Sage, 2002.
Wang M, Vinall-Collier K, Csikar J, Douglas G . A qualitative study of patients' views of techniques to reduce dental anxiety. J Dent 2017; 66 : 45–51.
Lindenmeyer A, Bowyer V, Roscoe J, Dale J, Sutcliffe P . Oral health awareness and care preferences in patients with diabetes: a qualitative study. Fam Pract 2013; 30 : 113–118.
Gallagher J, Clarke W, Wilson N . Understanding the motivation: a qualitative study of dental students' choice of professional career. Eur J Dent Educ 2008; 12 : 89–98.
Tod A . Interviewing. In Gerrish K, Lacey A (editors) The Research Process in Nursing . Oxford: Blackwell Publishing, 2006.
Grey E, Harcourt D, O'Sullivan D, Buchanan H, Kipatrick N . A qualitative study of patients' motivations and expectations for dental implants. Br Dent J 2013; 214 : 10.1038/sj.bdj.2012.1178.
Farmer J, Peressini S, Lawrence H . Exploring the role of the dental hygienist in reducing oral health disparities in Canada: A qualitative study. Int J Dent Hygiene 2017; 10.1111/idh.12276.
McElhinney E, Cheater F, Kidd L . Undertaking qualitative health research in social virtual worlds. J Adv Nurs 2013; 70 : 1267–1275.
Health Research Authority. UK Policy Framework for Health and Social Care Research. Available at https://www.hra.nhs.uk/planning-and-improving-research/policies-standards-legislation/uk-policy-framework-health-social-care-research/ (accessed September 2017).
Baillie J, Gill P, Courtenay P . Knowledge, understanding and experiences of peritonitis among patients, and their families, undertaking peritoneal dialysis: A mixed methods study protocol. J Adv Nurs 2017; 10.1111/jan.13400.
Kvale S . Interviews . Thousand Oaks (CA): Sage, 1996.
Spradley J . The Ethnographic Interview . New York: Holt, Rinehart and Winston, 1979.
Goodman C, Evans C . Focus Groups. In Gerrish K, Lathlean J (editors) The Research Process in Nursing . pp. 401–412. Oxford: Wiley Blackwell, 2015.
Shaha M, Wenzell J, Hill E . Planning and conducting focus group research with nurses. Nurse Res 2011; 18 : 77–87.
Wang G, Gao X, Edward C . Public perception of dental implants: a qualitative study. J Dent 2015; 43 : 798–805.
Bailey E . Contemporary views of dental practitioners' on patient safety. Br Dent J 2015; 219 : 535–540.
Abrams K, Gaiser T . Online Focus Groups. In Field N, Lee R, Blank G (editors) The Sage Handbook of Online Research Methods . pp. 435–450. London: Sage Publications, 2016.
Poynter R . The Handbook of Online and Social Media Research . West Sussex: John Wiley & Sons, 2010.
Kevern J, Webb C . Focus groups as a tool for critical social research in nurse education. Nurse Educ Today 2001; 21 : 323–333.
Kitzinger J, Barbour R . Introduction: The Challenge and Promise of Focus Groups. In Barbour R S K J (editor) Developing Focus Group Research . pp. 1–20. London: Sage Publications, 1999.
Krueger R, Casey M . Focus Groups: A Practical Guide for Applied Research. 4th ed. Thousand Oaks, California: SAGE; 2009.
Download references
Authors and affiliations.
Senior Lecturer (Adult Nursing), School of Healthcare Sciences, Cardiff University,
Lecturer (Adult Nursing) and RCBC Wales Postdoctoral Research Fellow, School of Healthcare Sciences, Cardiff University,
You can also search for this author in PubMed Google Scholar
Correspondence to P. Gill .
Reprints and permissions
Cite this article.
Gill, P., Baillie, J. Interviews and focus groups in qualitative research: an update for the digital age. Br Dent J 225 , 668–672 (2018). https://doi.org/10.1038/sj.bdj.2018.815
Download citation
Accepted : 02 July 2018
Published : 05 October 2018
Issue Date : 12 October 2018
DOI : https://doi.org/10.1038/sj.bdj.2018.815
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
Assessment of women’s needs and wishes regarding interprofessional guidance on oral health in pregnancy – a qualitative study.
BMC Pregnancy and Childbirth (2024)
International Journal of Corporate Social Responsibility (2024)
BMC Public Health (2024)
‘baby mamas’ in urban ghana: an exploratory qualitative study on the factors influencing serial fathering among men in accra, ghana.
Reproductive Health (2023)
Run a free plagiarism check in 10 minutes, automatically generate references for free.
Published on 4 May 2022 by Tegan George . Revised on 10 October 2022.
An unstructured interview is a data collection method that relies on asking participants questions to collect data on a topic. Also known as non-directive interviewing , unstructured interviews do not have a set pattern and questions are not arranged in advance.
In research, unstructured interviews are usually qualitative in nature, and they can be very helpful for social science or humanities research focusing on personal experiences.
An unstructured interview can be a particularly useful exploratory research tool. Known for being very informal and flexible, they can yield captivating responses from your participants.
What is an unstructured interview, when to use an unstructured interview, advantages of unstructured interviews, disadvantages of unstructured interviews, unstructured interview questions, how to conduct an unstructured interview, how to analyse an unstructured interview, presenting your results, frequently asked questions about unstructured interviews.
An unstructured interview is the most flexible type of interview, with room for spontaneity. In contrast to a structured interview , the questions and the order in which they are presented are not set. Instead, the interview proceeds based on the participant’s previous answers.
Unstructured interviews are open-ended.This lack of structure can help you gather detailed information on your topic, while still allowing you to observe patterns in the analysis stage.
It can be challenging to know what type of interview best fits your subject matter. Unstructured interviews can be very challenging to conduct and may not always be the best fit for your research question . Unstructured interviews are best used when:
Even more so than in structured or semi-structured interviews, it is critical that you remain organised and develop a system for keeping track of participant responses. Since the questions are not set beforehand, the data collection and analysis become more complex.
Make sure to choose the type of interview that suits your research best. This table shows the most important differences between the four types.
Fixed questions | ||||
---|---|---|---|---|
Fixed order of questions | ||||
Fixed number of questions | ||||
Option to ask additional questions |
Unstructured interviews have a few advantages compared to other types of interviews.
Respondents are more at ease, reduced risk of bias, more detail and nuance.
Unstructured interviews also have a few downsides compared to other data collection methods.
Risk of leading questions, very time-consuming, risk of low internal validity.
It can be challenging to ask unstructured interview questions that get you the information you seek without biasing your responses. You will have to rely on the flow of the conversation and the cues you pick up from your participants.
Here are a few tips:
Here are a few possibilities for how your conversation could proceed:
Conversation A:
Since the participant hinted that going to the gym is important for their mental health, proceed with questions in that vein, such as:
Conversation B:
Since the participant seems to have strong feelings against the gym, you can probe deeper.
Once you’ve determined that an unstructured interview is the right fit for your research topic , you can proceed with the following steps.
As you conceptualise your research question, consider starting with some guiding questions, such as:
While you do not need to plan your questions ahead of time for an unstructured interview, this does not mean that no advanced planning is needed. Unstructured interviews actually require extensive planning ahead to ensure that the interview stage will be fruitful.
Once you are feeling really solid about your research question, you can start brainstorming categories of questions you may ask. You can start with one broad, overarching question and brainstorm what paths the conversation could take.
There are a few sampling methods you can use to recruit your interview participants, such as:
You should decide ahead of time whether your interview will be conducted in person, over the phone, or via video conferencing.
In-person, phone, or video interviews each have their own advantages and disadvantages.
As you conduct your interviews, pay special attention to any environmental conditions that could bias your responses. This includes noises, temperature, and setting, but also your body language. Be careful to moderate your tone of voice and any responses to avoid interviewer effects.
Remember that one of the biggest challenges with unstructured interviews is to keep your questions neutral and unbiased. Strive for open-ended phrasing, and allow your participants to set the pace, asking follow-up questions that flow naturally from their last answer.
After you’re finished conducting your interviews, you move into the analysis phase. Don’t forget to assign each participant a pseudonym (such as a number or letter) to be sure you stay organised.
First, transcribe your recorded interviews. You can then conduct content or thematic analysis to create your categories, seeking patterns that stand out to you among your responses and testing your hypotheses .
The transcription process can be quite lengthy for unstructured interviews due to their more detailed nature. One decision that can save you quite a bit of time before you get started is whether you will be conducting verbatim transcription or intelligent verbatim transcription.
Transcribing has the added benefit of being a great opportunity for cleaning your data . While you listen, you can take notes of questions or inconsistencies that come up.
Note that in some cases, your supervisor may ask you to add the finished transcriptions in the appendix of your paper.
After you’re finished transcribing, you can begin your thematic or content analysis . Here, you separate words, patterns, or recurring responses that stand out to you into labels or categories for later analysis. This process is called ‘coding’.
Due to the open-ended nature of unstructured interviews, you will most likely proceed with thematic analysis, rather than content analysis. In thematic analysis, you draw preliminary conclusions about your participants by identifying common topics, ideas, or patterns in their responses.
Once you’re confident with your preliminary thoughts, you can take either an inductive or a deductive approach in your analysis.
Thematic analysis is quite subjective, which can lead to issues with the reliability of your results. The unstructured nature of this type of interview leads to greater dependence on your judgement and interpretations. Be extra vigilant about remaining objective here.
After your data analysis, you’re ready to combine your findings into a research paper .
Let’s say you are a history student particularly interested in the history of the town around your campus. The town has a long history dating back to the early 1600s, but town census data shows that many long-term residents have been moving away in recent years.
You identify a few potential reasons for this shift:
Anecdotally, you hypothesise that the increased cost of living is the predominant factor in driving away long-time residents. However, you cannot rule out the other options, specifically the lack of job options coupled with the university’s expansionist aims.
You feel very comfortable with this topic and oral histories in general. Since it is exploratory in nature but has the potential to become sensitive or emotional, you decide to conduct unstructured interviews with long-term residents of your town. Multi-generational residents are of particular interest.
To find the right mix of participants, you post in the Facebook group for town residents, as well as in the town’s NextDoor forum. You also post flyers in local cafés and even some postboxes.
Once you’ve assembled your participants, it’s time to proceed with your interviews. Consider starting out with an icebreaker, such as:
You can then proceed with the interview, asking follow-up questions relevant to your participants’ responses, probing their family history, ties to the community, or any stories they have to share – whether funny, touching, or sentimental.
Establishing rapport with your participants helps you delve into the reasoning behind the choice to stay or leave, and competing thoughts and feelings they may have as the interview goes on. Remember to try to structure it like a conversation, to put them more at ease with the emotional topics.
After conducting your interviews and transcribing your data, you can then conduct thematic analysis, coding responses into different categories. Since you began your research with several theories for why residents may be leaving that all seemed plausible, you would use the inductive approach.
After identifying the relevant themes from your data, you can draw inferences and conclusions. Your results section usually addresses each theme or pattern you found, describing each in turn, as well as how often you came across them in your analysis.
An unstructured interview is the most flexible type of interview, but it is not always the best fit for your research topic.
Unstructured interviews are best used when:
The four most common types of interviews are:
There are various approaches to qualitative data analysis , but they all share five steps in common:
The specifics of each step depend on the focus of the analysis. Some common approaches include textual analysis , thematic analysis , and discourse analysis .
The interviewer effect is a type of bias that emerges when a characteristic of an interviewer (race, age, gender identity, etc.) influences the responses given by the interviewee.
There is a risk of an interviewer effect in all types of interviews , but it can be mitigated by writing really high-quality interview questions.
If you want to cite this source, you can copy and paste the citation or click the ‘Cite this Scribbr article’ button to automatically add the citation to our free Reference Generator.
George, T. (2022, October 10). Unstructured Interview | Definition, Guide & Examples. Scribbr. Retrieved 3 September 2024, from https://www.scribbr.co.uk/research-methods/unstructured-interviews/
Cite this chapter.
Part of the book series: Nonconvex Optimization and Its Applications ((NOIA,volume 5))
349 Accesses
3 Citations
A class of unstructured decision making problems is under consideration. Unstructured problems are the problems with the majority of qualitative parameters with unknown quantitative dependencies. The peculiarities of these tasks are discussed, and requirements for decision aid tools are formulated: psychologically valid measurements and elicitation procedures, constistency testing, and possibility to communicate the result. Method ZAPROS is described as an example of the decision aid, meeting these requirements. Peculiarities of the method are illustrated on an example.
This is a preview of subscription content, log in via an institution to check access.
Subscribe and save.
Tax calculation will be finalised at checkout
Purchases are for personal use only
Institutional subscriptions
Unable to display preview. Download preview PDF.
Bana e Costa, C.A., “Absolute and relative evaluation problematics. The concept of neutral level and the MCDA Robot Technique”, in Cerny, D.Gluckaufova and D. Loula (eds), Proceedings of the International Workshop on Multicriteria Decision Making , Methods - Algorithms - Applications Liblice , March 18–22 , 1991 (Prague 1992)
Google Scholar
Brown R.V. (1989) Toward a prescriptiive science and technology of decision aiding. - Annals of operations research , 19, 467–483.
Corner J.L. and Kirkwood, C.W. (1991) Decision analysis applications in the operations research literature, 1970–1989.– Operations Research , 39, 206–219.
Article Google Scholar
Dror Y. (1989) Public Policy making Reexamined. - Transaction Publishers: New Brunswick (USA) and Oxford (UK).
Goodwin P. and Wright G., (1991) Decision analysis for management judgments..Y.: Wiley.
Kahneman D., Slovic P., Tversky A. (eds) (1982), Judgment under uncertainty: heuristics and biases. - Cambridge: Univ. Press.
Keeney R.L. (1974), Multiplicative utility functions. - Operation Research , 22, 22–34. Keeney R.L. ( 1980 ), Siting energy facilities. - N.Y.: Academic Press.
Keeney R., (1992) Value-focused thinking. - Harvard Univ. Press.
Keeney R., Raiffa H. (1976), Decisions with multiple objectives: preference and value tradeoffs.- New York: Wiley.
Larichev O.I. (1987) Objective models and Subjective Decisions. - Moscow: Nauka, 87 (in Russian).
Larichev O.I. (1992), Cognitive validity in design of decision-aiding techniques.– Journal of Multi-Criteria Decision Analysis , 1, 127–138.
Larichev O.I., Furems E.M. (1987) Multicriteria Packing Problems. In: Y.Sawaragi, K.Inoue, H.Nakayama (Eds) Towards Interactive and Intelligent Decision Support Systems , Springer-Verlag.
Larichev O.I., Kozucharov A. (1979) Multiple criteria assignment problem: combining the collective criterion with individual preferences.– Mathematical Science Humain , 68, 63–77.
Larichev O.I., Moshkovich H.M. (1988) Limits to decision making ability in direct multiattribute alternative evaluation.– OBHDP , 42, 217–233.
Larichev 0., Moshkovich H. (1990) Decision Support System CLASS for R and D Planning, - Proceedings of First International Conference on Expert Planning Systems , Brighton , Conf. Public. N 322, The Institue of Electrical Engineers, 227–232.
Larichev 0.1., Moshkovich H.M. (1991), ZAPROS: a method and a system for ordering of multiattribute alternatives on the base of decision-maker’s preferences. - Preprint, Moscow: VNIISI press, 1991 (in English).
Larichev O.I., Moshkovich H.M. (1992) Decision Support System ORCLASS, Proceedings of the Tenth International Conférence on Multiple Criteria Decision Making , Taiwan, 1, 341–350.
Larichev O.I., Moshkovich H.M. (1994a) An Approach to Ordinal Classification Problems. - Int.Trans.Oper.Res , v.1 , no.3 , pp.375–385 .
Larichev O.I., Moshkovich H.M. (1994b) ZAPROS-LM a method and system for ordering multiattribute alternatives. - European Journal of Operational Research (in press).
Larichev O.I., Moshkovich H.M., Mechitov A.I., Olson D.L. (1993), Qualitative approaches to rank-ordering multiattribute alternatives.– Journal of Multi-Criteria Decision Analysis , 2, 5–26.
Larichev O.I., Polyakov O.A., Nikiforov A.D. (1987), Multicriterion linear programming problems (Analytical Survey)– Journal of economical psychology , 8, 389–407.
Larichev 0.1., Zuev Yu.A., Gnedenko L.S. (1974), Method for classification of applied RandD projects. - In: S.V.Emelyanov (ed.) Perspective apllied RandD planning. - Moscow : Nauka press, 28–57 (in Russian).
Mirkin B.G. (1974), Problems of group choice. - Moscow: Nauka press (in Russian).
Moskovich H.M. (1988) Interactive system ZAPROS (for ordering of multiattribute alternatives on the basis of decision maker’s preferences). - In: Larichev O.I., Emelyanov S.V. (eds), Man-machine procedures for decision making. - Moscow: VNIISI press, 11, 13–21 (in Russian).
von Neumann J.and Morgenstern 0. (1947) Theory of games and economic behavior. - Princeton University Press, Princeton.
Quade E.S. (1984), Analysis of Military Decisions. - Chicago: McNally.
Roy B. (1985) Methodologe multicritere d’aide a la decision, Economica.
Simon H., Newell A. (1958), Heuristic Problem Solving: the next Advance in Operastions Research. - Operations Research , 6.
Jan. Steuer R. (1986) Multiple Criteria Optimization: Theory, Computation and Application. N.Y., Wiley.
von Winterfeldt D. and Edwards W., (1986), Decision Analysis and Behavioral Research. - Cambridge University Press.
Yu, W., (1992), ELECTRE TRI, Aspects methodologiques et manuel d’utilisation, in:Document du LAMSADE, 74 ( Paris: Universite de Paris-Dauphine ).
Download references
Authors and affiliations.
Institute for System Analysis Russian Academy of Sciences, Moscow, Russland
O. I. Larichev & H. M. Moskovich
You can also search for this author in PubMed Google Scholar
Editors and affiliations.
Dept. of Industrial and Systems Engineering, University of Florida, 303 Weil Hall, 32611, Gainesville, FL, USA
Panos M. Pardalos
DSS Laboratory, Dept. of Production Engineering and Management, Technical University of Crete, University Campus, 73100, Chania, Greece
Yannis Siskos & Constantin Zopounidis &
Reprints and permissions
© 1995 Springer Science+Business Media Dordrecht
Larichev, O.I., Moskovich, H.M. (1995). Unstructured Problems and Development of Prescriptive Decision Making Methods. In: Pardalos, P.M., Siskos, Y., Zopounidis, C. (eds) Advances in Multicriteria Analysis. Nonconvex Optimization and Its Applications, vol 5. Springer, Boston, MA. https://doi.org/10.1007/978-1-4757-2383-0_4
DOI : https://doi.org/10.1007/978-1-4757-2383-0_4
Publisher Name : Springer, Boston, MA
Print ISBN : 978-1-4419-4748-2
Online ISBN : 978-1-4757-2383-0
eBook Packages : Springer Book Archive
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
Policies and ethics
Trials volume 25 , Article number: 596 ( 2024 ) Cite this article
Metrics details
Ensuring diversity in clinical trials can be a challenge, which may be exacerbated when recruiting vulnerable populations, such as participants with mental health illness. As recruitment continues to be the major cause of trial delays, researchers are turning to online recruitment strategies, e.g. social media, to reach a wider population and reduce recruitment time and costs. There is mixed evidence for the use of online recruitment strategies; therefore, the REcruitment in Mental health trials: broadening the ‘net’, opportunities for INclusivity through online methoDs (RE-MIND) study aimed to identify evidence and provide guidance for use of online strategies in recruitment to mental health trials, with a focus on whether online strategies can enhance inclusivity. This commentary, as part of the RE-MIND study, focusses on providing recommendations for recruitment strategy selection in future research with the aim to improve trial efficiency.
A mixed-methods approach was employed involving three work packages: (I) an evidence review of a cohort of 97 recently published randomised controlled trials/feasibility or pilot studies in mental health to assess the impact of online versus offline recruitment; (II) a qualitative study investigating the experiences of n = 23 key stakeholders on use of an online recruitment approach in mental health clinical trials; (III) combining the results of WP1 and WP2 to produce recommendations on the use of an online recruitment strategy in mental health clinical trials. The findings from WP1 and 2 have been published elsewhere; this commentary represents the results of the third work package.
For external validity, clinical trial participants should reflect the populations that will ultimately receive the interventions being tested, if proven effective. To guide researchers on their options for inclusive recruitment strategies, we have developed a list of considerations and practical recommendations on how to maximise the use of online recruitment methods.
Peer Review reports
Recruitment to clinical trials is challenging, and those in mental health research are no exception and people with mental health illness have been identified as an under-served group in health research [ 1 ]. The importance of broader representation of under-served populations in clinical trials is already well established to ensure they reflect the populations that stand to benefit from the intervention being tested [ 2 ]. The question is how do we improve recruitment when we already know that mental health service use is proportionately lower for the socioeconomically disadvantaged [ 3 ], males [ 4 ], people from ethnic minority backgrounds [ 5 ], and older participants or those living in more rural areas [ 6 ]. Traditionally, recruitment into mental health trials has been dependent upon face-to-face referrals and therefore limited to those individuals actively seeking service intervention, thus perpetuating the problem [ 7 ]. Furthermore, increasing pressures on mental health services has become an obstacle to the delivery of trials using this approach; however, technological advances are allowing researchers to be more creative and dynamic in their choice of recruitment strategies to target potential participants typically outside of services and reach wider groups of people [ 8 ]. Despite this potential, deciding upon what might be the best recruitment strategy for those living with mental health illness needs further careful consideration.
To help address, this we conducted a study, “REcruitment in Mental health trials: broadening the ‘net’, opportunities for Inclusivity through online methoDs’ (RE-MIND)” https://www.nctu.ac.uk/our-research/methodology.aspx . The objective was to explore the use of offline and online recruitment strategies with the aim of helping researchers improve recruitment reach and increase the efficiency of clinical trials of mental health interventions.
This project focussed on the recruitment strategy used to make the initial approach to potential participants, informing them about an active clinical trial. As our focus was on the initial stage in recruitment, we did not cover issues surrounding the consent process itself. Despite this, we acknowledge the importance of the methods of taking informed consent, and this should be considered when deciding on a recruitment strategy.
The RE-MIND study consisted of two work packages which have been published separately [ 9 , 10 ]. First is an evidence review of 97 recently published randomised controlled trials (RCTs) and randomised feasibility/pilot studies in mental health to assess the impact of online recruitment versus offline recruitment in clinical trials [ 9 ]. Second is a qualitative study investigating the experiences, opinions, and ideas of n = 23 key stakeholders (research staff and patients and public involvement members with experience working in mental health research) on the use of online recruitment as an approach in mental health clinical trials [ 10 ]. The findings were then triangulated [ 11 ] by researchers MI, KS, and CLH to develop draft considerations and practical recommendations which then underwent a review process by the study Advisory Group (HRG, AW, SRE, EJ, MT, and JM) who have experience in digital research, design, and delivery of online and offline RCTs and equality, diversity, and inclusion resulting in the final recommendations.
Throughout the RE-MIND study, we used the following definitions to broadly categorise offline or online recruitment. These definitions describe an overarching strategy to recruitment:
Online recruitment strategies —the use of Internet technologies such as social media advertisements, Google search engine advertisements, and other website campaigns [ 12 ].
Offline recruitment strategies —in-clinic recruitment, approaching potential participants through mail and telephone using health records and registers, media campaigns, newspaper advertisements, and input during radio and television interviews [ 12 ].
In this commentary, we present a list of considerations and practical recommendations for research teams on the use of online recruitment of participants into mental health clinical trials with the aim to improve recruitment efficiency in clinical trials of mental health interventions. It is worth noting that although the RE-MIND study focussed on mental health interventions the findings may also be beneficial in wider clinical research.
Severity of mental health illness has previously been identified as a barrier to participation in mental health research [ 13 , 14 ]. RE-MIND reported that the type of mental health illness, its stage, participants’ feelings about their illness, and carers’ responsibilities were key factors when selecting a recruitment strategy [ 10 ]. Alongside meaningful and authentic patient and public involvement (PPI) to guide and inform the recruitment strategy, using a multi-method approach to recruitment could improve accessibility and inclusivity, by supporting the diverse and changing needs of those living with mental health illness.
Consider any relationships between recruitment strategy and mental health symptomatology:
For example, individuals with learning disabilities, autism, anxiety, or obsessive compulsive disorder may have difficulty interfacing in public and therefore may benefit from online recruitment.
Online recruitment may, however, be a barrier for other mental health illnesses such as low mood disorders, depression, personality disorders, and psychosis where an in-person approach offers more security, contact, and support to the individual.
Consider using the stage or severity of illness to inform recruitment method:
Will the person’s diagnostic and treatment experience impact on selection of recruitment method, for example, both patients and carers may be reluctant to talk about or need more time to process a diagnosis in the early stages?
Are personal cues, such as body language, important for communicating with your participants and supporting greater engagement in a trial, for example, recognising changes in mental health state, physical discomfort, increasing tics, loss of concentration, fatigue, etc.?
Is personal contact preferable or more encouraging, for example, for building rapport and trust with the individual?
Consider whether the recruitment method selected may impact on any experience of stigma around mental health:
Providing a virtual safe space (online) may be beneficial, but the safety of this space relies on participants having secure and private access to a safe space and a device that can access the Internet.
Consider the impact of the relationship between participants living with mental illness and the research team:
Trusting relationships are deemed important for both recruitment and retention of participants living with mental ill health. Knowing that a health care provider understands an illness and can offer personalised support can be reassuring.
Will your recruitment strategy choices contribute to maintaining or building trust with this group? Online recruitment, such as social media, can be seen as distant and disengaging compared to in-person recruitment. Regular trial updates and information sharing through short videos or live ‘chats’ may help ‘humanise’ the trial on digital platforms.
Develop your recruitment approach (offline/online/mixed) by working in partnership with potential participants and members of the public that share characteristics with your target population group. You can identify PPI contributors through your local employing organisation or through professional or existing research or public contributor groups such as Sprouting Minds https://digitalyouth.ac.uk/the-digital-youth-programme/about-sprouting-minds/ . Please note that most UK National Health Service (NHS) Trusts have established PPI Groups.
Build in flexibility where possible at the protocol development stage, to ensure that participants with fluctuating symptoms can remain engaged in a safe and supported way. This may be achieved in several ways, for example, by offering a mixed recruitment strategy to allow individuals to choose how they want to participate. Alternatively, you may select an online recruitment strategy via Facebook for the initial approach to participate but then build in telephone or in-person opportunities for eligibility checks or follow-ups. It is important to ensure participants know that these options exist at the earliest opportunity.
RE-MIND identified a number of specific challenges to inclusive recruitment into mental health clinical trials. Continuing stigma surrounding mental health was a significant factor on a political, cultural, community, and individual level, underpinned by lack of education and mistrust of services and research [ 10 ]. In addition, lack of researcher skills and experience in inclusive recruitment strategies has also been found to contribute to underrepresentation in clinical research [ 15 , 16 ]. This highlights the critical role of PPI in understanding a trial population’s needs. It is also vital to educate researchers on equality and diversity, to enable co-design and selection of suitable recruitment methods to improve representation in mental health clinical trials, for example, through better implementation of the UK’s National Institute for Health Research (NIHR) INCLUDE ethnicity framework [ 1 ].
Consider the impact of the relationship between participants from marginalised groups and the research team:
Will your recruitment strategy choices contribute to maintaining or building trust with this group, for example, those living with mental health illness in rural or under-served communities may benefit from an online recruitment strategy?
Can you develop relationships with local and/or national community groups to build trust in your research? Identify community group leaders who will advocate for your research.
Do you have connections with trusted members of the community to support the building and development of relationships to facilitate inclusive recruitment? This can be in-person or online for example. through administrators of Facebook groups, libraries, or leaders of interest groups.
Do you have a PPI member with lived experience on your research team who can advocate for your research with community groups? Establishing connections through shared experience can help break down barriers of mistrust and misunderstanding.
Consider which recruitment methods your target participant populations may prefer. Living with a mental health illness can be complex due to fluctuating health status or exacerbation of symptoms:
Think about what factors may be most important to them, e.g. if they are working, parents, carers, and/or attending school, then convenience may be the main factor to target.
Consider the range of media platforms available to target people who are educationally or socioeconomically diverse.
If local IT access, e.g. poor Internet access is known in a geographical area, consider using mixed methods for recruitment to improve inclusivity.
Consider information provision and accessibility when selecting your recruitment methods:
Consider whether the methods you are using to recruit and retain participants allow for language (written and/or spoken) needs to be met, e.g., using a translation service.
Consider whether the recruitment method selected allows you to adequately communicate what you need to your participants for example:
Social media platforms such as X (previously Twitter) or use of SMS text-based services have character limitations. Could any language or phrasing lead to misinterpretation or misunderstanding
Use of clinical or diagnostic terms, phrases and labels when considering issues of stigma.
If you are using offline methods, are they accessible for people in a physical sense? E.g., people with motor/mobility needs, or visual or auditory difficulties.
If you are using online methods, are the colours, font, and imagery that you are using inclusive? E.g., alt text for images, colour blindness, colour contrast and font readability.
Work in partnership with people with lived experience and members of the public that share characteristics with your target population group. Explore the needs of both the trial team and the target population group and select methods that are effective for both parties.
Greater sensitivities and confidentiality in mental health care mean that relationships and trust are critical, which may be easier to facilitate face-to-face. However, online recruitment may offer greater flexibility and convenience for participants, for example, by supporting those who may find in-person contact challenging due to their illness. When selecting a recruitment strategy , be mindful of both advantages and drawbacks of the strategy used.
Avoid stereotypes, particularly related to age, when thinking about online methods. For example, technology as a barrier is likely reduced with each generation as well as recent necessity to engage with digital communications (e.g. smartphones, WhatsApp, Facebook, videoconferencing platforms) due to the COVID pandemic.
Identify the main demographic characteristic(s) that is important to engage with your trial, and then consider how other characteristics may impact how they react to the recruitment strategy you have in mind. For example, if you know you want to include young people, consider using TikTok, whereas Facebook may be preferable for older participants. It is important to think about other characteristics that may impact if/how social media is used, e.g. mental health status, socioeconomic status, health status, gender.
There are a growing number of community-led mental illness specific support groups on social media. Can you access and/or engage these groups to help with recruitment? Care should be taken not to harm the safe spaces afforded by these groups, for example for a researcher joining a group purely for the purpose of trial promotion.
RE-MIND found that for people living with mental health illness, there remained a significant element of fear and mistrust in using online methods underpinned by the stigma and vulnerability of mental health illness with the potential for confidentiality to be broken [ 10 ]. Understanding safeguards for the range of digital platforms was particularly complex and in line with other research suggests better regulation is needed of digital platforms [ 17 ], which at times were not deemed as stringent as clinical trial requirements.
Consider putting appropriate safeguards in place for the recruitment methods selected, e.g. firewalls, General data Protection Regulation (GDPR), secure server.
Can you use a quick response (QR) code to improve security and safety. A QR code is an image scannable by a digital device that can impart information.
Does your organisation have data management policies for use of digital platforms such as social media that must be adhered to? Consider local policies required for multi-site trials.
Is your recruitment method a credible source, e.g. not mistaken for spam, phishing?
Allocate a moderator for engagement with online public groups to ensure safeguarding and wellbeing of people engaging with the content.
How will you inform potential participants about how their data will be shared and/or managed online?
Consider the resources required to adequately manage large numbers of enquiries generated by online strategies:
Do you have the resources to support the additional work associated with screening and monitoring of data quality?
Ensure that eligibility criteria are clearly communicated to potential participants.
Invest adequate time and resources in ensuring your data management systems are secure and safe for participants. You may want to make use restrictive software features for online methods.
Invest time to ensure security and safety methods are communicated clearly. You should work in partnership with potential participants and members of the public that share characteristics with your potential participant group to do this.
The process of targeting recruitment using an online strategy has been considered as more time-efficient and cost-effective than traditional offline (in-person) recruitment [ 12 ]. However, knowledge of digital platforms and access to organisational and technical support and funding were the most common challenges researchers cited when selecting a recruitment strategy in the RE-MIND study [ 10 ]. It appears that despite advances in technology offering greater opportunity to reach wider audiences, many of these advances remain underutilised without adequate support and resources.
Consider identifying trials involving similar participant populations to learn from their experience of recruitment:
For example, information on trials can be accessed from ClinicalTrials.Gov, PubMed, etc.
Remember that this relies on adequate reporting of recruitment strategy.
Think about how previous trials could have been improved.
Consider the impact of researchers/recruiters being in/adequately trained and knowledgeable on how to use the online recruitment methods you have chosen:
If you are using social media, does your organisation have policies and/or expertise that can be used to support engagement on specific platforms
Does your organisation have procedures for payment for social media promotion?
Do you have local services available to support at an organisational level when things go wrong, e.g. IT, marketing, or communications teams?
Ensure your recruitment methods are appropriately funded, for example, advertising costs per click; do you need a professional designer to produce visual summaries of the research, such as infographics?
Do you have lived experience patient and public input on the selection of recruitment strategy, including content and presentation?
Make a conscious effort to learn from previous trials aimed at the populations you are intending to recruit. Reflect upon how these trials may differ from yours and how that may impact your selection of recruitment process (e.g., severity or stage of mental health illness, intervention type, locality, country, setting, healthcare system, culture).
Ensure research teams are adequately trained on systems and software, and that they know where to go when systems fail, or if they have unanswered questions.
This list of considerations and recommendations is based on the experiences of key partners and the findings from the RE-MIND project, outlining factors to consider when planning recruitment strategies in mental health research/clinical trials. It should be used as a starting point for discussions among the trial team. We acknowledge the potential limitations of each consideration in context of individual and/or organisational capacity, funding and resources available.
The process of selecting a suitable recruitment method should give due consideration to the study population as well as the resources (including staff time and training) needed to implement that method. The ideal juncture to do this is when writing a trial grant funding proposal to ensure adequate resourcing. However, we encourage trial teams that are struggling to recruit to use our considerations and recommendations to re-evaluate their approach to recruitment.
The considerations are designed to be used flexibly based on the target population to be recruited. Greater consideration should be given to using online or mixed methods recruitment strategies that adopt a tailored approach, offering flexibility and choice, to enable wider participation. For future work, we recommend revisiting and re-evaluating these considerations after they have been implemented in practical settings. This process of reassessment will allow us to gain valuable insights into the real-world impact and effectiveness of our proposed strategies. It will also enable us to make necessary adjustments, fine-tune our recommendations, and ensure their continued relevance and success in evolving contexts.
The data collected, used, and/or analysed during the current study are available from the Nottingham Clinical Trials Unit (NCTU) via the corresponding author on reasonable request.
General Data Protection Regulation
Patient and public involvement
Nottingham Clinical Trials Unit
National health Service
National Institute for Health and Care Research
Quick response
Randomised controlled trial
Short message service
REcruitment in Mental health trials: broadening the ‘net’, opportunities for INclusivity through online methoDs
United Kingdom
National Institute for Health Research. Improving inclusion of under-served groups in clinical research: Guidance from the NIHR INCLUDE project 2020 [09August2023]. Available from: https://www.nihr.ac.uk/documents/improving-inclusion-of-under-served-groups-in-clinical-research-guidance-from-include-project/25435 .
Clark LT, Watkins L, Piña IL, Elmer M, Akinboboye O, Gorham M, et al. Increasing diversity in clinical trials: overcoming critical barriers. Curr Probl Cardiol. 2019;44(5):148–72.
Article PubMed Google Scholar
Robards F, Kang M, Usherwood T, Sanci L. How marginalized young people access, engage with, and navigate health-care systems in the digital age: systematic review. J Adolesc Health. 2018;62(4):365–81.
Pattyn E, Verhaeghe M, Bracke P. The gender gap in mental health service use. Soc Psychiatry Psychiatr Epidemiol. 2015;50(7):1089–95.
Tiwari SK, Wang J. Ethnic differences in mental health service use among White, Chinese, South Asian and South East Asian populations living in Canada. Soc Psychiatry Psychiatr Epidemiol. 2008;43(11):866–71.
Brenes GA, Danhauer SC, Lyles MF, Hogan PE, Miller ME. Barriers to mental health treatment in rural older adults. Am J Geriatr Psychiatry. 2015;23(11):1172–8.
Article PubMed PubMed Central Google Scholar
Barak A. Psychological applications on the Internet: a discipline on the threshold of a new millennium. Appl Prev Psychol. 1999;8(4):231–45.
Article Google Scholar
Akers L, Gordon JS. Using Facebook for large-scale online randomized clinical trial recruitment: effective advertising strategies. J Med Internet Res. 2018;20(11): e290.
Iflaifel M, Hall CL, Green HR, Willis A, Rennick-Egglestone S, Juszczak E, et al. Recruitment strategies in mental health clinical trials: a scoping review (RE-MIND Study). Trials [In Peer Review]. June 2024.
Iflaifel M, Hall CL, Green HR, Willis A, Rennick-Egglestone S, Juszczak E, et al. Widening participation – recruitment methods in mental health randomised controlled trials: a qualitative study. BMC Med Res Methodol. 2023;23(1):211.
Farmer T, Robinson K, Elliott SJ, Eyles J. Developing and Implementing a Triangulation Protocol for Qualitative Health Research. Qual Health Res. 2006;16(3):377–94.
Brøgger-Mikkelsen M, Ali Z, Zibert JR, Andersen AD, Thomsen SF. Online patient recruitment in clinical trials: systematic review and meta-analysis. J Med Internet Res. 2020;22(11): e22179.
Kaminsky A, Roberts LW, Brody JL. Influences upon willingness to participate in schizophrenia research: an analysis of narrative data from 63 people with schizophrenia. Ethics Behav. 2003;13(3):279–302.
Woodall A, Morgan C, Sloan C, Howard L. Barriers to participation in mental health research: are there specific gender, ethnicity and age related barriers? BMC Psychiatry. 2010;10:103.
Kusnoor SV, Villalta-Gil V, Michaels M, Joosten Y, Israel TL, Epelbaum MI, et al. Design and implementation of a massive open online course on enhancing the recruitment of minorities in clinical trials - Faster Together. BMC Med Res Methodol. 2021;21(1):44.
Niranjan SJ, Durant RW, Wenzel JA, Cook ED, Fouad MN, Vickers SM, et al. Training needs of clinical and research professionals to optimize minority recruitment and retention in cancer clinical trials. J Cancer Educ. 2019;34(1):26–34.
Mühlhoff R, Willem T. Social media advertising for clinical studies: ethical and data protection implications of online targeting. Big Data Soc. 2023;10(1):20539517231156130.
Download references
The study authors would like to thank all our focus group and interview participants and the UK Clinical Research Collaboration for their support of the project culminating in these recommendations for future practice.
This project is funded by the National Institute for Health and Care Research (NIHR) CTU Support Funding scheme. The views expressed are those of the author(s) and not necessarily those of the NIHR or the Department of Health and Social Care. Open Access funding provided by The University of Nottingham. Stefan Rennick-Egglestone and Charlotte L Hall were supported by the NIHR Nottingham Biomedical Research Centre (NIHR203310).
Authors and affiliations.
Nottingham Clinical Trials Unit, University of Nottingham, Nottingham, UK
Mais Iflaifel, Edmund Juszczak & Kirsty Sprange
Institute of Mental Health, School of Medicine, NIHR MindTech MedTech HRC, Mental Health and Clinical Neurosciences, University of Nottingham, Innovation Park, Triumph Road, Nottingham, UK
Charlotte L. Hall & Jennifer Martin
Institute of Mental Health, NIHR Nottingham Biomedical Research Centre, University of Nottingham, Innovation Park, Triumph Road, Nottingham, UK
Charlotte L. Hall, Stefan Rennick-Egglestone & Jennifer Martin
Health Services Research Unit, University of Aberdeen, Aberdeen, UK
Heidi R. Green
COUCH Health, Manchester, UK
Leicester/Diabetes Research Centre, Centre for Ethnic Health Research, University of Leicester, Leicester, UK
Andrew Willis
School of Health Sciences, Institute of Mental Health, University of Nottingham, Nottingham, UK
Stefan Rennick-Egglestone
NIHR Evaluation, Trials and Studies Coordinating Centre (NETSCC), Southampton, UK
Mark Townsend
You can also search for this author in PubMed Google Scholar
All authors contributed to designing the RE-MIND study. All authors contributed to the selection and refinement of the recommendations. MI and KS drafted the initial manuscript. All authors reviewed and edited drafts of the manuscript. All authors accepted the final version of the manuscript.
Correspondence to Kirsty Sprange .
Ethics approval and consent to participate.
The RE-MIND study received approval from the University of Nottingham Research Ethics Committee (FMHS 13–0422) on 13 June 2022.
Not applicable.
The authors declare no competing interests.
Publisher’s note.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/ .
Reprints and permissions
Cite this article.
Iflaifel, M., Hall, C.L., Green, H.R. et al. Using online methods to recruit participants into mental health clinical trials: considerations and recommendations from the RE-MIND study. Trials 25 , 596 (2024). https://doi.org/10.1186/s13063-024-08435-9
Download citation
Received : 12 January 2024
Accepted : 23 August 2024
Published : 07 September 2024
DOI : https://doi.org/10.1186/s13063-024-08435-9
Anyone you share the following link with will be able to read this content:
Sorry, a shareable link is not currently available for this article.
Provided by the Springer Nature SharedIt content-sharing initiative
ISSN: 1745-6215
Social Sciences
03 June - 07 June 2024
Barcelona Four Seasons School of Demography
Institution:
Centre d’Estudis Demogràfics (CED – Centre for Demographic Studies). Universitat Autònoma de Barcelona
Fernanda Fortes de Lena (PhD) & María Andrée López Gómez (PhD) have experience in applying quantitative methods as well as qualitative methods. See more on our website.
The course will be useful to PhD students, postdocs and senior researchers and anyone interested in learning qualitative research methods.
Upon completion of the course, students will be able to identify research methods that are most adequate to answer their research questions, and understand how to design a study using qualitative methods, mixed-methods or a combination of qualitative and quantitative methods. Students will learn to analyze qualitative data and disseminate findings from qualitative research.
400 EUR, EUR 400: tuition fees
Mannheim, Germany
23 September - 27 September 2024
Colchester, United Kingdom
21 October - 25 October 2024
Utrecht, Netherlands
16 December - 18 December 2024
If you don’t want to miss out on new summer school courses, subscribe to our monthly newsletter.
Levels of measurement: explained simply (with examples).
By: Derek Jansen (MBA) | Expert Reviewed By Dr. Eunice Rautenbach | November 2020
If you’re new to the world of quantitative data analysis and statistics, you’ve most likely run into the four horsemen of levels of measurement : nominal, ordinal, interval and ratio . And if you’ve landed here, you’re probably a little confused or uncertain about them.
Don’t stress – in this post, we’ll explain nominal, ordinal, interval and ratio levels of measurement in simple terms , with loads of practical examples .
Here’s what we’ll be covering in this post. Click to skip directly to that section.
When you’re collecting survey data (or, really any kind of quantitative data) for your research project, you’re going to land up with two types of data – categorical and/or numerical . These reflect different levels of measurement.
Categorical data is data that reflect characteristics or categories (no big surprise there!). For example, categorical data could include variables such as gender, hair colour, ethnicity, coffee preference, etc. In other words, categorical data is essentially a way of assigning numbers to qualitative data (e.g. 1 for male, 2 for female, and so on).
Numerical data , on the other hand, reflects data that are inherently numbers-based and quantitative in nature. For example, age, height, weight. In other words, these are things that are naturally measured as numbers (i.e. they’re quantitative), as opposed to categorical data (which involves assigning numbers to qualitative characteristics or groups).
Within each of these two main categories, there are two levels of measurement:
Let’s take look at each of these, along with some practical examples.
As we’ve discussed, nominal data is a categorical data type, so it describes qualitative characteristics or groups, with no order or rank between categories. Examples of nominal data include:
In all of these examples, the data options are categorical , and there’s no ranking or natural order . In other words, they all have the same value – one is not ranked above another. So, you can view nominal data as the most basic level of measurement , reflecting categories with no rank or order involved.
Ordinal data kicks things up a notch. It’s the same as nominal data in that it’s looking at categories, but unlike nominal data, there is also a meaningful order or rank between the options. Here are some examples of ordinal data:
As you can see in these examples, all the options are still categories, but there is an ordering or ranking difference between the options . You can’t numerically measure the differences between the options (because they are categories, after all), but you can order and/or logically rank them. So, you can view ordinal as a slightly more sophisticated level of measurement than nominal.
As we discussed earlier, interval data are a numerical data type. In other words, it’s a level of measurement that involves data that’s naturally quantitative (is usually measured in numbers). Specifically, interval data has an order (like ordinal data), plus the spaces between measurement points are equal (unlike ordinal data).
Sounds a bit fluffy and conceptual? Let’s take a look at some examples of interval data:
Importantly, in all of these examples of interval data, the data points are numerical , but the zero point is arbitrary . For example, a temperature of zero degrees Fahrenheit doesn’t mean that there is no temperature (or no heat at all) – it just means the temperature is 10 degrees less than 10. Similarly, you cannot achieve a zero credit score or GMAT score.
In other words, interval data is a level of measurement that’s numerical (and you can measure the distance between points), but that doesn’t have a meaningful zero point – the zero is arbitrary.
Long story short – interval-type data offers a more sophisticated level of measurement than nominal and ordinal data, but it’s still not perfect. Enter, ratio data…
Ratio-type data is the most sophisticated level of measurement. Like interval data, it is ordered/ranked and the numerical distance between points is consistent (and can be measured). But what makes it the king of measurement is that the zero point reflects an absolute zero (unlike interval data’s arbitrary zero point). In other words, a measurement of zero means that there is nothing of that variable.
Here are some examples of ratio data:
In all of these examples, you can see that the zero point is absolute . For example, zero seconds quite literally means zero duration. Similarly, zero weight means weightless. It’s not some arbitrary number. This is what makes ratio-type data the most sophisticated level of measurement.
With ratio data, not only can you meaningfully measure distances between data points (i.e. add and subtract) – you can also meaningfully multiply and divide . For example, 20 minutes is indeed twice as much time as 10 minutes. You couldn’t do that with credit scores (i.e. interval data), as there’s no such thing as a zero credit score. This is why ratio data is king in the land of measurement levels.
At this point, you’re probably thinking, “Well that’s some lovely nit-picking nerdery there, Derek – but why does it matter?”. That’s a good question. And there’s a good answer .
The reason it’s important to understand the levels of measurement in your data – nominal, ordinal, interval and ratio – is because they directly impact which statistical techniques you can use in your analysis. Each statistical test only works with certain types of data. Some techniques work with categorical data (i.e. nominal or ordinal data), while others work with numerical data (i.e. interval or ratio data) – and some work with a mix . While statistical software like SPSS or R might “let” you run the test with the wrong type of data, your results will be flawed at best , and meaningless at worst.
The takeaway – make sure you understand the differences between the various levels of measurement before you decide on your statistical analysis techniques. Even better, think about what type of data you want to collect at the survey design stage (and design your survey accordingly) so that you can run the most sophisticated statistical analyses once you’ve got your data.
In this post, we looked at the four levels of measurement – nominal, ordinal, interval and ratio . Here’s a visual summary of each.
This post was based on one of our popular Research Bootcamps . If you're working on a research project, you'll definitely want to check this out ...
Clear, concise with examples. PLUS in your videos you include other names or terms that could apply to the topic you are reviewing. This is so important! You are fantastic! It has been many, many, many moons ago that these were learned. They are now necessary again as the nursing profession progresses deeper into evidence based practice.
Thanks for the feedback, Diana 🙂
Good explanation.. I came here after giving 5 marks for each question in a quiz n wondering that the data is not continuous and how to analyse it further.. Understood it is ratio and i can use mean/ median accordingly
Glad it helped!
Bloody good! You saved my homework (:
Happy to help 🙂
High quality of education stuff, thank you very much.
great knowledge shared here. I had problem understanding this at the undergraduate school but very clear now. Thanks to GRADCOACH
What type of data would age be? Ratio or interval?
It would be ratio. However, if you are using age ranges (e.g. 18 – 25, 26 – 35, etc.), this wouldn’t be the case.
What is age ranges considered?
What measurement scale is ideal to use when measuring “knowledge” and the acceptable responses are “yes,” “no,” or “not sure”? What kind of analytical test is suitable in this situation?
I watched your youtube tutorial on quantitative analysis and it was really informative.
However, I’m trying to navigate your blog to find the post that discusses the different inferential statistical methods and the data type they support.
Kindly forward this link to my email : [email protected]
Scores from a performance test are ratio data?
It is an excellent discussion about levels of measurement.
Pretty! This was an incredibly wonderful article. Thanks for providing this info.
Thank you so much for this information! The study material was vague.
Your email address will not be published. Required fields are marked *
Save my name, email, and website in this browser for the next time I comment.
IMAGES
VIDEO
COMMENTS
Unstructured Interview | Definition, Guide & Examples
Qualitative Research Methods are as follows: One-to-One Interview. ... Qualitative data analysis is a process of turning unstructured data into meaningful insights. It involves extracting and organizing information from sources like interviews, focus groups, and surveys. The goal is to understand people's attitudes, behaviors, and motivations
Qualitative research method-interviewing and observation
chapter will focus on unstructured interviews as a qualitative research method for data collection. The unstructured interview technique was developed in the disciplines of anthropology and sociology as a method to elicit people's social realities. In the literature, the term is used interchangeably with the terms, informal conversational
How to use and assess qualitative research methods - PMC
research interview, as a qualitative research method, as a "uniquely sensitive and powerful method for capturing the experiences and lived meanings of the subjects' every-day world".5 He proposed that "an interview is literally an inter view, or an inter change of views between two persons conversing about a theme of mutual interest"5 ...
The 3 Cs approach to unstructured field observations can be used when observation is the primary research method 46 or in tandem with another research method, such as qualitative interviews. 51 In the Qatar recruitment study, the observations were conducted more with the intent of being supplemental, but ultimately served as the primary source ...
This chapter gives an introduction to qualitative interviewing in its unstructured and semistructured forms. Initially, the human world is depicted as a conversational reality in which interviewing takes a central position as a research method. Interviewing is presented as a social practice that has a cultural history and that today appears in ...
Qualitative interviewing is a foundational method in qualitative research and is widely used in health research and the social sciences. Both qualitative semi-structured and in-depth unstructured interviews use verbal communication, mostly in face-to-face interactions, to collect data about the attitudes, beliefs, and experiences of participants.
This chapter gives an introduction to qualitative interviewing in its unstructured and semistructured forms. Initially, the human world is depicted as a conversational reality in which interviewing takes a central position as a research method. Interviewing is presented as a social practice that has a cultural history and that appears in a ...
Unstructured interviews are an extremely useful method for developing an understanding of an as-of-yet not fully understood or appreciated culture, experience, or setting. Unstructured interviews allow researchers to focus the respondents' talk on a particular topic of interest, and may allow researchers the opportunity to test out his or her ...
Dive into the world of unstructured interviews. Explore methods and advantages. Best practices for open ended questions. Read more! Back to School Sale . Save 20% with Code: SCHOOL24 ... Of the three types of interviews in qualitative research, the unstructured interview is the most free-flowing. It provides the greatest flexibility in ...
Given Unstructured interviews in qualitative research involve asking relatively open-ended questions of research participants in order to discover their percepts on the topic of interest. Interviews, in general, are a foundational means of collecting data when using qualitative research methods. They are designed to draw from the interviewee ...
An overview of unstructured interviews for qualitative research, including protocols for, types, advantages, and disadvantages. Chapter 1: Protocols for Unstructured Interviews in Qualitative Research
Sage Research Methods Video: Qualitative and Mixed Methods - The Unstructured Interview. This visualization demonstrates how methods are related and connects users to relevant content. Find step-by-step guidance to complete your research project. Answer a handful of multiple-choice questions to see which statistical method is best for your data ...
What Is Qualitative Research? | Methods & Examples
use of the guide will make you an expert in qualitative research. We recommend that field staff read the Qualitative Research Methods Overview module, page 1, first, in order to gain a comprehensive understanding of the kind of information that qualitative research methods can obtain. However, the modules on specific methods may be read in any ...
Interviews and focus groups in qualitative research
The term qualitative research refers to a family of primarily non-numeric methods for describing, analyzing, and interpreting the lived experiences of people in their day to day lives.
An amalgamation of qualitative and quantitative research components award's holistic view of research process, in depth understanding with own philosophical assumptions and different methods of ...
Revised on 10 October 2022. An unstructured interview is a data collection method that relies on asking participants questions to collect data on a topic. Also known as non-directive interviewing, unstructured interviews do not have a set pattern and questions are not arranged in advance. In research, unstructured interviews are usually ...
Abstract. A class of unstructured decision making problems is under consideration. Unstructured problems are the problems with the majority of qualitative parameters with unknown quantitative dependencies. The peculiarities of these tasks are discussed, and requirements for decision aid tools are formulated: psychologically valid measurements ...
Background Ensuring diversity in clinical trials can be a challenge, which may be exacerbated when recruiting vulnerable populations, such as participants with mental health illness. As recruitment continues to be the major cause of trial delays, researchers are turning to online recruitment strategies, e.g. social media, to reach a wider population and reduce recruitment time and costs. There ...
The objective of this course is to introduce students to qualitative methods in research that have been used in Demography. The specific goals of the course are to: First, introduce students to theoretical aspects related to qualitative methods; Second, build an understanding on how qualitative methods answer research questions by learning how to design a qualitative study, how to collect and ...
If you're new to the world of quantitative data analysis and statistics, you've most likely run into the four horsemen of levels of measurement: nominal, ordinal, interval and ratio.And if you've landed here, you're probably a little confused or uncertain about them. Don't stress - in this post, we'll explain nominal, ordinal, interval and ratio levels of measurement in simple ...