how to find research question in article

• SpringerLink shop

Identifying your research question

Making informed decisions about what to study, and defining your research question, even within a predetermined field, is critical to a successful research career, and can be one of the hardest challenges for a scientist.

Being knowledgeable about the state of your field and up-to-date with recent developments can help you:

• Make decisions about  what to study within niche research areas
• Identify  top researchers  in your field whose work you can follow and potentially collaborate with
• Find  important journals to read regularly and publish in
• Explain to others  why your work is important by being able to recount the bigger picture

How can you identify a research question?

Reading regularly is the most common way of identifying a good research question. This enables you to keep up to date with recent advancements and identify certain issues or unsolved problems that keep appearing.

Begin by searching for and reading literature in your field. Start with  general interest  journals, but don’t limit yourself to journal publications only; you can also look for clues in the news or on research blogs. Once you have identified a few interesting topics, you should be reading the table of contents of journals and the abstracts of most articles in that subject area. Papers that are directly related to your research you should read in their entirety.

TIP Keep an eye out for  Review papers and special issues in your chosen subject area as they are very helpful in discovering new areas and hot topics.

TIP: you can sign up to receive table of contents or notifications when articles are published in your field from most journals or publishers.

TIP: Joining a journal club is a great way to read and dissect published papers in and around your subject area. Usually consisting of 5-10 people from the same research group or institute they meet to evaluate the good and bad points of the research presented in the paper. This not only helps you keep up to date with the field but helps you become familiar with what is necessary for a good paper which can help when you come to write your own.

If possible, communicate with some of the authors of these manuscripts via email or in person. Going to conferences if possible is a great way to meet some of these authors. Often,  talking with the author  of an important work in your research area will give you more ideas than just reading the manuscript would.

Back │ Next

Evaluating Information Sources

• Evaluate Your Sources
• Publication Types and Bias

Structure of Scientific Papers

Reading a scholarly article, additional reading tips, for more information.

• Reading Scholarly Articles
• Impact Factors and Citation Counts
• Predatory Publishing

Research papers generally follow a specific format. Here are the different parts of the scholarly article.

Abstract (Summary)

The abstract, generally written by the author(s) of the article, provides a concise summary of the whole article. Usually it highlights the focus, study results and conclusion(s) of the article. 

Introduction (Why)

In this section, the authors introduce their topic, explain the purpose of the study, and present why it is important, unique or how it adds to existing knowledge in their field. Look for the author's hypothesis or thesis here. 

Introduction - Literature Review (Who else)

Many scholarly articles include a summary of previous research or discussions published on this topic, called a "Literature Review".  This section outlines what others have found and what questions still remain.

Methodology  / Materials and Methods (How) 

Find the details of how the study was performed in this section. There should be enough specifics so that you could repeat the study if you wanted. 

Results   (What happened)

This section includes the findings from the study. Look for the data and statistical results in the form of tables, charts, and graphs. Some papers include an analysis here.

Discussion  / Analysis  (What it means)

This section should tell you what the authors felt was significant about their results. The authors analyze their data and describe what they believe it means.

Conclusion (What was learned)

Here the authors offer their final thoughts and conclusions and may include: how the study addressed their hypothesis, how it contributes to the field, the strengths and weaknesses of the study, and recommendations for future research. Some papers combine the discussion and conclusion.

A scholarly paper can be difficult to read. Instead of reading straight through, try focusing on the different sections and asking specific questions at each point.

What is your research question? 

When you select an article to read for a project or class, focus on your topic. Look for information in the article that is relevant to your research question. 

Read the abstract first  as it covers basics of the article. Questions to consider: 

• What is this article about? What is the working hypothesis or thesis?
• Is this related to my question or area of research?

Second: Read the introduction and discussion/conclusion.  These sections offer the main argument and hypothesis of the article. Questions to consider for the introduction: 

• What do we already know about this topic and what is left to discover?
• What have other people done in regards to this topic?
• How is this research unique?
• Will this tell me anything new related to my research question?

Questions for the discussion and conclusion: 

• What does the study mean and why is it important?
• What are the weaknesses in their argument?
• Is the conclusion valid?

Next: Read about the Methods/Methodology.  If what you've read addresses your research question, this should be your next section. Questions to consider:

• How did the author do the research? Is it a qualitative or quantitative project?
• What data are the study based on?
• Could I repeat their work? Is all the information present in order to repeat it?

Finally: Read the Results and Analysis.  Now read the details of this research. What did the researchers learn? If graphs and statistics are confusing, focus on the explanations around them. Questions to consider: 

• What did the author find and how did they find it?
• Are the results presented in a factual and unbiased way?
• Does their analysis agree with the data presented?
• Is all the data present?
• What conclusions do you formulate from this data? (And does it match with the Author's conclusions?)

Review the References (anytime): These give credit to other scientists and researchers and show you the basis the authors used to develop their research.  The list of references, or works cited, should include all of the materials the authors used in the article. The references list can be a good way to identify additional sources of information on the topic. Questions to ask:

• What other articles should I read?
• What other authors are respected in this field?
• What other research should I explore?

When you read these scholarly articles, remember that you will be writing based on what you read.

While you are Reading:

• Keep in mind your research question
• Focus on the information in the article relevant to your question (feel free to skim over other parts)
• Question everything you read - not everything is 100% true or performed effectively
• Think critically about what you read and seek to build your own arguments
• Read out of order! This isn't a mystery novel or movie, you want to start with the spoiler
• Use any keywords printed by the journals as further clues about the article
• Look up words you don't know

How to Take Notes on the Article

Try different ways, but use the one that fits you best. Below are some suggestions:

• Print the article and highlight, circle and otherwise mark while you read (for a PDF, you can use the highlight text  feature in Adobe Reader)
• Take notes on the sections, for example in the margins (Adobe Reader offers pop-up  sticky notes )
• Highlight only very important quotes or terms - or highlight potential quotes in a different color
• Summarize the main or key points

Reflect on what you have read - draw your own conclusions . As you read jot down questions that come to mind. These may be answered later on in the article or you may have found something that the authors did not consider. Here are a few questions that might be helpful:

• Have I taken time to understand all the terminology?
• Am I spending too much time on the less important parts of this article?
• Do I have any reason to question the credibility of this research?
• What specific problem does the research address and why is it important?
• How do these results relate to my research interests or to other works which I have read?
• Anatomy of a Scholarly Article (Interactive tutorial) Andreas Orphanides, North Carolina State University Libraries, 2009
• How to Read an Article in a Scholarly Journal (Research Guide) Cayuga Community College Library, 2016
• How To Read a Scholarly Journal Article (YouTube Video) Tim Lockman, Kishwaukee College Library, 2012.
• How To Read a Scientific Paper (Interactive tutorial) Michael Fosmire, Purdue University Libraries, 2013. PDF
• How to Read a Scientific Paper (Online article) Science Buddies, 2012
• How to Read a Scientific Research Paper (Article) Durbin Jr., C. G. Respiratory Care, 2009
• The Illusion of Certainty and the Certainty of Illusion: A Caution when Reading Scientific Articles (Article) T. A. Lang, International Journal of Occupational and Environmental Medicine, 2011,
• Infographic: How to Read Scientific Papers Natalia Rodriguez, Elsevier, 2015
• Library Research Methods: Read & Evaluate Culinary Institute of America Library, 2016
• << Previous: Publication Types and Bias
• Next: Impact Factors and Citation Counts >>
• Last Updated: Mar 8, 2024 1:17 PM
• URL: https://libguides.usc.edu/evaluate

Research Question 101 📖

Everything you need to know to write a high-quality research question

By: Derek Jansen (MBA) | Reviewed By: Dr. Eunice Rautenbach | October 2023

If you’ve landed on this page, you’re probably asking yourself, “ What is a research question? ”. Well, you’ve come to the right place. In this post, we’ll explain what a research question is , how it’s differen t from a research aim, and how to craft a high-quality research question that sets you up for success.

Research Question 101

What is a research question.

• Research questions vs research aims
• The 4 types of research questions
• How to write a research question
• Frequently asked questions
• Examples of research questions

As the name suggests, the research question is the core question (or set of questions) that your study will (attempt to) answer .

In many ways, a research question is akin to a target in archery . Without a clear target, you won’t know where to concentrate your efforts and focus. Essentially, your research question acts as the guiding light throughout your project and informs every choice you make along the way.

Let’s look at some examples:

What impact does social media usage have on the mental health of teenagers in New York?

How does the introduction of a minimum wage affect employment levels in small businesses in outer London?

How does the portrayal of women in 19th-century American literature reflect the societal attitudes of the time?

What are the long-term effects of intermittent fasting on heart health in adults?

As you can see in these examples, research questions are clear, specific questions that can be feasibly answered within a study. These are important attributes and we’ll discuss each of them in more detail a little later . If you’d like to see more examples of research questions, you can find our RQ mega-list here .

Research Questions vs Research Aims

At this point, you might be asking yourself, “ How is a research question different from a research aim? ”. Within any given study, the research aim and research question (or questions) are tightly intertwined , but they are separate things . Let’s unpack that a little.

A research aim is typically broader in nature and outlines what you hope to achieve with your research. It doesn’t ask a specific question but rather gives a summary of what you intend to explore.

The research question, on the other hand, is much more focused . It’s the specific query you’re setting out to answer. It narrows down the research aim into a detailed, researchable question that will guide your study’s methods and analysis.

Let’s look at an example:

Research Aim: To explore the effects of climate change on marine life in Southern Africa.

Research Question: How does ocean acidification caused by climate change affect the reproduction rates of coral reefs?

As you can see, the research aim gives you a general focus , while the research question details exactly what you want to find out.

Need a helping hand?

Types of research questions

Now that we’ve defined what a research question is, let’s look at the different types of research questions that you might come across. Broadly speaking, there are (at least) four different types of research questions – descriptive , comparative , relational , and explanatory . 

Descriptive questions ask what is happening. In other words, they seek to describe a phenomena or situation . An example of a descriptive research question could be something like “What types of exercise do high-performing UK executives engage in?”. This would likely be a bit too basic to form an interesting study, but as you can see, the research question is just focused on the what – in other words, it just describes the situation.

Comparative research questions , on the other hand, look to understand the way in which two or more things differ , or how they’re similar. An example of a comparative research question might be something like “How do exercise preferences vary between middle-aged men across three American cities?”. As you can see, this question seeks to compare the differences (or similarities) in behaviour between different groups.

Next up, we’ve got exploratory research questions , which ask why or how is something happening. While the other types of questions we looked at focused on the what, exploratory research questions are interested in the why and how . As an example, an exploratory research question might ask something like “Why have bee populations declined in Germany over the last 5 years?”. As you can, this question is aimed squarely at the why, rather than the what.

Last but not least, we have relational research questions . As the name suggests, these types of research questions seek to explore the relationships between variables . Here, an example could be something like “What is the relationship between X and Y” or “Does A have an impact on B”. As you can see, these types of research questions are interested in understanding how constructs or variables are connected , and perhaps, whether one thing causes another.

Of course, depending on how fine-grained you want to get, you can argue that there are many more types of research questions , but these four categories give you a broad idea of the different flavours that exist out there. It’s also worth pointing out that a research question doesn’t need to fit perfectly into one category – in many cases, a research question might overlap into more than just one category and that’s okay.

The key takeaway here is that research questions can take many different forms , and it’s useful to understand the nature of your research question so that you can align your research methodology accordingly.

How To Write A Research Question

As we alluded earlier, a well-crafted research question needs to possess very specific attributes, including focus , clarity and feasibility . But that’s not all – a rock-solid research question also needs to be rooted and aligned . Let’s look at each of these.

A strong research question typically has a single focus. So, don’t try to cram multiple questions into one research question; rather split them up into separate questions (or even subquestions), each with their own specific focus. As a rule of thumb, narrow beats broad when it comes to research questions.

Clear and specific

A good research question is clear and specific, not vague and broad. State clearly exactly what you want to find out so that any reader can quickly understand what you’re looking to achieve with your study. Along the same vein, try to avoid using bulky language and jargon – aim for clarity.

Unfortunately, even a super tantalising and thought-provoking research question has little value if you cannot feasibly answer it. So, think about the methodological implications of your research question while you’re crafting it. Most importantly, make sure that you know exactly what data you’ll need (primary or secondary) and how you’ll analyse that data.

A good research question (and a research topic, more broadly) should be rooted in a clear research gap and research problem . Without a well-defined research gap, you risk wasting your effort pursuing a question that’s already been adequately answered (and agreed upon) by the research community. A well-argued research gap lays at the heart of a valuable study, so make sure you have your gap clearly articulated and that your research question directly links to it.

As we mentioned earlier, your research aim and research question are (or at least, should be) tightly linked. So, make sure that your research question (or set of questions) aligns with your research aim . If not, you’ll need to revise one of the two to achieve this.

FAQ: Research Questions

Research question faqs, how many research questions should i have, what should i avoid when writing a research question, can a research question be a statement.

Typically, a research question is phrased as a question, not a statement. A question clearly indicates what you’re setting out to discover.

Can a research question be too broad or too narrow?

Yes. A question that’s too broad makes your research unfocused, while a question that’s too narrow limits the scope of your study.

Here’s an example of a research question that’s too broad:

“Why is mental health important?”

Conversely, here’s an example of a research question that’s likely too narrow:

“What is the impact of sleep deprivation on the exam scores of 19-year-old males in London studying maths at The Open University?”

Can I change my research question during the research process?

How do i know if my research question is good.

A good research question is focused, specific, practical, rooted in a research gap, and aligned with the research aim. If your question meets these criteria, it’s likely a strong question.

Is a research question similar to a hypothesis?

Not quite. A hypothesis is a testable statement that predicts an outcome, while a research question is a query that you’re trying to answer through your study. Naturally, there can be linkages between a study’s research questions and hypothesis, but they serve different functions.

How are research questions and research objectives related?

The research question is a focused and specific query that your study aims to answer. It’s the central issue you’re investigating. The research objective, on the other hand, outlines the steps you’ll take to answer your research question. Research objectives are often more action-oriented and can be broken down into smaller tasks that guide your research process. In a sense, they’re something of a roadmap that helps you answer your research question.

Need some inspiration?

If you’d like to see more examples of research questions, check out our research question mega list here .  Alternatively, if you’d like 1-on-1 help developing a high-quality research question, consider our private coaching service .

Psst... there’s more!

This post was based on one of our popular Research Bootcamps . If you're working on a research project, you'll definitely want to check this out ...

You Might Also Like:

Submit a Comment Cancel reply

Your email address will not be published. Required fields are marked *

Save my name, email, and website in this browser for the next time I comment.

• Print Friendly

• Help and information
• Comparative Politics
• Environmental Politics
• European Politics
• European Union
• Foreign Policy
• Human Rights and Politics
• International Political Economy
• International Relations
• Introduction to Politics
• Middle Eastern Politics
• Political Economy
• Political Institutions
• Political Methodology
• Political Philosophy
• Political Theory
• Politics of Development
• Security Studies
• UK Politics
• US Politics
• Share This Facebook LinkedIn Twitter

Political Research: Methods and Practical Skills (3rd edn)

• Guided Tour of the Online Resources
• 1. Political Research
• 2. Forms of Knowledge: Laws, Explanation, and Interpretation in the Study of the Social World
• 3. Objectivity and Values
• 4. Asking Questions: How to Find and Formulate Research Questions
• 5. Finding Answers: Theories and How to Apply Them
• 6. Research Design
• 7. What is Data?
• 8. Experimental Research
• 9. Comparative Research
• 10. Historical Research
• 11. Surveys
• 12. Interviewing and Focus Groups
• 13. Ethnography and Participant Observation
• 14. Textual Analysis*
• 15. Quantitative Analysis: Description and Inference
• 16. Patterns of Association: Bivariate Analysis
• 17. A Guide to Multivariate Analysis
• Finding and Citing Sources for Political Research

p. 93 4. Asking Questions: How to Find and Formulate Research Questions

• Sandra Halperin Sandra Halperin Professor of International Relations, Royal Holloway, University of London
•  and  Oliver Heath Oliver Heath Professor of Politics, Royal Holloway, University of London
• https://doi.org/10.1093/hepl/9780198820628.003.0004
• Published in print: 17 April 2020
• Published online: August 2020

This chapter deals with the first step of the research process: the formulation of a well-crafted research question. It explains why political research should begin with a research question and how a research question structures the research process. It discusses the difference between a topic or general question, on the one hand, and a focused research question, on the other. It also considers the question of where to find and how to formulate research questions, the various types of questions scholars ask, and the role of the ‘literature review’ as a source and rationale for research questions. Finally, it describes a tool called the ‘research vase’ that provides a visualization of the research process, along with different types of questions: descriptive, explanatory, predictive, prescriptive, and normative.

• research process
• research question
• political research
• literature review
• research vase
• descriptive question
• explanatory question
• predictive question
• prescriptive question
• normative question

You do not currently have access to this chapter

Please sign in to access the full content.

Access to the full content requires a subscription

Printed from Oxford Politics Trove. Under the terms of the licence agreement, an individual user may print out a single article for personal use (for details see Privacy Policy and Legal Notice).

date: 21 April 2024

• Cookie Policy
• Privacy Policy
• Legal Notice
• Accessibility
• [66.249.64.20|81.177.180.204]
• 81.177.180.204

Characters remaining 500 /500

• Affiliate Program

• UNITED STATES
• 台灣 (TAIWAN)
• TÜRKIYE (TURKEY)
• Academic Editing Services
• - Research Paper
• - Journal Manuscript
• - Dissertation
• - College & University Assignments
• Admissions Editing Services
• - Application Essay
• - Personal Statement
• - Recommendation Letter
• - Cover Letter
• - CV/Resume
• Business Editing Services
• - Business Documents
• - Report & Brochure
• - Website & Blog
• Writer Editing Services
• - Script & Screenplay
• Our Editors
• Client Reviews
• Editing & Proofreading Prices
• Wordvice Points
• Partner Discount
• Plagiarism Checker
• APA Citation Generator
• MLA Citation Generator
• Chicago Citation Generator
• Vancouver Citation Generator
• - APA Style
• - MLA Style
• - Chicago Style
• - Vancouver Style
• Writing & Editing Guide
• Academic Resources
• Admissions Resources

Where to Put the Research Question in a Paper

Silke Haidekker has a PhD in Pharmacology from the University of Hannover. She is a Clinical Research Associate in multiple pharmaceutical companies in Germany and the USA. She now works as a full-time medical translator and writer in a small town in Georgia.

Of Rats and Panic Attacks: A Doctoral Student’s Tale

You would probably agree that the time spent writing your PhD dissertation or thesis is not only a time of taking pride or even joy in what you do, but also a time riddled with panic attacks of different varieties and lengths. When I worked on my PhD thesis in pharmacology in Germany many years back, I had  my  first panic attack as I first learned how to kill rats for my experiments with a very ugly tool called a guillotine! After that part of the procedure, I was to remove and mash their livers, spike them with Ciclosporin A (an immunosuppressive agent), and then present the metabolites by high-pressure liquid chromatography.

Many rats later, I had another serious panic attack. It occurred at the moment my doctoral adviser told me to write my first research paper on the Ciclosporin A metabolites I had detected in hundreds of slimy mashes of rat liver. Sadly, this second panic attack led to a third one that was caused by living in the pre-internet era, when it was not as easy to access information about  how to write research papers .

How I got over writing my first research paper is now ancient history. But it was only years later, living in the USA and finally being immersed in the language of most scientific research papers, that my interest in the art of writing “good” research papers was sparked during conferences held by the  American Medical Writers Association , as well as by getting involved in different writing programs and academic self-study courses.

How to State the Research Question in the Introduction Section

Good writing begins with clearly stating your research question (or hypothesis) in the Introduction section —the focal point on which your entire paper builds and unfolds in the subsequent Methods, Results, and Discussion sections . This research question or hypothesis that goes into the first section of your research manuscript, the Introduction, explains at least three major elements:

a) What is  known  or believed about the research topic?

B) what is still  unknown  (or problematic), c) what is the  question or hypothesis  of your investigation.

Some medical writers refer to this organizational structure of the Introduction as a “funnel shape” because it starts broadly, with the bigger picture, and then follows one scientifically logical step after the other until finally narrowing down the story to the focal point of your research at the end of the funnel.

Let’s now look in greater detail at a research question example and how you can logically embed it into the Introduction to make it a powerful focal point and ignite the reader’s interest about the importance of your research:

a) The Known

You should start by giving your reader a brief overview of knowledge or previous studies already performed in the context of your research topic.

The topic of one of my research papers was “investigating the value of diabetes as an independent predictor of death in people with end-stage renal disease (ESRD).” So in the Introduction, I first presented the basic knowledge that diabetes is the leading cause of end-stage renal disease (ESRD) and thus made the reader better understand our interest in this specific study population. I then presented previous studies already showing that diabetes indeed seems to represent an independent risk factor for death in the general population. However, very few studies had been performed in the ESRD population and those only yielded controversial results.

Example :  “It seems well established that there is a link between diabetic nephropathy and hypertensive nephropathy and end-stage renal disease (ESRD) in Western countries. In 2014, 73% of patients in US hospitals had comorbid ESRD and type 2 diabetes (1, 2, 3)…”

b) The Unknown

In our example, this “controversy” flags the “unknown” or “problematic” and therefore provides strong reasons for why further research is justified. The unknown should be clearly stated or implied by using phrases such as “were controversial” (as in our example), “…has not been determined,” or “…is unclear.” By clearly stating what is “unknown,” you indicate that your research is new. This creates a smooth transition into your research question.

Example :  “However, previous studies have failed to isolate diabetes as an independent factor, and thus much remains unknown about specific risk factors associated with both diabetes and ESRD .”

c) The Research Question (Hypothesis)

Your research question is the question that inevitably evolves from the deficits or problems revealed in the “Unknown” and clearly states the goal of your research. It is important to describe your research question in just one or two short sentences, but very precisely and including all variables studied, if applicable. A transition should be used to mark the transition from the unknown to the research question using one word such as “therefore” or “accordingly,” or short phrases like “for this reason” or “considering this lack of crucial information.”

In our example, we stated the research question as follows:

Example :  “Therefore, the primary goal of our study was to perform a Kaplan-Meier survival study and to investigate, by means of the Cox proportional hazard model, the value of diabetes as an independent predictor of death in diabetic patients with ESRD.”

Note that the research question may include the  experimental approach  of the study used to answer the research question.

Another powerful way to introduce the research question is to  state the research question as a hypothesis  so that the reader can more easily anticipate the answer. In our case, the question could be put as follows:

Example :  “To test the hypothesis that diabetes is an independent predictor of death in people with ESRD, we performed a Kaplan-Survival study and investigated the value of diabetes by means of the Cox proportional hazard model.”

Note that this sentence leads with an introductory clause that indicates the hypothesis itself, transitioning well into a synopsis of the approach in the second half of the sentence.

The generic framework of the Introduction can be modified to include, for example,  two  research questions instead of just one. In such a case, both questions must follow inevitably from the previous statements, meaning that the background information leading to the second question cannot be omitted. Otherwise, the Introduction will get confusing, with the reader not knowing where that question comes from.

Begin with your research purpose in mind

To conclude, here is my simple but most important advice for you as a researcher preparing to write a scientific paper (or just the Introduction of a research paper) for the first time: Think your research question through precisely before trying to write it down; have in mind the reasons for exactly why you wanted to do this specific research, what exactly you wanted to find out, and how (by which methods) you did your investigation. If you have the answers to these questions in mind (or even better, create a comprehensive outline ) before starting the paper, the actual writing process will be a piece of cake and you will finish it “like a rat up a drainpipe”! And hopefully with no panic attacks.

Wordvice Resources

Before submitting your master’s thesis or PhD dissertation to academic journals for publication, be sure to receive proofreading services (including research paper editing , manuscript editing , thesis editing , and dissertation editing ) to ensure that your research writing is error-free. Impress your journal editor and get into the academic journal of your choice.    

Home » Northern Arizona University » Where Is The Research Question In A Research Paper?

Where Is The Research Question In A Research Paper?

Table of Contents

The research question, the objective or hypothesis of the study, helps to set up context for what you have researched and why you chose to study this particular topic. Therefore, it is included in the Introduction of the manuscript .

Where is research question located?

Good writing begins with clearly stating your research question (or hypothesis) in the Introduction section —the focal point on which your entire paper builds and unfolds in the subsequent Methods, Results, and Discussion sections.

What is a research question in a research paper?

What is a research question? A research question is the question around which you center your research . It should be: clear: it provides enough specifics that one’s audience can easily understand its purpose without needing additional explanation.

Where can I find research questions in thesis?

One or two declarative sentences (no questions). Generally placed at the end of the introduction; however, it can sometime be found at the end of the research or literature review section of more extensive papers .

Is the research question the title of the paper?

It should provide more information about your research and the main outcome that you have achieved. It is not advisable to have a question as the title of your paper as it is the first thing readers will see about your paper.

How do you find the research question and hypothesis in an article?

The first few paragraphs of a journal article serve to introduce the topic, to provide the author’s hypothesis or thesis, and to indicate why the research was done. A thesis or hypothesis is not always clearly labled; you may need to read through the introductory paragraphs to determine what the authors are proposing .

What are the parts of research paper?

There are eight main parts in a research paper:

• Title (cover page)
• Introduction.
• Literature review.
• Research methodology.
• Data analysis.
• Conclusion.
• Reference page.

How do you present a research question in a paper?

• Step 1: Introduce your topic. The first job of the introduction is to tell the reader what your topic is and why it’s interesting or important.
• Step 2: Describe the background.
• Step 3: Establish your research problem.
• Step 4: Specify your objective(s)
• Step 5: Map out your paper.

How do you introduce a research question in a paper example?

• 10 tips for writing an effective introduction to original research papers.
• Start broadly and then narrow down.
• State the aims and importance.
• Cite thoroughly but not excessively.
• Avoid giving too many citations for one point.
• Clearly state either your hypothesis or research question.
• Consider giving an overview of the paper.

Are research questions the same as hypothesis?

Both are aspects of the Scientific Method, but they are not identical . A research question is typically a concise, focused and debatable question that will provide a clear path for research. A hypothesis is a formal statement designed to predict the relationship between two or more variables.

What comes first thesis or research question?

Simply stated, a thesis statement is what your paper intends to prove or show. A research question is what you need to learn in order to come up with a good thesis statement. Instead of starting with a thesis statement, it’s better to start with a question , and there are a couple of reasons for that.

Where do research questions come from?

The research question emerges from the topic of interest, or more directly from the topic problem, and the methodology of choice . Its articulation is carefully crafted to establish both lenses.

Where does the problem statement go in a research paper?

A problem statement can be several paragraphs long and serve as the basis for your research proposal, or it can be condensed into just a few sentences in the introduction of your paper or thesis .

What’s a research question examples?

10 Research Question Examples to Guide your Research Project

• What effect does social media have on people’s minds?
• What effect does daily use of Twitter have on the attention span of under-16s?

Can a research paper start with a question?

This is your thesis. 3) Writing the paper. The paper should start with an introduction that states your question or puzzle , and your thesis. If you can’t state your thesis in one or at most two sentences, you probably do not have a clear answer/argument.

Can you ask questions in a research paper?

You can ask a question in an essay provided the question leads to an idea . The idea in this case should be the answer to the question you just asked. Don’t ask a question to which you don’t intend to give an answer. Instead of a direct rhetorical question in an essay, use a rhetorical statement.

Is research question in abstract?

For a research paper, an abstract typically answers these questions: Purpose: What is the nature of your topic/study and why did you do it? Methods: What did you do, and how? Results: What were your most important findings?

What is the title of Chapter 1 in research?

THE PROBLEM AND ITS BACKGROUND This chapter includes the introduction, theoretical framework, statement of the problem, hypothesis, scope and limitation, conceptual framework, significance of the study and the definition of terms used.

What chapter is hypothesis in research?

Chapter 4 -RESEARCH HYPOTHESIS AND DEFINING VARIABLES.

What are the 5 parts of a research paper?

5 parts of research paper

• Seeing Your Paper as a Whole Jrobles10-11.
• CHAPTER 1 THE PROBLEM AND ITS BACKGROUND • CHAPTER 2 REVIEW OF RELATED LITERATURE • CHAPTER 3 METHOD AND PROCEDURES • CHAPTER 4 PRESENTATION, ANALYSIS AND INTERPRETATION OF DATA • CHAPTER 5 SUMMARY, CONCLUSIONS AND RECOMMENDATIONS • Others.

What is the chapter 2 of a research paper?

A PRACTICAL GUIDE TO RESEARCH WRITING – CHAPTER TWO This is the chapter where you provide detailed explanation of previous researches that has been conducted on your topic of interest .

By Cary Hardy

Hi there! I'm Cary Hardy, an education expert and consultant. I've worked with students of all ages and backgrounds, and I love helping them unlock their full potential. I'm also a big believer in lifelong learning- there's always something new to learn!

I got my start in education as a teacher, working with students in grades K-12. After several years of teaching, I transitioned into the world of educational consulting. I've since worked with schools and districts all over the country, helping them improve their curriculums and instruction methods.

I'm passionate about helping people achieve their dreams, and I believe that education is the key to unlocking everyone's potential. Thanks for reading!

You might also like:

Does nau have frat houses, what is considered northern arizona, what is in northwestern arizona.

Numbers, Facts and Trends Shaping Your World

Read our research on:

Full Topic List

Regions & Countries

• Publications
• Our Methods
• Short Reads
• Tools & Resources

Read Our Research On:

Writing Survey Questions

Perhaps the most important part of the survey process is the creation of questions that accurately measure the opinions, experiences and behaviors of the public. Accurate random sampling will be wasted if the information gathered is built on a shaky foundation of ambiguous or biased questions. Creating good measures involves both writing good questions and organizing them to form the questionnaire.

Questionnaire design is a multistage process that requires attention to many details at once. Designing the questionnaire is complicated because surveys can ask about topics in varying degrees of detail, questions can be asked in different ways, and questions asked earlier in a survey may influence how people respond to later questions. Researchers are also often interested in measuring change over time and therefore must be attentive to how opinions or behaviors have been measured in prior surveys.

Surveyors may conduct pilot tests or focus groups in the early stages of questionnaire development in order to better understand how people think about an issue or comprehend a question. Pretesting a survey is an essential step in the questionnaire design process to evaluate how people respond to the overall questionnaire and specific questions, especially when questions are being introduced for the first time.

For many years, surveyors approached questionnaire design as an art, but substantial research over the past forty years has demonstrated that there is a lot of science involved in crafting a good survey questionnaire. Here, we discuss the pitfalls and best practices of designing questionnaires.

Question development

There are several steps involved in developing a survey questionnaire. The first is identifying what topics will be covered in the survey. For Pew Research Center surveys, this involves thinking about what is happening in our nation and the world and what will be relevant to the public, policymakers and the media. We also track opinion on a variety of issues over time so we often ensure that we update these trends on a regular basis to better understand whether people’s opinions are changing.

At Pew Research Center, questionnaire development is a collaborative and iterative process where staff meet to discuss drafts of the questionnaire several times over the course of its development. We frequently test new survey questions ahead of time through qualitative research methods such as  focus groups , cognitive interviews, pretesting (often using an  online, opt-in sample ), or a combination of these approaches. Researchers use insights from this testing to refine questions before they are asked in a production survey, such as on the ATP.

Measuring change over time

Many surveyors want to track changes over time in people’s attitudes, opinions and behaviors. To measure change, questions are asked at two or more points in time. A cross-sectional design surveys different people in the same population at multiple points in time. A panel, such as the ATP, surveys the same people over time. However, it is common for the set of people in survey panels to change over time as new panelists are added and some prior panelists drop out. Many of the questions in Pew Research Center surveys have been asked in prior polls. Asking the same questions at different points in time allows us to report on changes in the overall views of the general public (or a subset of the public, such as registered voters, men or Black Americans), or what we call “trending the data”.

When measuring change over time, it is important to use the same question wording and to be sensitive to where the question is asked in the questionnaire to maintain a similar context as when the question was asked previously (see  question wording  and  question order  for further information). All of our survey reports include a topline questionnaire that provides the exact question wording and sequencing, along with results from the current survey and previous surveys in which we asked the question.

The Center’s transition from conducting U.S. surveys by live telephone interviewing to an online panel (around 2014 to 2020) complicated some opinion trends, but not others. Opinion trends that ask about sensitive topics (e.g., personal finances or attending religious services ) or that elicited volunteered answers (e.g., “neither” or “don’t know”) over the phone tended to show larger differences than other trends when shifting from phone polls to the online ATP. The Center adopted several strategies for coping with changes to data trends that may be related to this change in methodology. If there is evidence suggesting that a change in a trend stems from switching from phone to online measurement, Center reports flag that possibility for readers to try to head off confusion or erroneous conclusions.

Open- and closed-ended questions

One of the most significant decisions that can affect how people answer questions is whether the question is posed as an open-ended question, where respondents provide a response in their own words, or a closed-ended question, where they are asked to choose from a list of answer choices.

For example, in a poll conducted after the 2008 presidential election, people responded very differently to two versions of the question: “What one issue mattered most to you in deciding how you voted for president?” One was closed-ended and the other open-ended. In the closed-ended version, respondents were provided five options and could volunteer an option not on the list.

When explicitly offered the economy as a response, more than half of respondents (58%) chose this answer; only 35% of those who responded to the open-ended version volunteered the economy. Moreover, among those asked the closed-ended version, fewer than one-in-ten (8%) provided a response other than the five they were read. By contrast, fully 43% of those asked the open-ended version provided a response not listed in the closed-ended version of the question. All of the other issues were chosen at least slightly more often when explicitly offered in the closed-ended version than in the open-ended version. (Also see  “High Marks for the Campaign, a High Bar for Obama”  for more information.)

Researchers will sometimes conduct a pilot study using open-ended questions to discover which answers are most common. They will then develop closed-ended questions based off that pilot study that include the most common responses as answer choices. In this way, the questions may better reflect what the public is thinking, how they view a particular issue, or bring certain issues to light that the researchers may not have been aware of.

When asking closed-ended questions, the choice of options provided, how each option is described, the number of response options offered, and the order in which options are read can all influence how people respond. One example of the impact of how categories are defined can be found in a Pew Research Center poll conducted in January 2002. When half of the sample was asked whether it was “more important for President Bush to focus on domestic policy or foreign policy,” 52% chose domestic policy while only 34% said foreign policy. When the category “foreign policy” was narrowed to a specific aspect – “the war on terrorism” – far more people chose it; only 33% chose domestic policy while 52% chose the war on terrorism.

In most circumstances, the number of answer choices should be kept to a relatively small number – just four or perhaps five at most – especially in telephone surveys. Psychological research indicates that people have a hard time keeping more than this number of choices in mind at one time. When the question is asking about an objective fact and/or demographics, such as the religious affiliation of the respondent, more categories can be used. In fact, they are encouraged to ensure inclusivity. For example, Pew Research Center’s standard religion questions include more than 12 different categories, beginning with the most common affiliations (Protestant and Catholic). Most respondents have no trouble with this question because they can expect to see their religious group within that list in a self-administered survey.

In addition to the number and choice of response options offered, the order of answer categories can influence how people respond to closed-ended questions. Research suggests that in telephone surveys respondents more frequently choose items heard later in a list (a “recency effect”), and in self-administered surveys, they tend to choose items at the top of the list (a “primacy” effect).

Because of concerns about the effects of category order on responses to closed-ended questions, many sets of response options in Pew Research Center’s surveys are programmed to be randomized to ensure that the options are not asked in the same order for each respondent. Rotating or randomizing means that questions or items in a list are not asked in the same order to each respondent. Answers to questions are sometimes affected by questions that precede them. By presenting questions in a different order to each respondent, we ensure that each question gets asked in the same context as every other question the same number of times (e.g., first, last or any position in between). This does not eliminate the potential impact of previous questions on the current question, but it does ensure that this bias is spread randomly across all of the questions or items in the list. For instance, in the example discussed above about what issue mattered most in people’s vote, the order of the five issues in the closed-ended version of the question was randomized so that no one issue appeared early or late in the list for all respondents. Randomization of response items does not eliminate order effects, but it does ensure that this type of bias is spread randomly.

Questions with ordinal response categories – those with an underlying order (e.g., excellent, good, only fair, poor OR very favorable, mostly favorable, mostly unfavorable, very unfavorable) – are generally not randomized because the order of the categories conveys important information to help respondents answer the question. Generally, these types of scales should be presented in order so respondents can easily place their responses along the continuum, but the order can be reversed for some respondents. For example, in one of Pew Research Center’s questions about abortion, half of the sample is asked whether abortion should be “legal in all cases, legal in most cases, illegal in most cases, illegal in all cases,” while the other half of the sample is asked the same question with the response categories read in reverse order, starting with “illegal in all cases.” Again, reversing the order does not eliminate the recency effect but distributes it randomly across the population.

Question wording

The choice of words and phrases in a question is critical in expressing the meaning and intent of the question to the respondent and ensuring that all respondents interpret the question the same way. Even small wording differences can substantially affect the answers people provide.

[View more Methods 101 Videos ]

An example of a wording difference that had a significant impact on responses comes from a January 2003 Pew Research Center survey. When people were asked whether they would “favor or oppose taking military action in Iraq to end Saddam Hussein’s rule,” 68% said they favored military action while 25% said they opposed military action. However, when asked whether they would “favor or oppose taking military action in Iraq to end Saddam Hussein’s rule  even if it meant that U.S. forces might suffer thousands of casualties, ” responses were dramatically different; only 43% said they favored military action, while 48% said they opposed it. The introduction of U.S. casualties altered the context of the question and influenced whether people favored or opposed military action in Iraq.

There has been a substantial amount of research to gauge the impact of different ways of asking questions and how to minimize differences in the way respondents interpret what is being asked. The issues related to question wording are more numerous than can be treated adequately in this short space, but below are a few of the important things to consider:

First, it is important to ask questions that are clear and specific and that each respondent will be able to answer. If a question is open-ended, it should be evident to respondents that they can answer in their own words and what type of response they should provide (an issue or problem, a month, number of days, etc.). Closed-ended questions should include all reasonable responses (i.e., the list of options is exhaustive) and the response categories should not overlap (i.e., response options should be mutually exclusive). Further, it is important to discern when it is best to use forced-choice close-ended questions (often denoted with a radio button in online surveys) versus “select-all-that-apply” lists (or check-all boxes). A 2019 Center study found that forced-choice questions tend to yield more accurate responses, especially for sensitive questions.  Based on that research, the Center generally avoids using select-all-that-apply questions.

It is also important to ask only one question at a time. Questions that ask respondents to evaluate more than one concept (known as double-barreled questions) – such as “How much confidence do you have in President Obama to handle domestic and foreign policy?” – are difficult for respondents to answer and often lead to responses that are difficult to interpret. In this example, it would be more effective to ask two separate questions, one about domestic policy and another about foreign policy.

In general, questions that use simple and concrete language are more easily understood by respondents. It is especially important to consider the education level of the survey population when thinking about how easy it will be for respondents to interpret and answer a question. Double negatives (e.g., do you favor or oppose  not  allowing gays and lesbians to legally marry) or unfamiliar abbreviations or jargon (e.g., ANWR instead of Arctic National Wildlife Refuge) can result in respondent confusion and should be avoided.

Similarly, it is important to consider whether certain words may be viewed as biased or potentially offensive to some respondents, as well as the emotional reaction that some words may provoke. For example, in a 2005 Pew Research Center survey, 51% of respondents said they favored “making it legal for doctors to give terminally ill patients the means to end their lives,” but only 44% said they favored “making it legal for doctors to assist terminally ill patients in committing suicide.” Although both versions of the question are asking about the same thing, the reaction of respondents was different. In another example, respondents have reacted differently to questions using the word “welfare” as opposed to the more generic “assistance to the poor.” Several experiments have shown that there is much greater public support for expanding “assistance to the poor” than for expanding “welfare.”

We often write two versions of a question and ask half of the survey sample one version of the question and the other half the second version. Thus, we say we have two  forms  of the questionnaire. Respondents are assigned randomly to receive either form, so we can assume that the two groups of respondents are essentially identical. On questions where two versions are used, significant differences in the answers between the two forms tell us that the difference is a result of the way we worded the two versions.

One of the most common formats used in survey questions is the “agree-disagree” format. In this type of question, respondents are asked whether they agree or disagree with a particular statement. Research has shown that, compared with the better educated and better informed, less educated and less informed respondents have a greater tendency to agree with such statements. This is sometimes called an “acquiescence bias” (since some kinds of respondents are more likely to acquiesce to the assertion than are others). This behavior is even more pronounced when there’s an interviewer present, rather than when the survey is self-administered. A better practice is to offer respondents a choice between alternative statements. A Pew Research Center experiment with one of its routinely asked values questions illustrates the difference that question format can make. Not only does the forced choice format yield a very different result overall from the agree-disagree format, but the pattern of answers between respondents with more or less formal education also tends to be very different.

One other challenge in developing questionnaires is what is called “social desirability bias.” People have a natural tendency to want to be accepted and liked, and this may lead people to provide inaccurate answers to questions that deal with sensitive subjects. Research has shown that respondents understate alcohol and drug use, tax evasion and racial bias. They also may overstate church attendance, charitable contributions and the likelihood that they will vote in an election. Researchers attempt to account for this potential bias in crafting questions about these topics. For instance, when Pew Research Center surveys ask about past voting behavior, it is important to note that circumstances may have prevented the respondent from voting: “In the 2012 presidential election between Barack Obama and Mitt Romney, did things come up that kept you from voting, or did you happen to vote?” The choice of response options can also make it easier for people to be honest. For example, a question about church attendance might include three of six response options that indicate infrequent attendance. Research has also shown that social desirability bias can be greater when an interviewer is present (e.g., telephone and face-to-face surveys) than when respondents complete the survey themselves (e.g., paper and web surveys).

Lastly, because slight modifications in question wording can affect responses, identical question wording should be used when the intention is to compare results to those from earlier surveys. Similarly, because question wording and responses can vary based on the mode used to survey respondents, researchers should carefully evaluate the likely effects on trend measurements if a different survey mode will be used to assess change in opinion over time.

Question order

Once the survey questions are developed, particular attention should be paid to how they are ordered in the questionnaire. Surveyors must be attentive to how questions early in a questionnaire may have unintended effects on how respondents answer subsequent questions. Researchers have demonstrated that the order in which questions are asked can influence how people respond; earlier questions can unintentionally provide context for the questions that follow (these effects are called “order effects”).

One kind of order effect can be seen in responses to open-ended questions. Pew Research Center surveys generally ask open-ended questions about national problems, opinions about leaders and similar topics near the beginning of the questionnaire. If closed-ended questions that relate to the topic are placed before the open-ended question, respondents are much more likely to mention concepts or considerations raised in those earlier questions when responding to the open-ended question.

For closed-ended opinion questions, there are two main types of order effects: contrast effects ( where the order results in greater differences in responses), and assimilation effects (where responses are more similar as a result of their order).

An example of a contrast effect can be seen in a Pew Research Center poll conducted in October 2003, a dozen years before same-sex marriage was legalized in the U.S. That poll found that people were more likely to favor allowing gays and lesbians to enter into legal agreements that give them the same rights as married couples when this question was asked after one about whether they favored or opposed allowing gays and lesbians to marry (45% favored legal agreements when asked after the marriage question, but 37% favored legal agreements without the immediate preceding context of a question about same-sex marriage). Responses to the question about same-sex marriage, meanwhile, were not significantly affected by its placement before or after the legal agreements question.

Another experiment embedded in a December 2008 Pew Research Center poll also resulted in a contrast effect. When people were asked “All in all, are you satisfied or dissatisfied with the way things are going in this country today?” immediately after having been asked “Do you approve or disapprove of the way George W. Bush is handling his job as president?”; 88% said they were dissatisfied, compared with only 78% without the context of the prior question.

Responses to presidential approval remained relatively unchanged whether national satisfaction was asked before or after it. A similar finding occurred in December 2004 when both satisfaction and presidential approval were much higher (57% were dissatisfied when Bush approval was asked first vs. 51% when general satisfaction was asked first).

Several studies also have shown that asking a more specific question before a more general question (e.g., asking about happiness with one’s marriage before asking about one’s overall happiness) can result in a contrast effect. Although some exceptions have been found, people tend to avoid redundancy by excluding the more specific question from the general rating.

Assimilation effects occur when responses to two questions are more consistent or closer together because of their placement in the questionnaire. We found an example of an assimilation effect in a Pew Research Center poll conducted in November 2008 when we asked whether Republican leaders should work with Obama or stand up to him on important issues and whether Democratic leaders should work with Republican leaders or stand up to them on important issues. People were more likely to say that Republican leaders should work with Obama when the question was preceded by the one asking what Democratic leaders should do in working with Republican leaders (81% vs. 66%). However, when people were first asked about Republican leaders working with Obama, fewer said that Democratic leaders should work with Republican leaders (71% vs. 82%).

The order questions are asked is of particular importance when tracking trends over time. As a result, care should be taken to ensure that the context is similar each time a question is asked. Modifying the context of the question could call into question any observed changes over time (see  measuring change over time  for more information).

A questionnaire, like a conversation, should be grouped by topic and unfold in a logical order. It is often helpful to begin the survey with simple questions that respondents will find interesting and engaging. Throughout the survey, an effort should be made to keep the survey interesting and not overburden respondents with several difficult questions right after one another. Demographic questions such as income, education or age should not be asked near the beginning of a survey unless they are needed to determine eligibility for the survey or for routing respondents through particular sections of the questionnaire. Even then, it is best to precede such items with more interesting and engaging questions. One virtue of survey panels like the ATP is that demographic questions usually only need to be asked once a year, not in each survey.

U.S. Surveys

Other research methods, sign up for our weekly newsletter.

Fresh data delivered Saturday mornings

1615 L St. NW, Suite 800 Washington, DC 20036 USA (+1) 202-419-4300 | Main (+1) 202-857-8562 | Fax (+1) 202-419-4372 |  Media Inquiries

Research Topics

• Age & Generations
• Coronavirus (COVID-19)
• Economy & Work
• Family & Relationships
• Gender & LGBTQ
• Immigration & Migration
• International Affairs
• Internet & Technology
• Methodological Research
• News Habits & Media
• Non-U.S. Governments
• Other Topics
• Politics & Policy
• Race & Ethnicity
• Email Newsletters

ABOUT PEW RESEARCH CENTER  Pew Research Center is a nonpartisan fact tank that informs the public about the issues, attitudes and trends shaping the world. It conducts public opinion polling, demographic research, media content analysis and other empirical social science research. Pew Research Center does not take policy positions. It is a subsidiary of  The Pew Charitable Trusts .

Copyright 2024 Pew Research Center

Terms & Conditions

Privacy Policy

Cookie Settings

Reprints, Permissions & Use Policy

Connect with an agent

A realtor.com coordinator will connect you with a local agent in minutes.

A local real estate agent can answer questions, give guidance, and schedule home tours.

By proceeding, you consent to receive calls and texts at the number you provided, including marketing by autodialer and prerecorded and artificial voice, and email, from Realtor.com and others Persons who may contact you include real estate professionals such as agents and brokers, mortgage professionals such as lenders and mortgage brokers, realtor.com and its affiliates, insurers or their agents, and those who may be assisting any of the foregoing. about your inquiry and other home-related matters, but not as a condition of any purchase. More You also agree to our Terms of Use, and to our Privacy Policy regarding the information relating to you. Msg/data rates may apply. This consent applies even if you are on a corporate, state or national Do Not Call list.

A Realtor.com coordinator will call you shortly

What’s next.

• A coordinator will ask a few questions about your home buying or selling needs.
• You’ll be introduced to an agent from our real estate professional network.

To connect right away, call (855) 650-5492

( Getty Images )

How to Find a Real Estate Agent: Where to Look and What to Ask

Before putting your home on the market or setting out to buy a new one, you should identify real estate agents in your community who can assist with the sale. More than two million people nationwide have licenses to sell real estate , and it’s their job to be an expert on the properties in their community. They track real estate trends and are in the business of helping others buy and sell homes. If you’re in the market for a new home, it’s wise to know how to find a real estate agent.

Whether you’re a first-time seller or someone who is looking to buy your first home, there are several ways to find a local real estate agent:

• Use realtor.com’s how to find a real estate agent  tool to locate individuals who are active in your community.
• Get recommendations from friends and family members who have bought or sold their properties recently.
• Look for real estate agent signs in your community.
• Attend open houses and see if you connect with a real estate agent.
• Call your neighborhood real estate brokerages.

How to find a real estate agent: Ask these important questions

There are a number of questions you will want to ask a real estate agent before they start helping you with your home search:

1. What services do you offer?

Buyers and sellers have different needs, and certain real estate agents might specialize in selling over buying and vice versa.

2. What type of representation do you provide?

There are various forms of representation in different states. Some brokers represent buyers, some represent sellers, some facilitate transactions as a neutral party, and in some cases different salespeople in a single firm may represent different parties within a transaction.

3. What experience do you have in my immediate area?

Find out their success rate with buying and selling in your area.

4. How long are homes in this neighborhood typically on the market?

Be aware that because all homes are unique, some will sell faster than others. Several factors can impact the amount of time a home remains on the market, including list price, changing interest rates and local economic trends.

5. How would you price my home?

Ask about recent home sales and comparable properties currently on the market. If you speak with several real estate agents and their price estimates differ, that’s alright—but be sure to ask how their price opinions were determined and why they think your home would sell for a given value. Request a written Comparative Market Analysis (CMA) as well.

6. How will you market my home?

At listing presentations, brokers will provide a detailed summary of how they market homes, what marketing strategies have worked in the past and which marketing efforts may be effective for your home.

7. What is your fee?

Brokerage fees are established in the marketplace and not set by law or regulation. The commission is the agent’s rate for handling your transaction. Ask if there are other fees you will have to pay such as an early cancellation fee, marketing fee, MLS fee, or any other cost that isn’t included in the commission rate.

8. What disclosures should you (the consumer) receive?

State rules require brokers to provide extensive agency disclosure information, usually at the first sit-down meeting with an owner or buyer.

What to expect when working with a real estate agent

Once your home is listed with a real estate agent, they will immediately begin to market your home according to the most appropriate conventions for your community. A real estate agent keeps you informed as the marketing process unfolds and as expressions of interest are received.

Be sure to specify how you’d prefer to communicate. Some clients prefer email or texts. while others only want to be called or have in-person meetings. Whatever your preference, it’s best to outline those expectations upfront so everyone is working with clearly-defined objectives.

The same holds true for buyers. Because buyers are constantly meeting with their agent to see properties and give feedback on the properties they’ve already seen, communication is important. If you like to communicate via text message, let your agent know. All forms of communication are not acceptable to everyone. Make sure you have an agent who communicates with you in a way you find acceptable.

Every client should expect professionalism. That means a real estate agent will always expect you to be on-time, and you should expect the same from a real estate agent.

Remember, the real estate agent is your advocate in the transaction, whether you are buying or selling. Once you have signed up with an agent to represent you, he or she is your face, your voice, and your defense against all involved in the multi-layered home buying or home selling process.

Natalie Way covers news and advice stories about unique real estate, interior design, and celebrity homes. Natalie is the co-founder and co-host of Realtor.com's critically acclaimed podcast, "House Party." She can be reached at [email protected].

• Related Articles

Share this Article

An official website of the United States government

The .gov means it’s official. Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

The site is secure. The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

• Publications
• Account settings

Preview improvements coming to the PMC website in October 2024. Learn More or Try it out now .

• Advanced Search
• Journal List
• J Med Libr Assoc
• v.106(4); 2018 Oct

A systematic approach to searching: an efficient and complete method to develop literature searches

Associated data.

Creating search strategies for systematic reviews, finding the best balance between sensitivity and specificity, and translating search strategies between databases is challenging. Several methods describe standards for systematic search strategies, but a consistent approach for creating an exhaustive search strategy has not yet been fully described in enough detail to be fully replicable. The authors have established a method that describes step by step the process of developing a systematic search strategy as needed in the systematic review. This method describes how single-line search strategies can be prepared in a text document by typing search syntax (such as field codes, parentheses, and Boolean operators) before copying and pasting search terms (keywords and free-text synonyms) that are found in the thesaurus. To help ensure term completeness, we developed a novel optimization technique that is mainly based on comparing the results retrieved by thesaurus terms with those retrieved by the free-text search words to identify potentially relevant candidate search terms. Macros in Microsoft Word have been developed to convert syntaxes between databases and interfaces almost automatically. This method helps information specialists in developing librarian-mediated searches for systematic reviews as well as medical and health care practitioners who are searching for evidence to answer clinical questions. The described method can be used to create complex and comprehensive search strategies for different databases and interfaces, such as those that are needed when searching for relevant references for systematic reviews, and will assist both information specialists and practitioners when they are searching the biomedical literature.

INTRODUCTION

Librarians and information specialists are often involved in the process of preparing and completing systematic reviews (SRs), where one of their main tasks is to identify relevant references to include in the review [ 1 ]. Although several recommendations for the process of searching have been published [ 2 – 6 ], none describe the development of a systematic search strategy from start to finish.

Traditional methods of SR search strategy development and execution are highly time consuming, reportedly requiring up to 100 hours or more [ 7 , 8 ]. The authors wanted to develop systematic and exhaustive search strategies more efficiently, while preserving the high sensitivity that SR search strategies necessitate. In this article, we describe the method developed at Erasmus University Medical Center (MC) and demonstrate its use through an example search. The efficiency of the search method and outcome of 73 searches that have resulted in published reviews are described in a separate article [ 9 ].

As we aimed to describe the creation of systematic searches in full detail, the method starts at a basic level with the analysis of the research question and the creation of search terms. Readers who are new to SR searching are advised to follow all steps described. More experienced searchers can consider the basic steps to be existing knowledge that will already be part of their normal workflow, although step 4 probably differs from general practice. Experienced searchers will gain the most from reading about the novelties in the method as described in steps 10–13 and comparing the examples given in the supplementary appendix to their own practice.

CREATING A SYSTEMATIC SEARCH STRATEGY

Our methodology for planning and creating a multi-database search strategy consists of the following steps:

• Determine a clear and focused question
• Describe the articles that can answer the question
• Decide which key concepts address the different elements of the question
• Decide which elements should be used for the best results
• Choose an appropriate database and interface to start with
• Document the search process in a text document
• Identify appropriate index terms in the thesaurus of the first database
• Identify synonyms in the thesaurus
• Add variations in search terms
• Use database-appropriate syntax, with parentheses, Boolean operators, and field codes
• Optimize the search
• Evaluate the initial results
• Check for errors
• Translate to other databases
• Test and reiterate

Each step in the process is reflected by an example search described in the supplementary appendix .

1. Determine a clear and focused question

A systematic search can best be applied to a well-defined and precise research or clinical question. Questions that are too broad or too vague cannot be answered easily in a systematic way and will generally result in an overwhelming number of search results. On the other hand, a question that is too specific will result into too few or even zero search results. Various papers describe this process in more detail [ 10 – 12 ].

2. Describe the articles that can answer the question

Although not all clinical or research questions can be answered in the literature, the next step is to presume that the answer can indeed be found in published studies. A good starting point for a search is hypothesizing what the research that can answer the question would look like. These hypothetical (when possible, combined with known) articles can be used as guidance for constructing the search strategy.

3. Decide which key concepts address the different elements of the question

Key concepts are the topics or components that the desired articles should address, such as diseases or conditions, actions, substances, settings, domains (e.g., therapy, diagnosis, etiology), or study types. Key concepts from the research question can be grouped to create elements in the search strategy.

Elements in a search strategy do not necessarily follow the patient, intervention, comparison, outcome (PICO) structure or any other related structure. Using the PICO or another similar framework as guidance can be helpful to consider, especially in the inclusion and exclusion review stage of the SR, but this is not necessary for good search strategy development [ 13 – 15 ]. Sometimes concepts from different parts of the PICO structure can be grouped together into one search element, such as when the desired outcome is frequently described in a certain study type.

4. Decide which elements should be used for the best results

Not all elements of a research question should necessarily be used in the search strategy. Some elements are less important than others or may unnecessarily complicate or restrict a search strategy. Adding an element to a search strategy increases the chance of missing relevant references. Therefore, the number of elements in a search strategy should remain as low as possible to optimize recall.

Using the schema in Figure 1 , elements can be ordered by their specificity and importance to determine the best search approach. Whether an element is more specific or more general can be measured objectively by the number of hits retrieved in a database when searching for a key term representing that element. Depending on the research question, certain elements are more important than others. If articles (hypothetically or known) exist that can answer the question but lack a certain element in their titles, abstracts, or keywords, that element is unimportant to the question. An element can also be unimportant because of expected bias or an overlap with another element.

Schema for determining the optimal order of elements

Bias in elements

The choice of elements in a search strategy can introduce bias through use of overly specific terminology or terms often associated with positive outcomes. For the question “does prolonged breastfeeding improve intelligence outcomes in children?,” searching specifically for the element of duration will introduce bias, as articles that find a positive effect of prolonged breastfeeding will be much more likely to mention time factors in their titles or abstracts.

Overlapping elements

Elements in a question sometimes overlap in their meaning. Sometimes certain therapies are interventions for one specific disease. The Lichtenstein technique, for example, is a repair method for inguinal hernias. There is no need to include an element of “inguinal hernias” to a search for the effectiveness of the Lichtenstein therapy. Likewise, sometimes certain diseases are only found in certain populations. Adding such an overlapping element could lead to missing relevant references.

The elements to use in a search strategy can be found in the plot of elements in Figure 1 , by following the top row from left to right. For this method, we recommend starting with the most important and specific elements. Then, continue with more general and important elements until the number of results is acceptable for screening. Determining how many results are acceptable for screening is often a matter of negotiation with the SR team.

5. Choose an appropriate database and interface to start with

Important factors for choosing databases to use are the coverage and the presence of a thesaurus. For medically oriented searches, the coverage and recall of Embase, which includes the MEDLINE database, are superior to those of MEDLINE [ 16 ]. Each of these two databases has its own thesaurus with its own unique definitions and structure. Because of the complexity of the Embase thesaurus, Emtree, which contains much more specific thesaurus terms than the MEDLINE Medical Subject Headings (MeSH) thesaurus, translation from Emtree to MeSH is easier than the other way around. Therefore, we recommend starting in Embase.

MEDLINE and Embase are available through many different vendors and interfaces. The choice of an interface and primary database is often determined by the searcher’s accessibility. For our method, an interface that allows searching with proximity operators is desirable, and full functionality of the thesaurus, including explosion of narrower terms, is crucial. We recommend developing a personal workflow that always starts with one specific database and interface.

6. Document the search process in a text document

We advise designing and creating the complete search strategies in a log document, instead of directly in the database itself, to register the steps taken and to make searches accountable and reproducible. The developed search strategies can be copied and pasted into the desired databases from the log document. This way, the searcher is in control of the whole process. Any change to the search strategy should be done in the log document, assuring that the search strategy in the log is always the most recent.

7. Identify appropriate index terms in the thesaurus of the first database

Searches should start by identifying appropriate thesaurus terms for the desired elements. The thesaurus of the database is searched for matching index terms for each key concept. We advise restricting the initial terms to the most important and most relevant terms. Later in the process, more general terms can be added in the optimization process, in which the effect on the number of hits, and thus the desirability of adding these terms, can be evaluated more easily.

Several factors can complicate the identification of thesaurus terms. Sometimes, one thesaurus term is found that exactly describes a specific element. In contrast, especially in more general elements, multiple thesaurus terms can be found to describe one element. If no relevant thesaurus terms have been found for an element, free-text terms can be used, and possible thesaurus terms found in the resulting references can be added later (step 11).

Sometimes, no distinct thesaurus term is available for a specific key concept that describes the concept in enough detail. In Emtree, one thesaurus term often combines two or more elements. The easiest solution for combining these terms for a sensitive search is to use such a thesaurus term in all elements where it is relevant. Examples are given in the supplementary appendix .

8. Identify synonyms in the thesaurus

Most thesauri offer a list of synonyms on their term details page (named Synonyms in Emtree and Entry Terms in MeSH). To create a sensitive search strategy for SRs, these terms need to be searched as free-text keywords in the title and abstract fields, in addition to searching their associated thesaurus terms.

The Emtree thesaurus contains more synonyms (300,000) than MeSH does (220,000) [ 17 ]. The difference in number of terms is even higher considering that many synonyms in MeSH are permuted terms (i.e., inversions of phrases using commas).

Thesaurus terms are ordered in a tree structure. When searching for a more general thesaurus term, the more specific (narrower) terms in the branches below that term will also be searched (this is frequently referred to as “exploding” a thesaurus term). However, to perform a sensitive search, all relevant variations of the narrower terms must be searched as free-text keywords in the title or abstract, in addition to relying on the exploded thesaurus term. Thus, all articles that describe a certain narrower topic in their titles and abstracts will already be retrieved before MeSH terms are added.

9. Add variations in search terms (e.g., truncation, spelling differences, abbreviations, opposites)

Truncation allows a searcher to search for words beginning with the same word stem. A search for therap* will, thus, retrieve therapy, therapies, therapeutic, and all other words starting with “therap.” Do not truncate a word stem that is too short. Also, limitations of interfaces should be taken into account, especially in PubMed, where the number of search term variations that can be found by truncation is limited to 600.

Databases contain references to articles using both standard British and American English spellings. Both need to be searched as free-text terms in the title and abstract. Alternatively, many interfaces offer a certain code to replace zero or one characters, allowing a search for “pediatric” or “paediatric” as “p?ediatric.” Table 1 provides a detailed description of the syntax for different interfaces.

Field codes in five most used interfaces for biomedical literature searching

Searching for abbreviations can identify extra, relevant references and retrieve more irrelevant ones. The search can be more focused by combining the abbreviation with an important word that is relevant to its meaning or by using the Boolean “NOT” to exclude frequently observed, clearly irrelevant results. We advise that searchers do not exclude all possible irrelevant meanings, as it is very time consuming to identify all the variations, it will result in unnecessarily complicated search strategies, and it may lead to erroneously narrowing the search and, thereby, reduce recall.

Searching partial abbreviations can be useful for retrieving relevant references. For example, it is very likely that an article would mention osteoarthritis (OA) early in the abstract, replacing all further occurrences of osteoarthritis with OA . Therefore, it may not contain the phrase “hip osteoarthritis” but only “hip oa.”

It is also important to search for the opposites of search terms to avoid bias. When searching for “disease recurrence,” articles about “disease free” may be relevant as well. When the desired outcome is survival , articles about mortality may be relevant.

10. Use database-appropriate syntax, with parentheses, Boolean operators, and field codes

Different interfaces require different syntaxes, the special set of rules and symbols unique to each database that define how a correctly constructed search operates. Common syntax components include the use of parentheses and Boolean operators such as “AND,” “OR,” and “NOT,” which are available in all major interfaces. An overview of different syntaxes for four major interfaces for bibliographic medical databases (PubMed, Ovid, EBSCOhost, Embase.com, and ProQuest) is shown in Table 1 .

Creating the appropriate syntax for each database, in combination with the selected terms as described in steps 7–9, can be challenging. Following the method outlined below simplifies the process:

• Create single-line queries in a text document (not combining multiple record sets), which allows immediate checking of the relevance of retrieved references and efficient optimization.
• Type the syntax (Boolean operators, parentheses, and field codes) before adding terms, which reduces the chance that errors are made in the syntax, especially in the number of parentheses.
• Use predefined proximity structures including parentheses, such as (() ADJ3 ()) in Ovid, that can be reused in the query when necessary.
• Use thesaurus terms separately from free-text terms of each element. Start an element with all thesaurus terms (using “OR”) and follow with the free-text terms. This allows the unique optimization methods as described in step 11.
• When adding terms to an existing search strategy, pay close attention to the position of the cursor. Make sure to place it appropriately either in the thesaurus terms section, in the title/abstract section, or as an addition (broadening) to an existing proximity search.

The supplementary appendix explains the method of building a query in more detail, step by step for different interfaces: PubMed, Ovid, EBSCOhost, Embase.com, and ProQuest. This method results in a basic search strategy designed to retrieve some relevant references upon which a more thorough search strategy can be built with optimization such as described in step 11.

11. Optimize the search

The most important question when performing a systematic search is whether all (or most) potentially relevant articles have been retrieved by the search strategy. This is also the most difficult question to answer, since it is unknown which and how many articles are relevant. It is, therefore, wise first to broaden the initial search strategy, making the search more sensitive, and then check if new relevant articles are found by comparing the set results (i.e., search for Strategy #2 NOT Strategy #1 to see the unique results).

A search strategy should be tested for completeness. Therefore, it is necessary to identify extra, possibly relevant search terms and add them to the test search in an OR relationship with the already used search terms. A good place to start, and a well-known strategy, is scanning the top retrieved articles when sorted by relevance, looking for additional relevant synonyms that could be added to the search strategy.

We have developed a unique optimization method that has not been described before in the literature. This method often adds valuable extra terms to our search strategy and, therefore, extra, relevant references to our search results. Extra synonyms can be found in articles that have been assigned a certain set of thesaurus terms but that lack synonyms in the title and/or abstract that are already present in the current search strategy. Searching for thesaurus terms NOT free-text terms will help identify missed free-text terms in the title or abstract. Searching for free-text terms NOT thesaurus terms will help identify missed thesaurus terms. If this is done repeatedly for each element, leaving the rest of the query unchanged, this method will help add numerous relevant terms to the query. These steps are explained in detail for five different search platforms in the supplementary appendix .

12. Evaluate the initial results

The results should now contain relevant references. If the interface allows relevance ranking, use that in the evaluation. If you know some relevant references that should be included in the research, search for those references specifically; for example, combine a specific (first) author name with a page number and the publication year. Check whether those references are retrieved by the search. If the known relevant references are not retrieved by the search, adapt the search so that they are. If it is unclear which element should be adapted to retrieve a certain article, combine that article with each element separately.

Different outcomes are desired for different types of research questions. For instance, in the case of clinical question answering, the researcher will not be satisfied with many references that contain a lot of irrelevant references. A clinical search should be rather specific and is allowed to miss a relevant reference. In the case of an SR, the researchers do not want to miss any relevant reference and are willing to handle many irrelevant references to do so. The search for references to include in an SR should be very sensitive: no included reference should be missed. A search that is too specific or too sensitive for the intended goal can be adapted to become more sensitive or specific. Steps to increase sensitivity or specificity of a search strategy can be found in the supplementary appendix .

13. Check for errors

Errors might not be easily detected. Sometimes clues can be found in the number of results, either when the number of results is much higher or lower than expected or when many retrieved references are not relevant. However, the number expected is often unknown, and very sensitive search strategies will always retrieve many irrelevant articles. Each query should, therefore, be checked for errors.

One of the most frequently occurring errors is missing the Boolean operator “OR.” When no “OR” is added between two search terms, many interfaces automatically add an “AND,” which unintentionally reduces the number of results and likely misses relevant references. One good strategy to identify missing “OR”s is to go to the web page containing the full search strategy, as translated by the database, and using Ctrl-F search for “AND.” Check whether the occurrences of the “AND” operator are deliberate.

Ideally, search strategies should be checked by other information specialists [ 18 ]. The Peer Review of Electronic Search Strategies (PRESS) checklist offers good guidance for this process [ 4 ]. Apart from the syntax (especially Boolean operators and field codes) of the search strategy, it is wise to have the search terms checked by the clinician or researcher familiar with the topic. At Erasmus MC, researchers and clinicians are involved during the complete process of structuring and optimizing the search strategy. Each word is added after the combined decision of the searcher and the researcher, with the possibility of directly comparing results with and without the new term.

14. Translate to other databases

To retrieve as many relevant references as possible, one has to search multiple databases. Translation of complex and exhaustive queries between different databases can be very time consuming and cumbersome. The single-line search strategy approach detailed above allows quick translations using the find and replace method in Microsoft Word (<Ctrl-H>).

At Erasmus MC, macros based on the find-and-replace method in Microsoft Word have been developed for easy and fast translation between the most used databases for biomedical and health sciences questions. The schema that is followed for the translation between databases is shown in Figure 2 . Most databases simply follow the structure set by the Embase.com search strategy. The translation from Emtree terms to MeSH terms for MEDLINE in Ovid often identifies new terms that need to be added to the Embase.com search strategy before the translation to other databases.

Schematic representation of translation between databases used at Erasmus University Medical Center

Dotted lines represent databases that are used in less than 80% of the searches.

Using five different macros, a thoroughly optimized query in Embase.com can be relatively quickly translated into eight major databases. Basic search strategies will be created to use in many, mostly smaller, databases, because such niche databases often do not have extensive thesauri or advanced syntax options. Also, there is not much need to use extensive syntax because the number of hits and, therefore, the amount of noise in these databases is generally low. In MEDLINE (Ovid), PsycINFO (Ovid), and CINAHL (EBSCOhost), the thesaurus terms must be adapted manually, as each database has its own custom thesaurus. These macros and instructions for their installation, use, and adaptation are available at bit.ly/databasemacros.

15. Test and reiterate

Ideally, exhaustive search strategies should retrieve all references that are covered in a specific database. For SR search strategies, checking searches for their recall is advised. This can be done after included references have been determined by the authors of the systematic review. If additional papers have been identified through other non-database methods (i.e., checking references in included studies), results that were not identified by the database searches should be examined. If these results were available in the databases but not located by the search strategy, the search strategy should be adapted to try to retrieve these results, as they may contain terms that were omitted in the original search strategies. This may enable the identification of additional relevant results.

A methodology for creating exhaustive search strategies has been created that describes all steps of the search process, starting with a question and resulting in thorough search strategies in multiple databases. Many of the steps described are not new, but together, they form a strong method creating high-quality, robust searches in a relatively short time frame.

Our methodology is intended to create thoroughness for literature searches. The optimization method, as described in step 11, will identify missed synonyms or thesaurus terms, unlike any other method that largely depends on predetermined keywords and synonyms. Using this method results in a much quicker search process, compared to traditional methods, especially because of the easier translation between databases and interfaces (step 13). The method is not a guarantee for speed, since speed depends on many factors, including experience. However, by following the steps and using the tools as described above, searchers can gain confidence first and increase speed through practice.

What is new?

This method encourages searchers to start their search development process using empty syntax first and later adding the thesaurus terms and free-text synonyms. We feel this helps the searcher to focus on the search terms, instead of on the structure of the search query. The optimization method in which new terms are found in the already retrieved articles is used in some other institutes as well but has to our knowledge not been described in the literature. The macros to translate search strategies between interfaces are unique in this method.

What is different compared to common practice?

Traditionally, librarians and information specialists have focused on creating complex, multi-line (also called line-by-line) search strategies, consisting of multiple record sets, and this method is frequently advised in the literature and handbooks [ 2 , 19 – 21 ]. Our method, instead, uses single-line searches, which is critical to its success. Single-line search strategies can be easily adapted by adding or dropping a term without having to recode numbers of record sets, which would be necessary in multi-line searches. They can easily be saved in a text document and repeated by copying and pasting for search updates. Single-line search strategies also allow easy translation to other syntaxes using find-and-replace technology to update field codes and other syntax elements or using macros (step 13).

When constructing a search strategy, the searcher might experience that certain parentheses in the syntax are unnecessary, such as parentheses around all search terms in the title/abstract portion, if there is only one such term, there are double parentheses in the proximity statement, or one of the word groups exists for only one word. One might be tempted to omit those parentheses for ease of reading and management. However, during the optimization process, the searcher is likely to find extra synonyms that might consist of one word. To add those terms to the first query (with reduced parentheses) requires adding extra parentheses (meticulously placing and counting them), whereas, in the latter search, it only requires proper placement of those terms.

Many search methods highly depend on the PICO framework. Research states that often PICO or PICOS is not suitable for every question [ 22 , 23 ]. There are other acronyms than PICO—such as sample, phenomenon of interest, design, evaluation, research type (SPIDER) [ 24 ]—but each is just a variant. In our method, the most important and specific elements of a question are being analyzed for building the best search strategy.

Though it is generally recommended that searchers search both MEDLINE and Embase, most use MEDLINE as the starting point. It is considered the gold standard for biomedical searching, partially due to historical reasons, since it was the first of its kind, and more so now that it is freely available via the PubMed interface. Our method can be used with any database as a starting point, but we use Embase instead of MEDLINE or another database for a number of reasons. First, Embase provides both unique content and the complete content of MEDLINE. Therefore, searching Embase will be, by definition, more complete than searching MEDLINE only. Second, the number of terms in Emtree (the Embase thesaurus) is three times as high as that of MeSH (the MEDLINE thesaurus). It is easier to find MeSH terms after all relevant Emtree terms have been identified than to start with MeSH and translate to Emtree.

At Erasmus MC, the researchers sit next to the information specialist during most of the search strategy design process. This way, the researchers can deliver immediate feedback on the relevance of proposed search terms and retrieved references. The search team then combines knowledge about databases with knowledge about the research topic, which is an important condition to create the highest quality searches.

Limitations of the method

One disadvantage of single-line searches compared to multi-line search strategies is that errors are harder to recognize. However, with the methods for optimization as described (step 11), errors are recognized easily because missed synonyms and spelling errors will be identified during the process. Also problematic is that more parentheses are needed, making it more difficult for the searcher and others to assess the logic of the search strategy. However, as parentheses and field codes are typed before the search terms are added (step 10), errors in parentheses can be prevented.

Our methodology works best if used in an interface that allows proximity searching. It is recommended that searchers with access to an interface with proximity searching capabilities select one of those as the initial database to develop and optimize the search strategy. Because the PubMed interface does not allow proximity searches, phrases or Boolean “AND” combinations are required. Phrase searching complicates the process and is more specific, with the higher risk of missing relevant articles, and using Boolean “AND” combinations increases sensitivity but at an often high loss of specificity. Due to some searchers’ lack of access to expensive databases or interfaces, the freely available PubMed interface may be necessary to use, though it should never be the sole database used for an SR [ 2 , 16 , 25 ]. A limitation of our method is that it works best with subscription-based and licensed resources.

Another limitation is the customization of the macros to a specific institution’s resources. The macros for the translation between different database interfaces only work between the interfaces as described. To mitigate this, we recommend using the find-and-replace functionality of text editors like Microsoft Word to ease the translation of syntaxes between other databases. Depending on one’s institutional resources, custom macros can be developed using similar methods.

Results of the method

Whether this method results in exhaustive searches where no important article is missed is difficult to determine, because the number of relevant articles is unknown for any topic. A comparison of several parameters of 73 published reviews that were based on a search developed with this method to 258 reviews that acknowledged information specialists from other Dutch academic hospitals shows that the performance of the searches following our method is comparable to those performed in other institutes but that the time needed to develop the search strategies was much shorter than the time reported for the other reviews [ 9 ].

CONCLUSIONS

With the described method, searchers can gain confidence in their search strategies by finding many relevant words and creating exhaustive search strategies quickly. The approach can be used when performing SR searches or for other purposes such as answering clinical questions, with different expectations of the search’s precision and recall. This method, with practice, provides a stepwise approach that facilitates the search strategy development process from question clarification to final iteration and beyond.

SUPPLEMENTAL FILE

Acknowledgments.

We highly appreciate the work that was done by our former colleague Louis Volkers, who in his twenty years as an information specialist in Erasmus MC laid the basis for our method. We thank Professor Oscar Franco for reviewing earlier drafts of this article.