Free scoping read. A written assessment of your manuscript in two business days, at no cost.

Start one

Home/Academy/Researchers Q & A

Researchers Q & A

Direct answers to specific research questions on statistics, meta-analysis, manuscript preparation and the publication process. Each question opens to a short answer, with a link to the full article and its references.

59 questions8 topics

Featured questions

14 in-depth answers
Q&AResearch Writing

Why Should I Edit My Manuscript Before Submitting?

What published studies on manuscript triage actually found about why papers are rejected before peer review, and why pre-submission editing addresses more than just grammar.

Q&AResearch Data Analytics & AI

Can Publication Bias Always Be Detected Using a Funnel Plot?

A verified look at the documented accuracy limits of using funnel plots, visually or through formal statistical tests, to detect publication bias in meta-analysis.

Q&AResearch Data Analytics & AI

Why Is Standard Error Preferred Over Total Sample Size on the Vertical Axis?

A verified explanation of why standard error, not sample size, is the recommended vertical axis for a funnel plot in meta-analysis, and what goes wrong when sample size is used instead.

Q&AResearch Data Analytics & AI

What Does an Asymmetrical Funnel Plot Indicate?

A verified explanation of what an asymmetrical funnel plot indicates in meta-analysis, covering the five documented causes identified in current methodological guidance and how to investigate them.

Q&AResearch Data Analytics & AI

Why Is It Called a "Funnel Plot"?

A verified explanation of why the funnel plot is named for its expected inverted-funnel shape, the statistics behind that shape, and what it means when a real plot departs from it.

Q&AResearch Publication

How to Select the Best Journal for Your Manuscript

A verified, evidence-based guide to selecting the best journal for your manuscript, covering what researchers actually prioritize, how to build a shortlist, and how to verify journal metrics.

Q&AResearch Publication

Can I Submit the Same Manuscript to Multiple Journals at Once?

A verified look at ICMJE, COPE, and WAME guidance on duplicate and simultaneous journal submission, what counts, what doesn't, and what happens when a journal discovers it.

Q&AResearch Publication

What Should I Include in a Journal Submission Package?

A verified, checklist-based guide to what a complete journal submission package should contain, covering ICMJE-required disclosures and how submission portals enforce completeness.

Q&AResearch Publication

How Do I Know If a Journal Is Predatory?

A verified, evidence-based guide to identifying predatory journals, covering the 2019 Nature consensus definition, checkable warning signs, and free verification tools.

Q&AResearch Publication

What Is a Good Impact Factor? Should I Only Aim for High-Impact Journals?

A verified, evidence-based explanation of why there is no universal 'good' impact factor, what the metric was actually designed to measure, and what DORA recommends instead.

Q&AResearch Publication

How Long Does the Submission and Peer Review Process Take?

A verified, evidence-based look at how long journal submission and peer review actually take, covering measured reviewer-turnaround data and where avoidable delay accumulates.

Q&AResearch Publication

What If My Paper Gets Rejected?

A verified, practical guide to what to do after a journal rejects your paper, covering how to read reviewer feedback, what appeals can and cannot do, and how to plan a resubmission.

Q&AResearch Publication

What Is a Cover Letter, and Why Is It Important?

A verified, practical guide to what a journal submission cover letter is for, the disclosures ICMJE and publisher guidance require, and how to structure one effectively.

Q&AResearch Publication

Should I Go for Open Access or Traditional Journals?

A verified, evidence-based guide to choosing between open access and traditional journals, covering the Budapest Open Access Initiative, Plan S compliance, and cost and legitimacy checks.

All questions by topic

All 59 questions, grouped by topic. Select a question to see a short answer, then open the full answer for the detail and references.

Meta-analysis basics and effect sizes

7 questions
What is the difference between the mean and the mean difference in meta-analysis?

A mean describes one group on its own measurement scale; a mean difference is the effect-size statistic defined by the Cochrane Handbook for pooling the same comparison across multiple trials.

Read the full answer →
What is the minimum sample required for a meta-analysis?

A meta-analysis can be computed with as few as two studies, but the statistical methods underlying a random-effects model become unreliable at that scale.

Read the full answer →
What is effect size in meta-analysis, and what is a good effect size?

Effect size is the quantity that a meta-analysis pools, and it is distinct from the p-value. No fixed value qualifies as a good effect size, because the clinical or practical meaning of an identical effect-size value varies with the outcome, population and field it describes.

Read the full answer →
How can Standardized Mean Differences (SMDs) be interpreted using rules of thumb?

Cohen’s conventional thresholds — an SMD of 0.2 as small, 0.5 as medium and 0.8 as large — correspond to concrete, verifiable quantities of approximately 15%, 33% and 47% non-overlap between two distributions.

Read the full answer →
Should review authors include effect size rules of thumb in meta-analysis reports?

The inclusion of effect-size rules of thumb remains a subject of methodological disagreement rather than a settled rule. The Cochrane Handbook cautions that generic small, medium and large labels may mislead when applied without clinical context, whereas other methodologists argue that a labeled benchmark still assists non-specialist readers who cannot otherwise interpret a raw effect-size value.

Read the full answer →
Why might generic effect size interpretations be problematic?

A peer-reviewed methodological critique argues that field-specific effect-size benchmarks, and not only Cohen’s original generic scale, are hazardous shortcuts, because the distribution of effect sizes within any field is itself shaped by publication bias, study quality and measurement reliability rather than by a stable underlying standard of what constitutes a meaningful effect.

Read the full answer →
What are statistical significance and effect size?

Statistical significance concerns how surprising the data would be under the null hypothesis; effect size concerns the magnitude of the effect.

Read the full answer →

P values and statistical significance

6 questions
How does RevMan report P values in a meta-analysis?

The forest plot output of Review Manager (RevMan) reports two separate statistical tests: a “Test for overall effect” Z statistic and p-value for the pooled estimate, and a separate chi-squared-based heterogeneity or “Test for subgroup differences” p-value.

Read the full answer →
What threshold is commonly used to determine statistical significance?

The conventional p<0.05 threshold derives from Ronald Fisher’s 1925 statistics text, in which he described it as a convenient rather than uniquely correct cut-off.

Read the full answer →
What is a P value, and how is it interpreted in the context of Cochrane reviews?

The Cochrane Handbook’s guidance on interpreting results explicitly discourages review authors from using dichotomous significant/non-significant language and recommends that the confidence interval of a pooled effect be interpreted together with its p-value and GRADE certainty rating.

Read the full answer →
How does sample size affect the interpretation of P values?

A sufficiently large sample makes a p-value sensitive to even a trivially small, clinically meaningless effect, whereas a small, underpowered study may equally fail to detect a real and clinically important effect.

Read the full answer →
What are common misinterpretations in P values?

A widely cited 2016 methodological guide catalogues 25 distinct, documented misinterpretations of p-values and related statistics that remain common in published research.

Read the full answer →
How should P values be reported in Cochrane reviews?

Cochrane methods guidance instructs review authors to report an effect estimate with its confidence interval as the primary result and to treat the P value as a secondary, supporting figure, rather than the reverse.

Read the full answer →

Confidence intervals

10 questions
What are confidence intervals, and why are they important in meta-analysis?

A confidence interval around a pooled effect is derived from the extent of disagreement among the individual studies and the quantity of data they contribute, rather than from a single formula applied identically regardless of the data.

Read the full answer →
What is a good confidence interval in a meta-analysis?

No fixed width defines a confidence interval as ‘good’. The relevant criterion is whether the interval is sufficiently narrow, relative to the smallest effect that would change a clinical or policy decision, to confirm or exclude that decision.

Read the full answer →
How should a 95% confidence interval be interpreted?

A 95% confidence interval is a statement about the long-run performance of the method used to construct it, not a 95% probability that the true value lies within the particular interval calculated.

Read the full answer →
How does sample size affect confidence intervals?

The width of a confidence interval decreases approximately in proportion to the square root of the sample size; consequently, the number of participants must be quadrupled, not merely doubled, to halve the width of the reported interval.

Read the full answer →
How do fixed-effect and random-effects models differ in confidence intervals?

A random-effects confidence interval incorporates a between-study variance term that a fixed-effect interval assumes to be absent. For this reason, the same set of studies can produce two noticeably different interval widths around nearly the same pooled point estimate.

Read the full answer →
How does the confidence level impact the width of the confidence interval?

Raising the confidence level from 90% to 95% to 99% widens the interval in every case, because a higher level requires a larger critical value from the same distribution.

Read the full answer →
How are confidence intervals related to P values?

A two-sided P value and a confidence interval calculated from the same model and the same data are mathematically linked rather than independent pieces of evidence.

Read the full answer →
How can confidence intervals help assess clinical significance?

A confidence interval permits a reader to compare both bounds of a result with a pre-specified minimal important difference, which a single P value cannot do.

Read the full answer →
How can confidence intervals be used to assess harm versus benefit?

A confidence interval that spans both a meaningful benefit and a meaningful harm does not establish the direction of a treatment’s effect. For this reason, guidance on interpreting harm-benefit trade-offs treats the entire interval, rather than the point estimate, as the basis for the decision.

Read the full answer →
Can confidence intervals be used to conclude that an intervention is ineffective?

A confidence interval that includes the null value indicates that the data are inconclusive, not that an intervention has no effect. Demonstrating the absence of a meaningful effect requires equivalence or non-inferiority margin methods, which constitute an entirely distinct statistical approach.

Read the full answer →

Funnel plots and publication bias

9 questions
What is a funnel plot, and how is it used in meta-analysis?

A funnel plot displays the effect size of each study against its precision in order to assess publication bias. A 2011 BMJ methods paper cautions, however, that asymmetry may reflect genuine heterogeneity or chance as often as missing studies; the plot therefore prompts further investigation rather than providing a conclusion in itself.

Read the full answer →
What should a funnel plot look like in a meta-analysis?

A well-formed funnel chart is a symmetrical, inverted-funnel scatter plot of study precision against effect size, constructed from at least approximately ten studies with standard error on the vertical axis, rather than a decorative figure added retrospectively.

Read the full answer →
How are funnel plots constructed in meta-analysis?

Constructing a funnel plot follows a defined sequence: selection of one effect measure for every study, calculation of the standard error of each study, plotting of effect size against that standard error, and addition of a pooled-effect reference line.

Read the full answer →
Why is it called a "funnel plot"?

The chart is called a funnel plot because, in the absence of bias, large and precise studies cluster tightly near the top and small, imprecise studies scatter widely near the bottom, tracing the outline of an inverted funnel.

Read the full answer →
Why is standard error preferred over total sample size on the vertical axis?

Egger and Sterne’s 2001 methodological analysis found that plotting sample size rather than standard error on the vertical axis of a funnel plot produces an unpredictable shape even when no bias is present, which is why standard error became the recommended default.

Read the full answer →
How should ratio measures (e.g., odds ratios) and continuous outcomes be plotted in a funnel plot?

Mean and Mean difference are the two key statistical measures used in the statistical analysis. Both are essential for meta-analysis as well.

Read the full answer →
What does an asymmetrical funnel plot indicate?

An asymmetrical funnel plot indicates a small-study effect, in which smaller studies in a meta-analysis systematically report different results from larger ones.

Read the full answer →
Can publication bias in a meta-analysis always be detected using a funnel plot?

Publication bias cannot always be detected using a funnel plot. Researchers asked to identify publication bias visually from simulated funnel plots achieved an accuracy of about 53%, statistically indistinguishable from chance, and formal statistical tests perform little better when a meta-analysis includes fewer than about ten studies.

Read the full answer →
What are the shortcomings of funnel plots in meta-analysis?

Funnel plots have four well-documented shortcomings: human readers detect bias from them at approximately chance level, formal tests require about ten or more studies for adequate power, asymmetry has multiple causes other than bias, and no test has ever been validated against a true, known measure of publication bias.

Read the full answer →

Estimating standard deviations

5 questions
How can SD for the change score be estimated when baseline and post-intervention values are provided?

The standard deviation (SD) of a change score is calculated from the variance sum law by combining the baseline and final SDs with their correlation coefficient.

Read the full answer →
How is a pooled standard deviation calculated when combining two subgroups?

Combining two subgroups into one overall group, such as a male and a female arm of the same trial, requires a specific formula. The pooled standard deviation is not a simple average of the two subgroup standard deviations (SDs), because it must also account for the difference between the subgroup means.

Read the full answer →
How can SD be estimated when only the interquartile range (IQR) is available, without Q1 and Q3 values?

When a source paper reports only the first and third quartiles (Q1 and Q3), without the median, minimum or maximum, the standard deviation can still be approximated by dividing the interquartile range by 1.35, the distance between those quartiles in a standard normal distribution.

Read the full answer →
How can SD be estimated when only the range is reported?

When a study reports only a single range value, such as ‘range = 14 units’, without the underlying minimum and maximum, the Hozo-style formulas cannot be applied because they require both values directly.

Read the full answer →
How can SD be estimated from the minimum, maximum, median and quartiles?

The complete five-number summary (minimum, first quartile, median, third quartile and maximum) is the most informative data-extraction scenario addressed by the estimators of Wan and colleagues, and it yields a measurably more accurate standard deviation (SD) than either the range or the interquartile range alone.

Read the full answer →

Hypotheses and research concepts

3 questions
What is a hypothesis in scientific research?

A scientific hypothesis is a specific, testable claim framed against a conservative null position. The widely used biostatistics guidance of Hazra and Gogtay treats the correct choice and pre-specification of this framing as the step that determines which statistical test, and how much evidence, a study will require.

Read the full answer →
When should a hypothesis be used?

Mean and Mean difference are the two key statistical measures used in the statistical analysis. Both are essential for meta-analysis as well.

Read the full answer →
What is the difference between safety and efficacy in drug research?

Efficacy refers to how well a drug performs under controlled trial conditions, and safety to the acceptability of its adverse effects at that level of performance.

Read the full answer →

Journal selection and submission

10 questions
How do I select the best journal for my manuscript?

A 2022 survey of 1,085 Taylor & Francis authors, reviewers and editors found that journal reputation, scope fit and the reliability of the review process rank above impact factor among the factors that determine where researchers submit.

Read the full answer →
What is a good impact factor? Should I only aim for high-impact journals?

There is no universal threshold for a ‘good’ impact factor, because the Journal Impact Factor is a field-relative measure. The metric’s originator and the San Francisco Declaration on Research Assessment (DORA), which is supported by individual and organisational signatories internationally, both explicitly caution against using it to judge individual articles or researchers, or to compare journals outside their own field.

Read the full answer →
How do I know if a journal is predatory?

A 2019 consensus definition published in Nature and supported by 43 researchers and organizations defines predatory journals by what they fail to do: they prioritize self-interest over quality and misrepresent or omit their editorial and publishing practices.

Read the full answer →
Should I go for Open Access or traditional journals?

Plan S is an open-access initiative supported by cOAlition S, a group of research funding organisations. The choice between open access and a traditional subscription journal is often a compliance question rather than purely a matter of preference, and it should be checked before a journal shortlist is finalized.

Read the full answer →
Can I submit the same manuscript to multiple journals at once?

The International Committee of Medical Journal Editors (ICMJE), the Committee on Publication Ethics (COPE) and the World Association of Medical Editors (WAME) all regard simultaneous submission of the same manuscript to more than one journal as a breach of publication ethics.

Read the full answer →
What should I include in a journal submission package?

The recommendations of the International Committee of Medical Journal Editors (ICMJE), together with the submission-portal documentation that vendors such as Aries Systems and Clarivate publish for authors, converge on the same seven-part package: cover letter, title page, manuscript, figures and tables, supplementary material, disclosures and supporting documentation.

Read the full answer →
What is a cover letter, and why is it important?

A submission cover letter is the only place in which an author can state the significance of a manuscript directly to the editor and disclose any overlapping prior work.

Read the full answer →
How do submission portals such as ScholarOne and Editorial Manager work?

ScholarOne (Clarivate) and Editorial Manager (Aries Systems) are the two manuscript tracking systems underlying most biomedical and scientific journal submissions.

Read the full answer →
How long does the submission and peer review process take?

A study of 5,013 manuscripts at a general medical journal found a mean reviewer turnaround of approximately two weeks even as submission volume rose by half during the pandemic, while a controlled study of actual screening behaviour indicates that the earlier stages, rather than peer review itself, are often where avoidable delay accumulates.

Read the full answer →
What if my paper gets rejected?

Rejection is a routine and expected outcome in academic publishing rather than a judgement on a paper’s worth. Published editorial guidance offers authors a structured path — requesting clarification, revising substantively and resubmitting to a better-matched journal — rather than treating a first rejection as final.

Read the full answer →

Scientific slide decks

9 questions
What are Scientific Slide Decks?

A scientific slide deck is a visual argument constructed one assertion at a time. The assertion-evidence approach developed at Penn State has been associated, in controlled studies of audiences, with improved retention of presentation content compared with conventional bullet-point slide design.

Read the full answer →
Why do companies require Scientific Slide Decks?

Companies that fund or conduct scientific work require a presentation format that a non-specialist stakeholder can follow and a specialist can scrutinise within the same deck, which is the structural problem that the assertion-evidence approach to slide design was developed to address.

Read the full answer →
What services are included in Pubrica’s Scientific Slide Deck offerings?

GPP2022, the standard guidance for company-sponsored biomedical communication, names “meeting presentations” alongside manuscripts, posters, abstracts and plain-language summaries as a format bound by the same rules on ethics, data integrity and accountability.

Read the full answer →
How do you judge a provider’s experience with scientific slide decks?

The Certified Medical Publication Professional (CMPP) designation, a voluntary professional credential, exists because the correct application of Good Publication Practice to sponsored scientific content requires documented training that most general content teams lack.

Read the full answer →
Who prepares the content of a scientific slide deck, and are the contributors qualified?

A Committee on Publication Ethics (COPE) case concerning a medical communications company’s involvement in sponsored content found that undisclosed writing contributions constitute ghost writing regardless of intent.

Read the full answer →
What file formats are provided?

The scope of GPP2022, which names meeting presentations alongside manuscripts and plain-language summaries as communication formats subject to a single accountability standard, applies to the packaging of a deck’s underlying data and citations for delivery as much as to the content of the slides themselves.

Read the full answer →
How long does it take to complete a Scientific Slide Deck?

The timeline of a scientific slide deck is determined less by design effort than by the number of documented review stages that the GPP2022 accountability standard requires it to pass — subject-matter expert review, medical or compliance review and a named accountable sign-off — each a distinct checkpoint rather than part of a single pass.

Read the full answer →
How much does a scientific slide deck service cost?

The 2024 compensation survey of the American Medical Writers Association (AMWA) found that full-time freelance medical communicators reported mean gross incomes ranging from approximately $123,000 to $243,000 according to experience and specialization, a documented range that explains why the price of a scientific slide deck varies widely according to who produces it.

Read the full answer →
How is confidentiality maintained when preparing scientific content?

The Health Insurance Portability and Accountability Act (HIPAA) Privacy Rule sets out specific, named pathways for the use of protected health information in research: Institutional Review Board (IRB) waiver, a limited data set under a data use agreement, or individual authorization.

Read the full answer →

Have a question that is not listed?

Send it to us and a subject specialist will reply, usually within two business days.

Ask a specialist

Get a free quote

Regulations

Check your project against this rule

  1. 1Your work
  2. 2Your details
  3. 3Send
What do you need?

Material you send is held under signed confidentiality, with access limited to the assigned team and encrypted transfer. It is not used to train anything and is not passed to third-party tools. Ask for the agreement before you send anything you would rather cover first.