17

Answers which are wholly based on "original research" are generally downvoted and may be deleted.

What are the characteristics that (dis-)qualify an answer as original research? How should these issues be corrected?

1 Answer 1

12

The general rule for answers is that:

It is up to the answerer to provide valid, verifiable and potentially replicable evidence, and to show convincingly that it is relevant to the question. Every answer should be suitable for review and voting by our community of experts in evaluating evidence. Answers which require non-trivial specialist expertise or are anecdotal in nature are not acceptable due to the nature of this community.

Here is a list of common examples of unacceptable research and how to fix them.

Original data analysis

Answers are original research when they perform non-trivial analysis of available data and present a novel result which requires specialist expertise to review. It is acceptable to provide a collection of evidence, but not to apply non-trivial calculations that require a community of experts to evaluate. (This also includes the use of non-trivial Internet-based tools.)

How to fix

Find a peer-reviewed (or at least authoritative) analysis of such data; don't perform the analysis independently.

Unverifiable data

Answers are original research when they are based on non-verifiable or non-replicable data, like home-performed experiments.

How to fix

Provide more reputable data, preferably from peer-reviewed sources.

Negative searches

Answers are original research when they are based on the fact that the answerer found no relevant results when looking at non-verifiable or non-replicable search results, such as Google queries.

How to fix

When you want to link to a search, typically to "prove a negative":

  • Use a tool which allows reasonably good replication of the results. For example, Google is known to provide different answers per user, so it's not acceptable.

  • Use a reputable tool which has an extensive index.

  • Document your search terms.

Note that you will not be proving a negative so make sure your answer does not jump to unreasonable conclusions. At best, a negative search can support a "probably not" or, more likely, a "unknown" answer.

An alternative approach is to cite a relevant expert in the field, who has reported that they have searched for evidence and found none. This suffers from the Argument from Authority fallacy, and is merely likely to be correct, rather than definitively correct. Despite that, it is sometimes the best we can do to demonstrate a claim has no substance behind it. Once again, care should be taken about the conclusions drawn from such an argument.

Specialist or untrusted tools

Answers are original research if they are based on tools whose validity is unknown or disputed.

How to fix

If you need to use a tool that is not obviously main-stream, provide reliable evidence that such a tool is reliable and that you are using it as intended.

4
  • 5
    Saying "requires specialist expertise to review" and "require a community of experts to evaluate" might be begging the question. What about the answers to meta.skeptics.stackexchange.com/q/2860/2703 made them 'original research'? IMO they were simple arithmetic; and quotes from the tax code and from public cost-of-living data. Where they made assumptions (e.g. 'person living alone' versus 'person with a family') they stated the assumption.
    – ChrisW
    Sep 4, 2014 at 0:11
  • 1
    Let's address the specific problems with those particular answers on that meta-question. I agree the terms you highlighted are not rigidly defined, but hopefully they are clearer than the term "original research". It will never be entirely specified, but I think this is more specific, and hence an improvement.
    – Oddthinking Mod
    Sep 4, 2014 at 3:05
  • 1
    I think your wording of "nontrivial" is rather vague. Can you clarify what exactly is meant by that?
    – March Ho
    Jan 14, 2015 at 20:59
  • @MarchHo not exactly, but the general idea is "high-school level or lower" is trivial
    – Sklivvz
    Jan 14, 2015 at 21:07

You must log in to answer this question.

Not the answer you're looking for? Browse other questions tagged .