McMaster University’s Professor Geoff Norman is a prominent figure in the Medical Education/Health Professions Education community. Along with co-authoring one of the most popular handbooks in Biostatistics, Norman is also a long-time editor for the Advance in Health Sciences Education journal.
In his journal’s most recent issue Norman offers up some tips on how to not get your paper published. I’ve highlighted my favourites–sound advice for academics and graduate students alike:
- Support your problem statement with the best available evidence (“Nice ideas finish last”)
- Your paper must provide sufficient theoretical and empirical justification for why its problem statement is an important one.
- Conduct a thorough literature review early (“The world doesn’t need another mousetrap”)
- Before beginning your study, ensure the same work has not been conducted before. If it has, ensure your problem statement and study design sufficiently expand past findings.
- Ensure data are consistent with the journal’s/disciplines expectations (“We don’t really care if your students loved the course”)
- Norman reminds us that studies involving self-assessment as data are consistently uncorrelated with performance measures. (Eva and Regehr 2005) While another journal may publish self-assessment data, Norman begs authors to consider whether their data is appropriate for journal/disciplinary conventions before submitting their manuscripts.
- Ask whether your findings are applicable in another context (“We are scientists, not inventors”)
- In studies where a costly simulation device or complex intervention is designed, Norman warns authors not to presume that their findings should be of interest to a wider audience–taking special care when the research is aligned with an commercial interests (e.g., a device manufacturer)
- Ask whether your findings are interesting in another context (“The only people who care about education of pediatric gerontologists in Lower Volga are pediatric gerontologists in Lower Volga”)
- Norman reminds us to think about an international audience for our work. It is incumbent on authors to figure out why researchers in different countries will care about their work.
- Disclose other venues in which your study has been published (“Salami slicing belongs in butcher shops”)
- Salami slicing is the colloquial term for publishing the same study in multiple journals. While Norman admits that this is sometimes an appropriate practice, he reminds researchers to avoid self-plagiarism by writing the second study de novo rather than cutting and pasting swathes of text.
- Represent quantitative value with appropriate detail (“P values tell you whether it’s zero but little else”)
- While a research team’s findings may be statistically significant, simply displaying an appropriate P value is insufficient. Norman reminds authors to include standard deviations, confidence intervals and effect sizes, best represented by good figures and graphs.
- Leave room for future research (“More research is always required”)
- Avoid overstating the universal applicability of your results. Be specific about other research questions that remain to be answered in your work.
Leave your thoughts
What do you think? Am I missing anything obvious? Do you find the advice pedantic? I’d love to read your commends below.