NCEAS Project 9241

A quantitative exploration of the role of publication-related biases in ecology

• Lortie, Christopher
• Aarssen, Lonnie
• Koricheva, Julia
• Tregenza, Tom

Abstract
Progress in a scientific discipline is normally achieved through publication and dissemination of knowledge. Number of publications and their citation frequency are also widely used for academic evaluation of individual researchers, departments, and universities. Therefore, any bias in publication and dissemination of scientific content may potentially affect the development of a field in terms of what kind of information is available for synthesis, who is successfully employed, and where funding is allocated . We will specifically focus on publication bias in ecology in this working group using meta-analysis techniques (and other standard statistics) on several sizeable collections of published papers and related online resources such as citation frequencies and impact factors. We have loosely identified three levels of attributes of the publication and dissemination process in ecology: characteristics of the study (number of hypotheses, effect size, support for main hypothesis), attributes of the publication itself (merit, length, number and gender of authors), and attributes of the journal (reputation, impact factor, circulation). General publication biases identified in medicine and ecology include the file drawer problem, overinterpretation bias, dissemination bias, status bias, visibility bias, and gender bias. Few synthetic studies however have quantitatively tested the importance of these proposed biases nor related these biases to specific attributes of the publication process. Furthermore, there has been no quantitative evaluation of the relative importance and potential interactions between these factors.

• Overview
• Ecology Core Program
• Conservation & Resource Management Program
• Ecoinformatics Program
• Call for Proposals
• NCEAS Public Data Repository
• NCEAS Data Policy