Limitations of Bibliometric Data
There are a number of limitations to biblio and alt-metrics, here are the most commonly agreed upon.
- Quality: a high citation count doesn't directly equate with quality in a scientific paper, neither does it mean that a paper is the most cutting edge research in a given field. What these metrics tell us is how much attention is being paid to a specific article.
- Academic Disciplines: different disciplines have different publishing standards, research can take longer etc. and thus there can be wide variance between say history and chemical engineering.
- Data problems: all metrics are based on data sets. These datasets can be incomplete in certain cases and therefore cannot tell the whole story. Others may have other problems, this is why you must be a critical consumer of information when using bibliometric data.