An analysis of the statistics used in psychological papers
DOI:
https://doi.org/10.24837/pru.v7i2.435Keywords:
statistical procedures, psychology conference in Romania, descriptive statistics, inferential statisticsAbstract
This article analyses the statistical procedures used in the proceedings of the one of the psychology conferences regularly organized in Romania. 111 papers in six branches of applied psychology were scrutinized. The analysis was structured on descriptive statistics (numerical and graphical), and inferential statistics (parametric and nonparametric). Was also pursued the extent to which papers complied with APA recommendations on the reporting of confidence limits and size effect. Results: 64.9% of the papers reported statistical results. The sections with more statistical based papers are military psychology (85.7%) and industrial-organizational psychology (84%). On the other hand, only 52.4% papers on educational psychology reported statistics procedures. The average of the reported samples was 190 subjects (minimum 10, maximum 1519). A percentage of 26.4% of works includes at least one statistical descriptive indicator, while 31.9% of works containing statistics, have no descriptive indicators. The graphics used are mostly bar and pie. Regarding inferential statistics, 47.2% of work contains at least one statistical test, and 36.1% have none statistical test. The most frequent utilized tests are Pearson r and t tests. It was recorded no single case of reporting effect sizes and confidence limits. Conclusions: The results allow us to appreciate that the papers presented at scientific events, most of them by young psychologists, contain a relative insufficiently matured statistical analysis, and often insufficient connected to the problem studied. We must appreciate, however, as positive the interest in empirical research and statistical analysis of results.
Downloads
References
Brewerton, P., & Millward, L. (2008). Organizational Research Methods. A Guide for Students and Researchers, London: SAGE Publications.
Bryman, A. (2008). The End of the Paradigm Wars? In P. Alasuutari, L. Bickman & J. Brannen (Eds.), The SAGE Handbook of Social Research Methods (p. 13-25): SAGE Publications.
Crosta, F., Nishiwaki-Dantas, M. C., Silvino, W., & Dantas, P. E. (2005). [Diversity and frequency of scientific research design and statistical methods in the "Arquivos Brasileiros de Oftalmologia": a systematic review of the "Arquivos Brasileiros de Oftalmologia"--1993-2002.]. Arquivos brasileiros de oftalmologia, 68(3), 339-345.
Cumming, G., Fidler, F., Leonard, M., Kalinowski, P., Christiansen, A., Kleinig, A., et al. (2007). Statistical reform in psychology: is anything changing? (www.blackwell-synergy.com). Psychological Science, 18(3).
Daniel, L. G. (1998). Statistical Significance Testing: A Historical Overview of Misuse and Misinterpretation with Implications for the Editorial Policies of Educational Journals. Research in the school, 5 (1), 23-32.
Denis, D. J. (2003). Alternatives to Nul Hypothesis Significance Testing. Theory & Science. Retrieved from http://theoryandscience.icaap.org/content/vol 4.1/02_denis.html
Elster, A. D. (1994). Use of statistical analysis in the AJR and Radiology: frequency, methods, and subspecialty differences. American Journal of Radiology and Roentgenology, 163(3), 711-715.
Fan, X. (2001). Statistical significance and effect size in educational research: two sides of a coin. The Journal of Educational Research, 94(5), 275-282.
Frankfort-Nachmias, C., & Nachmias, D. (2000). Research Methods in the Social Sciences (Sixth ed.): Worth Publishers.
Fransella, F., & Neimeyer, R. A. (2003). George Alexander Kelly: The Man and his Theory. In F. Fransella (Ed.), International Handbook of Personal Construct Psychology (p. 21-33): 2003 John Wiley & Sons.
Golder, W. (1999). [Statistical analysis of German radiologic periodicals: developmental trends in the last 10 years]. Fortschritte auf dem Gebiete der Röntgenstrahlen und der Nuklearmedizin, 171(3), 232-239.
Goldin, J., Zhu, W., & Sayre, J. W. (1996). A review of the statistical analysis used in papers published in Clinical Radiology and British Journal of Radiology. Clinical Radiology, 51(1), 47-50.
Goodman, S. N., Altman, D. G., & George, S. L. (1998). Statistical reviewing policies of medical journals: caveat lector? Journal of General Internal Medicine, 13(11), 753-756.
Goodwin, L. D., & Goodwin, W. L. (1985). An Analysis of Statistical Techniques Used in the Journal of Educational Psychology, 1979-1983 Educational Psychologist, 20(1), 13-21.
Huang, W., LaBerge, J. M., Lu, Y., & Glidden, D. V. (2002). Research publications in vascular and interventional radiology: research topics, study designs, and statistical methods. Journal of Vascular and Interventional Radiology, 13(3), 247-255.
Juzych, M. S., Shin, D. H., Seyedsadr, M., Siegner, S. W., & Juzych, L. A. (1992). Statistical techniques in ophthalmic journals. Archives of Ophthalmology, 110(9), 1225-1229.
Katz, K. A., Crawford, G. H., Lu, D. W., Kantor, J., & Margolis, D. J. (2004). Statistical reviewing policies in dermatology journals: results of a questionnaire survey of editors. Journal of the American Academy of Dermatology, 51(2), 234-240.
Kotrlik, J. W., & Williams, H. A. (2003). The Incorporation of Effect Size in Information Technology, Learning, and Performance Research. Information Technology, Learning, and Performance Journal, 21(1).
Mora Ripoll, R., & Canela, S. J. (1997). [Statistical analyses in the Revista Clinica Española: their actual use and accessibility for the reader]. Revista Clinica Española, 197(1), 23-27.
Rosnow, R. L., & Rosenthal, R. (1989). Statistical Procedures and the Justification of Knowledge in Psychological Science. American Psychologist, October, 1276-1284.
Sych, Z. (1996). [Evaluation of using statistical methods in selected national medical journals]. Annales Academiae Medicae Stetinensis, 42, 67-84.
Taddese, Z. (2001). A survey of statistical methodology used in Ethiopian health science research journals. Ethiopian Medical Journal, 39(3), 229-239.
Wang, Q., & Zhang, B. (1998). Research design and statistical methods in Chinese medical journals. The Journal of the American Medical Association, 280(3), 283-285.
Wilkinson L. & Task Force on Statistical Inference; APA Board of Scientific Affairs (1999). Statistical methods in psychology journals: Guidelines and explanations. American Psychologist, 54, 594-604.
Downloads
Published
How to Cite
Issue
Section
License
Authors who publish with this journal agree to the following terms:
- Authors retain copyright and grant the journal right of first publication with the work simultaneously licensed under a Creative Commons Attribution License that allows others to share the work with an acknowledgement of the work's authorship and initial publication in this journal,it also allows for use of the work for non-commercial purposes and if others remix, transform or build upon the works found in this journal they must distribute the contributions under the same licence as the original.
- Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in this journal.
- Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See: The Effect of Open Access).
