Application of Minimum Bayes Factor to a Balanced Two-Way Anova with Random Effects

Adekunle Omotayo Abidoye; Adewara  A.A; Popoola   J; Egburonu  O. D

doi:10.55927/eajmr.v2i3.3375

Authors

Adekunle Omotayo Abidoye University of Ilorin, Ilorin, Nigeria
Adewara A.A University of Ilorin, Ilorin, Nigeria
Popoola J University of Ilorin, Ilorin, Nigeria
Egburonu O. D Centre for Critical Thinking and Research, CLAPAI Orphanage High School, Jos, Nigeria

DOI:

https://doi.org/10.55927/eajmr.v2i3.3375

Keywords:

ANOVA, Bayes Factor, Bayesian, Frequentist, Variability, P-value

Abstract

It is a common practice in statistical analysis to draw conclusions based on significance. P-values often reflect the probability of incorrectly concluding that a null hypothesized model is true; they do not provide information about other types of error that are also important for interpreting statistical results. Standard model selection criteria and test procedures are often inappropriate for comparing models with different numbers of random effects, due to constraints on the parameter space of the variance components. In this paper, we focused on a minimum Bayes factor proposed by Held and Ott (2018) and applied it to a balanced two way analysis of variance (ANOVA) with random effects under three cases namely: Case 1: both factors are fixed; Case 2: both factors are random; Case 3: factor A is fixed and factor B is random. We realized that in all the three cases, considered the Bayes factor indicates weak evidence against the null hypothesis of zero variability in the effects of the levels of the factors as well as the interactions. This result is due to the conservative nature of the minimum Bayes factor.

References

Bernardo, J. M., and Smith, A. F. M. (1994), Bayesian Theory, New York: Wiley. [104]

Egburonu O.D, And Abidoye A.O. (2018); Application of Bayes Factor For One Way Analysis Of Variance Using Random Effect Models. Bulgarian Journal of Science and Education Policy (BJSEP), 12,( 2 ), 1 – 16.

Faulkenberry T.J. (2018). Approximating Bayes factors from minimal ANOVA summaries: An extension of the BIC method Department of Psychological Sciences Tarleton State University, USA arXiv:1710.02351v1 [stat.ME] 6 Oct 2017

Goodman S. N. (1999). Toward evidence-based medical statistics. 2: The Bayes factor. Ann. Intern.Med. 130:1005–13

Goodman S. N. 2016. Aligning statistical and scientific reasoning. Science 352:1180–81

Gupta S. (2011). Fundamentals of Statistics sixth revised and enlarged edition.

Held L, Ott M. (2018).On p-Values and Bayes Factors.Annual Review of Statistics and Its Application.Epidemiology, Biostatistics and Prevention Institute, University of Zurich, CH-8001 Zurich, Switzerland; email: leonhard.held@uzh.ch, manuela.ott@uzh.chhttps://doi.org/10.1146/annurev-statistics-031017-100307

Held L, and Ott M. (2016): How the maximal evidence of p-values against point null hypotheses dependson sample size. Am. Stat. 70:335–41

Hoenig, J. M., and Heisey, D. M. (2001). The abuse of power: the pervasive fallacy ofpower calculations for data analysis. The American Statistician, 55, 1–6.

James H. S. (2013); Lecture Note on Random Effects ANOVA. Department of Psychology and Human Development, Vanderbilt University

Jeffreys H.(1961). Theory of Probability, Statistics and Computing.3rd edition. London: Oxford University Press

Masson E. J. (2011). A tutorial on a practical Bayesian alternative to null-hypothesis significance testing.Behavior Research Methods, 43(3):679–690,

R Development Core Team. (2017), R: A Language and Environment for Statistical Computing, Vienna, Austria: R Foundation for Statistical Computing, ISBN 3–900051–00–3. [107]

Sellke T., Bayarri M. J. And Berger J.O. (2001). Calibration of p Values for Testing Precise Null Hypotheses.The American Statistician, February 2001, Vol. 55, No. 1 c 2001 American Statistical Association

Wagenmakers (2007): A Practical Solution to the Pervasive Problems of P Values.Theoretical and Review article.Psychonomic bulletin and review.14 (5). 779-804

Wang M. and Sun X. (2013). Bayes factor consistency for One-way Random Effects Model. Department of Mathematical Sciences, Clemson University, USA. arXiv1302.6320v [stat.ME] 26 Feb. 2013