Parameter Estimation of Bernoulli Distribution using Maximum Likelihood and Bayesian Methods

Nurmaita Hamsyiah, Nisa Nisa, Warsono Warsono


The term parameter estimation refers to the process of using sample data to estimate the parameters of theselected distribution.There are several methodsthat can be used to estimate distributionparameter(s).In thispaper,the maximum likelihood andBayesian methodsare usedfor estimating parameter ofBernoulli distribution,i.e. , which isdefined asthe probability of success event for two possible outcomes.The maximum likelihood andBayesian estimators of Bernoulli parameter are derived,for the Bayesian estimator the Beta prior is used. Theanalytical calculation shows that maximum likelihood estimator is unbiased while Bayesian estimator isasymptotically unbiased. However, empirical analysis by Monte Carlo simulation shows that the mean squareerrors (MSE) of the Bayesian estimatorare smaller than maximum likelihood estimator for large sample sizes.

Article Metrics

Abstract view : 1612 times
PDF - 4008 times

Full Text:



Bain, L.J. and Engelhardt, M. (1992).Introduction to Probability and Mathematical Statistics. Duxbury Press, California.

Walpole, R.E dan Myers, R.H. (1995). Ilmu Peluang dan Statistika untuk Insinyur dan Ilmuwan. ITB, Bandung.

Al-Kutubi H. S., Ibrahim N.A. (2009). Bayes Estimator for Exponential Distribution with Extensionof Jeffery Prior Information. Malaysian Journal of MathematicalSciences. 3(2):297-313.

Nurlaila, D., Kusnandar D.,& Sulistianingsih, E. (2013). Perbandingan Metode Maximum Likelihood Estimation (MLE) dan Metode Bayes dalam Pendugaan Parameter Distribusi Eksponensial. Buletin Ilmiah Mat. Stat. dan Terapannya. 2(1):51-56.

Fikhri, M., Yanuar, F., & Yudiantri A. (2014). Pendugaan Parameter dari Distribusi Poisson dengan Menggunakan Metode Maximum Likelihood Estimation (MLE) dan Metode Bayes. Jurnal Matematika UNAND. 3(4):152-159.

Singh S. K., Singh, U., &Kumar, M. (2014). Estimation for the Parameter of Poisson-Exponential Distribution under Bayesian Paradigm. Journal of Data Science.12:157-173.

Gupta, I. (2017). Bayesian and E-Bayesian Method of Estimation of Parameter of Rayleigh Distribution-A Bayesian Approachunder Linex Loss Function. International Journal of Statistics and Systems.12(4):791-796.

Box, G.E.P& Tiao, G.C. (1973). Bayesian Inference in Statistical Analysis. Addision-Wesley Publishing Company, Philippines.


  • There are currently no refbacks.