WOLFRAM NOTEBOOK

WOLFRAM|DEMONSTRATIONS PROJECT

Monte Carlo Expectation-Maximization (EM) Algorithm

display
Monte Carlo estimates
data quantile plot
sample size n
25
iterations N
25
simulations M
25
theoretical censor rate r
0.25
random seed
5983
The Monte Carlo expectation-maximization (EM) algorithm is used to estimate the mean in a random sample of size
n
from a left-censored standard normal distribution with censor point,
c=
-1
Φ
(r)
, where
r
is the censor rate and
-1
Φ
is the inverse cumulative distribution function of the standard normal distribution. The random sample consists of
m
non-censored observations and
n-m
censored observations. You can see these observations in the quantile plot along with the empirical censor rate,
c
=(n-m)/n
.
Each Monte Carlo iteration uses
M
simulations of latent censored values in the right-truncated normal distribution on
(-,c)
to provide an estimate of the mean.
N
Monte Carlo iterations are done and these are shown as the blue points. The blue line segment shows the corresponding average for the blue points. The short red line segment on the right shows the deterministic EM estimate.
You can see that using the average improves the accuracy, since the blue line showing the average is closer to the red line than the individual points. Also, you see that as the number of iterations increases, the points lie closer, illustrating the well-known result that the iterations converge to the deterministic value. The gray line shows the true parameter value,
μ=0
, and this Demonstration shows that as the sample size
n
increases, both the Monte Carlo and deterministic EM algorithm converge to the true value. See Details for further discussion.
Wolfram Cloud

You are using a browser not supported by the Wolfram Cloud

Supported browsers include recent versions of Chrome, Edge, Firefox and Safari.


I understand and wish to continue anyway »

You are using a browser not supported by the Wolfram Cloud. Supported browsers include recent versions of Chrome, Edge, Firefox and Safari.