[Solved] CS6313 Mini Project 3

1. Suppose we would like to estimate the parameter (> 0) of a Uniform (0,) population based on a random sample X₁,,X_n from the population. In the class, we have discussed two estimators for the maximum likelihood estimator, ₁ = X_(n), where X_(n) is the maximum of the sample, and the method of moments

estimator, ₂ = 2X, where X is the sample mean. The goal of this exercise is to compare the mean squared errors of the two estimators to determine which estimator is better. Recall that the mean squared error of an estimator of a parameter is defined as E{()²}. For the comparison, we will focus on n = 1,2,3,5,10,30 and = 1,5,50,100.

1

• Explain how you will compute the mean squared error of an estimator usingMonte Carlo simulation.
• For a given combination of (n,), compute the mean squared errors of both ₁ and ₂ using Monte Carlo simulation with N = 1000 replications. Be sure to compute both estimates from the same data.
• Repeat (b) for the remaining combinations of (n,). Summarize your results graphically.
• Based on (c), which estimator is better? Does the answer depend on n or ? Explain. Provide justification for all your conclusions.

2. Suppose the lifetime, in years, of an electronic component can be modeled by a continuous random variable with probability density function

where > 0 is an unknown parameter. Let X₁,,X_n be a random sample of size n from this population.

• Derive an expression for maximum likelihood estimator of .
• Suppose n = 5 and the sample values are x₁ = 21.72,x₂ = 14.65,x₃ = 50.42,x₄ = 28.78,x₅ = 11. Use the expression in (a) to provide the maximum likelihood estimate for based on these data.
• Even though we know the maximum likelihood estimate from (b), use the data in(b) to obtain the estimate by numerically maximizing the log-likelihood function using optim function in R. Do your answers match?
• Use the output of numerical maximization in (c) to provide an approximatestandard error of the maximum likelihood estimate and an approximate 95% confidence interval for . Are these approximations going to be good? Justify your answer.