Suppose that X1, X2, ..., Xn are i.i.d. from Unif[α,
0].
(a) Find ˆαMM, which is the estimator using method of
moments.
(b) Compute E(ˆαMM) and V ar(ˆαMM)
(c) Find ˆαML, which is the estimate using maximum likelihood
method.
(d) Determine the density of X(1), the smallest of X1, · · · , Xn,
by solving the following:
i. Find P(X(1) ≥ x) as a function of x, where x ≥ 0.
(Hint: X(1) is defined to be the smallest. If the smallest is at
least x, then X1 ≥ x and
X2 ≥ x and · · · Xn ≥ x.)
ii. Find the cdf of X(1), i.e. P(X(1) ≤ x) as a function of x.
Consider three cases x < α,
α < x < 0 and x > 0.
iii. Obtain the density of X(1) by differentiating your answer in
(ii).
(e) Compute E(ˆαML). Is ˆαML unbiased? If not, make it unbiased,
and denote the unbiased
estimate as ˆα.
(f) Compute V ar(ˆα). Which one is more efficient, ˆαMM or
ˆα?
(g) Compute the MSEs (Mean Squared Error) of ˆαMM and ˆαML. Which
one has the smaller MSE?
(Then, that is the better one according to MSE criterion.)
Suppose that X1, X2, ..., Xn are i.i.d. from Unif[α, 0]. (a) Find ˆαMM, which is...
Suppose X1, X2, . . . , Xn (n ≥ 5) are i.i.d. Exp(µ) with the density f(x) = 1 µ e −x/µ for x > 0. (a) Let ˆµ1 = X. Show ˆµ1 is a minimum variance unbiased estimator. (b) Let ˆµ2 = (X1 +X2)/2. Show ˆµ2 is unbiased. Calculate V ar(ˆµ2). Confirm V ar(ˆµ1) < V ar(ˆµ2). Calculate the efficiency of ˆµ2 relative to ˆµ1. (c) Show X is consistent and sufficient. (d) Show ˆµ2 is not consistent...
7. Let X1 , Xn be i.i.d. with the density p(r,0) = a*(1 - 0)1-k1{x = 0,1} (a) Find the ML estimator of 0 (b) Is it unbiased? (c) Compute its MSE
7. Let X1 , Xn be i.i.d. with the density p(r,0) = a*(1 - 0)1-k1{x = 0,1} (a) Find the ML estimator of 0 (b) Is it unbiased? (c) Compute its MSE
Q3 Suppose X1, X2, ..., Xn are i.i.d. Poisson random variables with expected value ). It is well-known that X is an unbiased estimator for l because I = E(X). 1. Show that X1+Xn is also an unbiased estimator for \. 2 2. Show that S2 (Xi-X) = is also an unbaised esimator for \. n-1 3. Find MSE(S2). (We will need two facts) E com/questions/2476527/variance-of-sample-variance) 2. Fact 2: For Poisson distribution, E[(X – u)4] 312 + 1. (See for...
7. Let X1, · · · , Xn be i.i.d. with the density p(x, θ) = θ k
(1 − θ) 1−k I{x = 0, 1}
(a) Find the ML estimator of θ.
(b) Is it unbiased ?
(c) Compute its MSE
7. Let Xi, . . . , Xn be i.id, with the density p(z,0)-gk(1-0)1-k1(z-0, 1) (b) Is it unbiased? (c) Compute its MSE
7. Let Xi, . . . , Xn be i.id, with the density p(z,0)-gk(1-0)1-k1(z-0, 1)...
Find the variance assuming X1, X2, · · · , Xn be an i.i.d. sample from the density f (x|θ) = 1/2θ e (−|x|/θ) , −∞ < x < ∞
1. Suppose that X Unif(0, 30) and we draw a random sample X1,..., Xn Find the MME and compute its relative efficiency to 6, = 2X1-3X2. 2. In class, I showed the below picture. Here, I have changed the vertical axis from variance to SD. In this new picture, how can we visualize the MSE? How does this way of seeing the MSE help us decide which of two (possibly biased) estimators is more efficient? SD 04 Bias (B) 0...
Additional Question i.i.d. ˆ Fix θ > 0 and let X1,...,Xn ∼
Unif[0,θ]. We saw in class that the MLE of θ, θMLE = max(X1, . . .
, Xn), is biased. I give two other estimators of θ, which can be
made unbiased by appropriate choice of constants C1, C2:
ADDITIONAL QUESTION Fix θ 0 and let Xi, . . . , Xn iid. Unifl0.0]. We saw in class that the MLE of θ, θΜ1E- max(Xi,..., Xn), is biased....
Additional Question Fix θ > 0 and let X1, . . . , Xn i.i.d. ∼ Unif[0, θ]. We saw in class that the MLE of θ, ˆθMLE = max(X1, . . . , Xn), is biased. I give two other estimators of θ, which can be made unbiased by appropriate choice of constants C1, C2: ˆθ1 = C1 max(X1, . . . , Xn) and ˆθ2 = C2Σxi We have two questions: (1) Find values of C1, C2 for...
Let X1, ..., Xn be i.i.d. [Recall that i.i.d. stands for independent and identically distributed.] Since X1, ..., Xn all have the same distribution, they have the same expected value and variance. Let E(X1) = µ and V ar(X1) = σ 2 . Find the following in terms of µ and σ 2 . (a) E(X2 1 ). Note this is not µ 2 ! (b) E( Pn i=1 X2 i /n). (c) Now, define W by W = 1...
Q2 Suppose X1, X2, ..., Xn are i.i.d. Bernoulli random variables with probability of success p. It is known ΣΧ; is an unbiased estimator for p. that = n 2. Suggest an unbiased estimator for pa. (Hint: use the fact that the sample variance is unbiased for variance.) 3. Show that p= ΣΧ,+2 n+4 is a biased estimator for p. 4. For what values of p, MSE) is smaller than MSE)?