Theory of Estimation

We know from our basic knowledge of statistics that one of the objectives in statistics is to better understand and model the underlying process which generates the data. This is known as statistical inference: we infer from information contained in a sample properties of the population from which the observations are taken. In multivariate statistical inference, we do exactly the same. The basic ideas were introduced in Section 4.5 on sampling theory: we observed the values of a multivariate random variable X and obtained a sample $$\left\{ {{x_i}} \right\}_i^n = 1$$ . Under random sampling, these observations are considered to be realizations of a sequence of i.i.d. random variables X 1, ..., X n where each X i is a p-variate random variable which replicates the parent or population random variable X. In this chapter, for notational convenience, we will no longer differentiate between a random variable X i and an observation of it, x i , in our notation. We will simply write x i and it should be clear from the context whether a random variable or an observed value is meant.