The process of averaging in situations involving low random error of measurement is examined critically. The illustrative examples are drawn from physics, but the conclusions apply more generally. In particular, the various averages which can arise in physical situations are discussed. Approximate expressions are given for the differences between them. Finally, the significance of these differences is examined.