Behrens-Fisher problem

You don't need to be Editor-In-Chief to add or edit content to WikiDoc. You can begin to add to or edit text on this WikiDoc page by clicking on the edit button at the top of this page. Next enter or edit the information that you would like to appear here. Once you are done editing, scroll down and click the Save page button at the bottom of the page.

Editor-In-Chief: C. Michael Gibson, M.S., M.D. [1] Phone:617-632-7753

Please Take Over This Page and Apply to be Editor-In-Chief for this topic: There can be one or more than one Editor-In-Chief. You may also apply to be an Associate Editor-In-Chief of one of the subtopics below. Please mail us [2] to indicate your interest in serving either as an Editor-In-Chief of the entire topic or as an Associate Editor-In-Chief for a subtopic. Please be sure to attach your CV and or biographical sketch.

Overview

In statistics, the Behrens-Fisher problem is the problem of interval estimation and hypothesis testing concerning the difference between the means of two normally distributed populations when the variances of the two populations are not assumed to be equal, based on two independent samples.

Ronald Fisher in 1935 introduced fiducial inference in order to apply it to this problem. He referred to an earlier paper by W. V. Behrens from 1929. Behrens and Fisher proposed to find the probability distribution of

where and are the two sample means, and s₁ and s₂ are their standard deviations. Fisher approximated the distribution of this by ignoring the random variation of the relative sizes of the standard deviations, .

Fisher's solution provoked controversy because it did not have the property that the hypothesis of equal means would be rejected with probability α if the means were in fact equal. Many other methods of treating the problem have been proposed since.

Welch's approximate t solution

The most widely used method (for example in statistical packages and in Microsoft Excel) is that of B. L. Welch, who, like Fisher, was at University College London. The variance of the mean difference results in . Welch (1938) approximated the distribution of by that Typ III Pearson distribution (a scaled chi-squared distribution) whose first two moments agree with that of . This applies to the following number of degrees of freedom (d.f.), which is generally non-integer:

.

Under the null hypothesis of equal expectations, μ₁ = μ₂, the distribution of the Behrens Fisher statistic T, which also depends on the variance ratio , could now be approximated by Student's t distribution with these ν degrees of freedom. But this ν contains the population variances , and these are unknown. The following estimate only replaces the population variances by the sample variances:

.

This is a random variable. A t distribution with a random number of degrees of freedom does not exist. Nevertheless, the Behrens Fisher T can be compared with a corresponding quantile of Student's t distribution with these estimated number of degrees of freedom, , which is generally non-integer. In this way, the boundary between acceptance and rejection region of the test statistic T is described by a smooth function dependent on the empirical variances .

This method also does not give exactly the nominal rate, but is generally not too far off. However, if the population variances are equal, or if the samples are rather small and the population variances can be assumed to be approximately equal, it is more accurate to use the standard method, which is the two-sample t-test.

References and external links

• W. V. Behrens, "Ein beitrag zur Fehlerberechnung bei wenigen Beobachtungen", 'Landwirtschaftliche Jahrbuecher' 68, pp. 807-37.
• "On the Behrens-Fisher Problem: A Review", by Seock-Ho Kim and Allan Cohen, University of Wisconsin-Madison, 1995. Paper presented at the annual meeting of the Psychometric Society, Minneapolis.

• "Distributional Property of the Generalized p-value for the Behrens-Fisher Problem with Applications to Multiple Testing", by Kam-Wah Tsui and Shijie Tang, University of Wisconsin-Madison, October 31, 2005

• "A simple conservative and robust solution of the Behrens-Fisher problem", by Harold Ruben, 'The Indian Journal of Statistics' Series A Volume 64 Part 1 Pages 139--155 Year: 2002

• "The significance of the difference between two means when the population variances are unequal" by B. L. Welch, 1938, 'Biometrika' 29, pp. 350-62.

• A solution using empirical likelihood