Fisher Consistency

In statistics, Fisher consistency, named after Ronald Fisher, is a desirable property of an estimator asserting that if the estimator were calculated using the entire population rather than a sample, the true value of the estimated parameter would be obtained.

Definition

Suppose we have a statistical sample X1, ..., Xn where each Xi follows a cumulative distribution Fθ which depends on an unknown parameter θ. If an estimator of θ based on the sample can be represented as a functional of the empirical distribution function n:

    Fisher Consistency 

the estimator is said to be Fisher consistent if:

    Fisher Consistency 

As long as the Xi are exchangeable, an estimator T defined in terms of the Xi can be converted into an estimator T′ that can be defined in terms of n by averaging T over all permutations of the data. The resulting estimator will have the same expected value as T and its variance will be no larger than that of T.

If the strong law of large numbers can be applied, the empirical distribution functions n converge pointwise to Fθ, allowing us to express Fisher consistency as a limit — the estimator is Fisher consistent if

    Fisher Consistency 

Finite population example

Suppose our sample is obtained from a finite population Z1, ..., Zm. We can represent our sample of size n in terms of the proportion of the sample ni / n taking on each value in the population. Writing our estimator of θ as T(n1 / n, ..., nm / n), the population analogue of the estimator is T(p1, ..., pm), where pi = P(X = Zi). Thus we have Fisher consistency if T(p1, ..., pm) = θ.

Suppose the parameter of interest is the expected value μ and the estimator is the sample mean, which can be written

    Fisher Consistency 

where I is the indicator function. The population analogue of this expression is

    Fisher Consistency 

so we have Fisher consistency.

Role in maximum likelihood estimation

Maximising the likelihood function L gives an estimate that is Fisher consistent for a parameter b if

    Fisher Consistency 

where b0 represents the true value of b.

Relationship to asymptotic consistency and unbiasedness

The term consistency in statistics usually refers to an estimator that is asymptotically consistent. Fisher consistency and asymptotic consistency are distinct concepts, although both aim to define a desirable property of an estimator. While many estimators are consistent in both senses, neither definition encompasses the other. For example, suppose we take an estimator Tn that is both Fisher consistent and asymptotically consistent, and then form Tn + En, where En is a deterministic sequence of nonzero numbers converging to zero. This estimator is asymptotically consistent, but not Fisher consistent for any n.

The sample mean is a Fisher consistent and unbiased estimate of the population mean, but not all Fisher consistent estimates are unbiased. Suppose we observe a sample from a uniform distribution on (0,θ) and we wish to estimate θ. The sample maximum is Fisher consistent, but downwardly biased. Conversely, the sample variance is an unbiased estimate of the population variance, but is not Fisher consistent.

Role in decision theory

A loss function is Fisher consistent if the population minimizer of the risk leads to the Bayes optimal decision rule.

References

Tags:

Fisher Consistency DefinitionFisher Consistency Finite population exampleFisher Consistency Role in maximum likelihood estimationFisher Consistency Relationship to asymptotic consistency and unbiasednessFisher Consistency Role in decision theoryFisher ConsistencyEstimation theoryRonald FisherSample (statistics)Statistical populationStatistics

🔥 Trending searches on Wiki English:

Keira KnightleyPriscilla PresleyBlake LivelyBohemian GroveKung Fu Panda 4Dakota FanningUnited Arab EmiratesLondonWikiMuhammadAfghanistanDawn Moore2026 FIFA World CupXXX (2002 film)Donte DiVincenzoJustin TimberlakeAbraham OzlerGame of ThronesCultural RevolutionReba McEntireHong KongLes FerdinandMargot RobbieContainer shipArnold SchwarzeneggerAriana GrandeTitanicPirates of the Caribbean (film series)M. A. Chidambaram StadiumWorld War IIJerry TrainorEpicanthic foldAlina HabbaInstagramJulius CaesarSuge Knight2024 Indian general election in Maharashtra2022 FIFA World CupDavid BeckhamVanessa HudgensArthur the KingSenegalIvan ToneyFighter (2024 film)Isla FisherLinkedInChallengers (film)Yulia PutintsevaKathy GriffinMurder MubarakFrancis Scott KeyMillennialsKate GarrawayRebecca FergusonInna Lillahi wa inna ilayhi raji'unRobert Downey Jr.CaliforniaU.S. stateIlia MalininSoviet UnionX (2022 film)Korean WarKate WinsletGrimsby (film)IndiaNapoleonJake Paul vs. Mike TysonTed BundySocial mediaKaty PerrySpain national football teamUEFA European ChampionshipNatalie PortmanGodzilla vs. KongHoliKim PorterDune (novel)🡆 More