Kernel density estimation

Jump to navigation Jump to search

WikiDoc Resources for Kernel density estimation

Articles

Most recent articles on Kernel density estimation

Most cited articles on Kernel density estimation

Review articles on Kernel density estimation

Articles on Kernel density estimation in N Eng J Med, Lancet, BMJ

Media

Powerpoint slides on Kernel density estimation

Images of Kernel density estimation

Photos of Kernel density estimation

Podcasts & MP3s on Kernel density estimation

Videos on Kernel density estimation

Evidence Based Medicine

Cochrane Collaboration on Kernel density estimation

Bandolier on Kernel density estimation

TRIP on Kernel density estimation

Clinical Trials

Ongoing Trials on Kernel density estimation at Clinical Trials.gov

Trial results on Kernel density estimation

Clinical Trials on Kernel density estimation at Google

Guidelines / Policies / Govt

US National Guidelines Clearinghouse on Kernel density estimation

NICE Guidance on Kernel density estimation

NHS PRODIGY Guidance

FDA on Kernel density estimation

CDC on Kernel density estimation

Books

Books on Kernel density estimation

News

Kernel density estimation in the news

Be alerted to news on Kernel density estimation

News trends on Kernel density estimation

Commentary

Blogs on Kernel density estimation

Definitions

Definitions of Kernel density estimation

Patient Resources / Community

Patient resources on Kernel density estimation

Discussion groups on Kernel density estimation

Patient Handouts on Kernel density estimation

Directions to Hospitals Treating Kernel density estimation

Risk calculators and risk factors for Kernel density estimation

Healthcare Provider Resources

Symptoms of Kernel density estimation

Causes & Risk Factors for Kernel density estimation

Diagnostic studies for Kernel density estimation

Treatment of Kernel density estimation

Continuing Medical Education (CME)

CME Programs on Kernel density estimation

International

Kernel density estimation en Espanol

Kernel density estimation en Francais

Business

Kernel density estimation in the Marketplace

Patents on Kernel density estimation

Experimental / Informatics

List of terms related to Kernel density estimation


Overview

In statistics, kernel density estimation' (or Parzen window method, named after Emanuel Parzen) is a way of estimating the probability density function of a random variable. As an illustration, given some data about a sample of a population, kernel density estimation makes it possible to extrapolate the data to the entire population.

Definition

If x1, x2, ..., xN ~ f is a IID sample of a random variable, then the kernel density approximation of its probability density function is

<math>\widehat{f}_h(x)=\frac{1}{Nh}\sum_{i=1}^N K\left(\frac{x-x_i}{h}\right)</math>

where K is some kernel and h is the bandwidth (smoothing parameter). Quite often K is taken to be a standard Gaussian function with mean zero and variance 1:

<math>K(x) = {1 \over \sqrt{2\pi} }\,e^{-\frac{1}{2}x^2}.</math>

Intuition

Although less smooth density estimators such as the histogram density estimator can be made to be asymptotically consistent, others are often either discontinuous or converge at slower rates than the kernel density estimator. Rather than grouping observations together in bins, the kernel density estimator can be thought to place small "bumps" at each observation, determined by the kernel function. The estimator consists of a "sum of bumps" and is clearly smoother as a result (see below image).

Properties

Let <math>R(f,\hat f(x))</math> be the L2 risk function for f. Under weak assumptions on f and K,

<math>R(f,\hat f(x)) \approx \frac{1}{4}\sigma_k^4h^4\int(f(x))^2dx + \frac{\int K^2(x)dx}{nh}</math> where <math>\sigma_K^2 = \int x^2K(x)dx</math>.

By minimizing the theoretical risk function, it can be shown that the optimal bandwidth is

<math>h^* = \frac{c_1^{-2/5}c_2^{1/5}c_3^{-1/5}}{n^{1/5}}</math>

where

<math>c_1 = \int x^2K(x)dx</math>
<math>c_2 = \int K(x)^2dx</math>
<math>c_3 = \int (f(x))^2dx</math>

When the optimal choice of bandwidth is chosen, the risk function is <math>R(f, \hat f(x)) \approx \frac{c_4}{n^{4/5}}</math> for some constant c4 > 0. It can be shown that, under weak assumptions, there cannot exist a non-parametric estimator that converges at a faster rate than the kernel estimator. Note that the n-4/5 rate is slower than the typical n-1 convergence rate of parametric methods.

Statistical implementation

  • In Stata, it is implemented through kdensity; for example histogram x, kdensity.
  • In R, it is implemented through the density function.

See also

References

  • Parzen E. (1962). On estimation of a probability density function and mode, Ann. Math. Stat. 33, pp. 1065-1076.
  • Duda, R. and Hart, P. (1973). Pattern Classification and Scene Analysis. John Wiley & Sons. ISBN 0-471-22361-1.
  • Wasserman, L. (2005). All of Statistics: A Concise Course in Statistical Inference, Springer Texts in Statistics.

External links

de:Kerndichteschätzer

Template:WikiDoc Sources