Can recent innovations in harmonic analysis "explain" key findings in natural image statistics?

DAVID DONOHO; A.G. FLESIA

NETWORK-COMPUTATION IN NEURAL SYSTEMS

Taylor and Francis Group

Lugar: New York; Año: 2001 vol. 12 p. 371 - 393

0954-898X

Recently, applied mathematicians have been pursuing the goal of sparse coding of certain mathematical models of image with edges. They have found by mathematical analysis that, instead of wavelets and Fourier methods, sparse coding leads towards new systems, ridgelets and curvelets.These new systems have elements distributed across a range of scales and locations, but also orientations. In fact they have highly direction-specific elements and exhibit increasing numbers of distinct directions as we go successively finer scales. Meanwhile, researches in Natural Scene Statistics have been attempting to find sparse codes for natural images. The new systems the have found by computational optimization have elements distributed across a range of scales and locations, but also orientations. The new systems are certainly unlike wavelet and Gabor systems, one hand because of the multi-orientation and on the other hand because of the multi-scale nature.There is a certain degree of visual resemblance between the findings in the two fields, which suggests the hypothesis that certain important findings in the NSS literature might possibly be explained by the slogan: edges are the dominant features in images, and curvelets are the right tool for representing edges.We consider here certain empirical consequences of this hypothesis, looking at key findings of the NSS literature and conduction studies of curvelets and ridgelets transforms  on synthetic images and real images, to see if the results are consistent with predictions from the slogan.Our first experiment measure the non Gaussianity of Fourier, Wavelet Ridgelet and Curvelet coefficients over a database of synthetic and photographic images. Empirically the curvelet coefficients exhibit noticeably high kurtosis than wavelet, ridgelet, or Fourier coefficients. This is consistent with the hypothesis.Our second experiment studies the interscale correlation of the wavelet coefficient energies at the same location. We describe a simple experiment showing that presence of edges explains these correlations. We describe a simple experiment showing that presence of edges explains these correlations.  we also develop a crude nonlinear ´partial correlation´by considering the correlation between wavelet parent and children after a few curvelet coefficients are removed. When we kill the few biggest coefficients of the curvelet transform , much of the correlation between wavelet sub-bands disappears consistent with the hypothesis.We suggest implications for future discussions about NSS.