Focus recovery based on the linear canonical transform

Focus recovery from a defocused image is an ill-posed problem since it loses the component of high frequency. Most of the methods for focus recovery are based on depth estimation theory.^[1] The Linear canonical transform (LCT) gives a scalable kernel to fit many well-known optical effects. Using LCTs to approximate an optical system for imaging and inverting this system, theoretically permits recovery of a defocused image.

Depth of field and perceptual focus

In photography, depth of field (DOF) means an effective focal length. It is usually used for stressing an object and deemphasizing the background (and/or the foreground). The important measure related to DOF is the lens aperture. Decreasing the diameter of aperture increases focus and lowers resolution and vice versa.

The Huygens–Fresnel principle and DOF

The Huygens–Fresnel principle describes diffraction of wave propagation between two fields. It belongs to Fourier optics rather than geometric optics.The disturbance of diffraction depends on two circumstance parameters, the size of aperture and the interfield distance.

Consider a source field and a destination field, field 1 and field 0, respectively. P₁(x₁,y₁) is the position in the source field, P₀(x₀,y₀) is the position in the destination field. The Huygens–Fresnel principle gives the diffraction formula for two fields U(x₀,y₀), U(x₁,y₁) as following:

{\mathbf U}(x_{0},y_{0})={\frac {1}{j\lambda }}\int \!\int {\mathbf U}(x_{1},y_{1}){\frac {e^{{jkr_{{01}}}}}{r_{{01}}}}\cos \theta dx_{1}dy_{1}

where θ denotes the angle between $r_{{01}}$ and $z$ . Replace cosθ by ${\frac {r_{{01}}}{z}}$ and $r_{{01}}$ by
$[(x_{0}-x_{1})^{2}+(y_{0}-y_{1})^{2}+z^{2}]^{{1/2}}$

we get

{\mathbf U}(x_{0},y_{0})={\frac {1}{j\lambda z}}\int \!\int {\mathbf U}(x_{1},y_{1}){\frac {\exp(jkz[1+({\frac {x_{0}-x_{1}}{z}})^{2}+({\frac {y_{0}-y_{1}}{z}})^{2}]^{{1/2}})}{1+({\frac {x_{0}-x_{1}}{z}})^{2}+({\frac {y_{0}-y_{1}}{z}})^{2}}}dx_{1}dy_{1}

The further distance z or the smaller aperture (x₁,y₁) causes a greater diffraction. A larger DOF can lead to a more effective focused wave distribution. This seems to be a conflict. Here are the notations:

Diffraction
In a real imaging environment, the depths of objects comparing to the aperture are usually not enough to lead to serious diffraction.

However, a long enough depth of the object can truly blurs the image.

Effective Focus
Small aperture, small blurring radius, few wave information.

Loses details in comparing to a large aperture.

In conclusion, diffraction explains a micro behavior whereas DOF shows a macro behavior. Both of them are related to aperture size.

Linear canonical transform

As the meaning of "canonical", the linear canonical transform (LCT) is a scalable transform that connects to lots of important kernels such as the Fresnel transform, Fraunhofer transform and the fractional Fourier transform. It can be easily controlled by its four parameters, a, b, c, d (3 degrees of freedom). The definition:

L_{M}(f(u))=\int L_{M}(u,u')f(u')du'

where

L_{M}(u,u')={\begin{cases}{\sqrt {\frac {1}{b}}}e^{{-j\pi /4}}e^{{[j\pi ({\frac {d}{b}}u^{2})-2{\frac {1}{b}}uu'+{\frac {a}{b}}u'^{2}]}},&{\mbox{if }}b\neq 0\\{\sqrt {d}}e^{{{\frac {j}{2}}cdu^{2}}}\delta (u'-du),&{\mbox{if }}b=0\end{cases}}

Consider a general imaging system with object distance z₀, focal length of the thin lens f and an imaging distance z₁. The effect of the propagation in freespace acts as nearly a chirp convolution, that is, the formula of diffraction. Besides, the effect of the propagation in thin lens acts as a chirp multiplication. The parameters are all simplified as paraxial approximations while meeting the freespace propagation. It does not consider aperture size.

From the properties of the LCT, it is possible to obtain those 4 parameters for this optical system as:

{\begin{bmatrix}1-{\frac {z_{1}}{f}}\quad &\lambda z_{0}-{\frac {\lambda z_{0}z_{1}}{f}}+\lambda z_{1}\\-{\frac {1}{\lambda f}}\quad &1-{\frac {z_{0}}{f}}\end{bmatrix}}

Once the values of z₁, z₀ and f are known, the LCT can simulate any optical system.

Notes

↑ Most depth recovery methods are simply based on camera focus and defocus. Among those approaches, they usually fall in a depth discontinuity problem.

References

M. Haldun Ozaktas, Zeev Zalevsky and M. Alper Kutay, The fractional Fourier transform with applications in optics and signal processing, JOHN WILEY & SONS, LTD, New York, 2001.
M. Sorel and J. Flusser, "Space-variant restoration of images degraded by camera motion blur", IEEE Transactions on Image Processing, vol. 17, pp. 105–116, Feb. 2008.
Jos. Schneider Optische Werke GmbH, "The way a zoom lens works", Feb. 2008. [Accessed: Mar. 9 2008].
B. Barshan, M. Alper Kutay and H. M. Ozaktas, "Optimal filtering with linear ca-nonical transformations", Optics Communications, vol. 135, pp. 32–36, Feb. 1997.

This article is issued from Wikipedia - version of the 2/12/2016. The text is available under the Creative Commons Attribution/Share Alike but additional terms may apply for the media files.