Retinal image analysis: Concepts, applications and potential

https://doi.org/10.1016/j.preteyeres.2005.07.001Get rights and content

Abstract

As digital imaging and computing power increasingly develop, so too does the potential to use these technologies in ophthalmology. Image processing, analysis and computer vision techniques are increasing in prominence in all fields of medical science, and are especially pertinent to modern ophthalmology, as it is heavily dependent on visually oriented signs. The retinal microvasculature is unique in that it is the only part of the human circulation that can be directly visualised non-invasively in vivo, readily photographed and subject to digital image analysis. Exciting developments in image processing relevant to ophthalmology over the past 15 years includes the progress being made towards developing automated diagnostic systems for conditions, such as diabetic retinopathy, age-related macular degeneration and retinopathy of prematurity. These diagnostic systems offer the potential to be used in large-scale screening programs, with the potential for significant resource savings, as well as being free from observer bias and fatigue. In addition, quantitative measurements of retinal vascular topography using digital image analysis from retinal photography have been used as research tools to better understand the relationship between the retinal microvasculature and cardiovascular disease. Furthermore, advances in electronic media transmission increase the relevance of using image processing in ‘teleophthalmology’ as an aid in clinical decision-making, with particular relevance to large rural-based communities.

In this review, we outline the principles upon which retinal digital image analysis is based. We discuss current techniques used to automatically detect landmark features of the fundus, such as the optic disc, fovea and blood vessels. We review the use of image analysis in the automated diagnosis of pathology (with particular reference to diabetic retinopathy). We also review its role in defining and performing quantitative measurements of vascular topography, how these entities are based on ‘optimisation’ principles and how they have helped to describe the relationship between systemic cardiovascular disease and retinal vascular changes. We also review the potential future use of fundal image analysis in telemedicine.

Introduction

The retina is the only location where blood vessels can be directly visualised non-invasively in vivo. Increasing technology leading to the development of digital imaging systems over the past two decades has revolutionised fundal imaging. Whilst digital imaging does not still have the resolution of conventional photography, modern digital imaging systems offer very high-resolution images that are sufficient for most clinical scenarios (Facey et al., 2002; Fransen et al., 2002; Hansen et al., 2004b; Klein et al., 2004a; van Leeuwen et al., 2003). In addition, digital imaging has the advantage of easier storage on media that do not deteriorate in quality with time, can be transmitted over short distances throughout a clinic or over large distances via electronic transfer (allowing expert “at-a-distance” opinion in large rural communities), can be processed to improve image quality, and subjected to image analysis to perform objective quantitative analysis of fundal images and the potential for automated diagnosis. In the research or screening setting, large databases of fundal images may be automatically classified and managed more readily than labour-intensive observer-driven techniques. Automated diagnosis may also aid decision-making for optometrists.

In this review, we outline the principles upon which retinal digital image analysis is based. We discuss current techniques used to automatically detect landmark features of the fundus, such as the optic disc, fovea and blood vessels. We review the use of image analysis in the automated diagnosis of pathology (with particular reference to diabetic retinopathy). We also review its role in defining and performing quantitative measurements of vascular topography, how these entities are based on ‘optimisation’ principles and how they have helped to describe the relationship between systemic cardiovascular disease and retinal vascular changes. We also review the potential future use of fundal image analysis in telemedicine. Whilst this technology can be employed for other image acquisition modalities, such as confocal scanning laser ophthalmoscopes (cSLO) (Deckert et al., 2005), ultrasound (Schachar and Kamangar, 2005) and optical coherence tomography (Yanuzzi et al., 2004), in this article we concentrate solely on image processing based on fundal colour photography and fluorescein angiography.

Section snippets

Principle of digital image capture, processing and analysis

Digital images are made up in such a way that makes them accessible to simple and complex mathematical manipulation. For black and white images (grey scale) at any given locus of pixel, typically there is a corresponding intensity on a range from 0 (black) to 255 (white) (28 for 8-bit images) {for 12-bit images, there are 4096 grey levels (212), etc.}. Hence, the image is composed of an array of pixels of varying intensity across the image, the intensity corresponding to the level of “greyness”

Automated localisation (segmentation) of retinal landmarks

A potential use of fundal digital image analysis is the ability to analyse a large database of fundal images in a short period of time. The identification of fundal landmark features such as the optic disc, fovea and the retinal vessels as reference co-ordinates is a prerequisite before systems can achieve more complex tasks identifying pathological entities. Reliable techniques exist for identification of these structures in retinal photographs.

Automated detection of pathology using retinal digital image analysis

Automated diagnosis of retinal fundal images using digital image analysis offers huge potential benefits. In a research setting, it offers the potential to examine a large number of images with time and cost savings and offer more objective measurements than current observer-driven techniques. Advantages in a clinical context include the potential to perform large numbers of automated screening for conditions such as diabetic retinopathy, and hence to reduce the workload required from manual

Quantitative measurements from Fundal images

An important role of retinal digital image analysis is the ability to perform quantitative objective measurements from retinal colour photographs. However, the effect of image magnification resultant from fundal photography has to be overcome, either incorporating an adjusted measurement to take the magnification into account, or to use dimensionless measurements so that results between patients can be compared.

Digital retinal vascular image analysis and telemedicine

Because ophthalmology is largely dependent on visual information, it is an ideal specialty for telemedicine (Constable et al., 2000; Lamminen et al., 2003; Murdoch, 1999; Yogesan et al., 1998). Digital capture of images and the potential for transmission of these images via electronic transfer across large distances with subsequent image analysis offers the potential for more efficacious use of medical resources in large, rural communities that may otherwise have difficulty obtaining expert

Future directions

Retinal digital image analysis is able to exploit the ease with which the retinal circulation can be visualised, photographed, and analysed non-invasively in vivo. Using objective, quantitative measures from retinal vasculature which are based on principals of optimisation of a branching vasculature, studies have been able to improve our understanding of the effect of systemic factors on the microvasculature. The most commonly performed quantitative measurement from digital retinal vascular

References (232)

  • P.H. Gregson et al.

    Automated grading of venous beading

    Comput. Biomed. Res.

    (1995)
  • T. Griffith et al.

    Basal EDRF activity helps to keep the geometrical configuration of arterial bifurcations close to the Murray optimum

    J. Theor. Biol.

    (1990)
  • W. Hart et al.

    Measurement and classification of retinal vascular tortuosity

    Int. J. Med. Inf.

    (1999)
  • C. Heneghan et al.

    Characterization of changes in blood vessel and tortuosity in retinopathy of prematurity using image analysis

    Med. Image Anal.

    (2002)
  • J.V. Hodge et al.

    Comparison of methods of measuring vessel widths on retinal photographs and the effect of fluorescein injection on apparent vessel calibers

    Am. J. Ophthalmol.

    (1969)
  • L.D. Hubbard et al.

    Methods for evaluation of retinal microvascular abnormalities associate with hypertension/sclerosis in the Atherosclerosis Risk in Communities Study

    Ophthalmology

    (1999)
  • M. Ibanez et al.

    Bayesian detection of the fovea in eye fundus angiographies

    Pattern Recogn. Lett.

    (1999)
  • H. Kalviainen et al.

    Probabilistic and non-probabilistic Hough transforms

    Image Vision Comput.

    (1995)
  • M. Kiani et al.

    Computer simulation of growth of anastomosing microvascular networks

    J. Theor. Biol.

    (1991)
  • R. Klein et al.

    Retinal vascular abnormalities in persons with type 1 diabetes: the Wisconsin Epidemiologic Study of Diabetic Retinopathy: XVIII

    Ophthalmology

    (2003)
  • S. Aldington et al.

    Methodology for retinal photography and assessment of diabetic retinopathy—the EURODIAB IDDM complications study

    Diabetologia

    (1995)
  • A. Amos et al.

    The rising global burden of diabetes and its complications: estimates and projections to the year 2010

    Diabet. Med.

    (1997)
  • J.V. Arnold et al.

    Possible errors in the measurement of retinal lesions

    Invest. Ophthalmol. Vis. Sci.

    (1993)
  • A. Avakian et al.

    Fractal analysis of region-based vascular change in the normal and non-proliferative diabetic retina

    Curr. Eye Res.

    (2002)
  • R. Baer et al.

    Retinal vessel responses to passive tilting

    Eye

    (1990)
  • A. Barthes et al.

    Mathematical morphology in computerized analysis of angiograms in age-related macular degeneration

    Med. Phys.

    (2001)
  • A. Basu et al.

    Is digital image compression acceptable within diabetic retinopathy screening

    Diabet. Med.

    (2003)
  • C. Bellmann et al.

    Fundus autofluorescence imaging compared with different confocal scanning laser ophthalmoscopes

    Br. J. Ophthalmol.

    (2003)
  • B. Bengtsson

    The variation and covariation of cup and disc diameters

    Acta Ophthalmol. (Copenh.)

    (1976)
  • B. Bengtsson et al.

    Some essential optical features of the Zeiss fundus camera

    Acta Ophthalmol. (Copenh.)

    (1977)
  • B. Bengtsson et al.

    Correction of optic disc measurements on fundus photographs

    Graefe's Arch. Clin. Exp. Ophthalmol.

    (1992)
  • A. Bennett et al.

    Improvements on Littman's method of determining the size of retinal features by fundus photography

    Graefe's Arch. Clin. Exp. Ophthalmol.

    (1994)
  • J. Bezdek et al.

    Fuzzy Model and Algorithms for Pattern Recognition and Image Processing

    (1999)
  • R. Bowman et al.

    Reliability of telemedicine for diagnosing and managing eye problems in accident and emergency departments

    Eye

    (2003)
  • D. Bracher et al.

    Measurement of vessel width on fundus photographs

    Albrecht Von Graefes Arch. Klin. Exp. Ophthalmol.

    (1979)
  • O. Brinchmann-Hansen

    The light reflex on retinal arteries and veins. A theoretical study and a new technique for measuring width and intensity profiles across retinal vessels

    Acta Ophthalmol.

    (1986)
  • A. Burgess

    Objective measurements of the retinal vessels

    Ann. Intern. Med.

    (1967)
  • M.J. Burnier

    Telemedicine and tele-ophthalmology

    Can. J. Ophthalmol.

    (2003)
  • A. Can et al.

    A feature-based technique for joint, linear estimation of high-order image-to-mosaic transformations: application to mosaicing the curved human retina

    Comput. Vis. Pattern Recogn.

    (2000)
  • J. Canny

    A computational approach to edge detection

    IEEE Trans. Pattern Anal. Mach. Intell.

    (1986)
  • J. Capowski et al.

    A numerical index based on spatial frequency for the tortuosity of retinal vessels and its application to plus disease in retinopathy of prematurity

    Retina

    (1995)
  • N. Chapman et al.

    Retinal vascular network architecture in low birth weight males

    J. Hypertens.

    (1997)
  • N. Chapman et al.

    Acute effects of oxygen and carbon dioxide on retinal vascular network geometry in hypertensive and normotensive subjects

    Clin. Sci.

    (2000)
  • N. Chapman et al.

    Computer algorithms for the automated measurement of retinal arteriolar diameters

    Br. J. Ophthalmol.

    (2001)
  • N. Chapman et al.

    Peripheral vascular disease is associated with abnormal arteriolar diameter relationships at bifurcations in the human retina

    Clin. Sci.

    (2002)
  • Chaudhuri, S., Chatterjee, S., Katz, N., Nelson, M., Goldbaum, M., 1989a. Automatic detection of the optic nerve in...
  • S. Chaudhuri et al.

    Detection of retinal blood vessels in retinal images using two-dimensional matched filters

    IEEE Trans. Med. Imag.

    (1989)
  • H.C. Chen et al.

    Vessel diameter changes during the cardiac cycle

    Eye

    (1994)
  • A. Cideciyan et al.

    Registration of high resolution images of the retina

    Proc. SPIE

    (1992)
  • I. Constable et al.

    Fred Hollows lecture: digital screening for eye disease

    Clin. Exp. Ophthalmol.

    (2000)
  • Cited by (0)

    View full text