retinal fundus images provide rich information of pathological changes which may indicate diseases such as arteriosclerosis , diabetes , hypertension , stroke , and cardiovascular disease .
. however , the retinal fundus images are usually with low contrast , uneven illumination , and blur of the details due to the complex imaging environments .
the purpose of retinal fundus image enhancement is to improve the contrast and highlight the retinal vessels .
histogram equalization ( he )   is a popular method to improve image contrast , but the decreasing of the gray levels may result in the loss of image details . to overcome this deficiency , contrast limited adaptive histogram equalization ( clahe ) is proposed .
but the clahe method may produce artificial boundaries at the region which has an abrupt change in the gray levels .
proposed an image enhancement method based on a wavelet - based homomorphic filter , which can improve image contrast and dynamic range .
however , it is difficult to find a suitable structuring element for the morphological filter .
oh and hwang   proposed an image enhancement method based on morphology - based homomorphic filter and differential evolution algorithm .
but the target image region should be input firstly , which may limit the scope of its application .
u. qidwai and u. qidwai   proposed a retinal image enhancement method based on the blind deconvolution approach using maximum likelihood estimation . and this deconvolution approach showed a promising result , which may be used for clinical application .
used a 2d gabor filter to enhance retinal fundus image , which could detect the vessels in multidirection .
proposed an image enhancement method based on multiscale top - hat transformation . in this method , the image details
used a complex diffusion - based shock filter for retinal image smoothing and contrast enhancement . and this method outperformed other methods on the diaretdb1 database .
used a hybrid model of multiscale top - hat transformation and histogram fitting stretching to enhance retinal fundus image , which could enhance the contrast of the retinal image effectively and highlight the retinal vessels well .
but some parameters have to be set cautiously in the part of histogram fitting stretching . in this paper ,
a retinal image enhancement method was proposed to avoid producing artificial boundaries , abrupt changes in color levels , and the loss of image detail .
first , we used normalized convolution with a domain transform to obtain an image containing the basic information of the original image .
then , the image containing the basic information was fused with the original image to enhance vessels and detail of the retinal fundus image .
experimental results of three well - known databases are used to demonstrate the effectiveness of the proposed method . finally , in section 4 , the conclusion is presented .
it is very difficult to enhance retinal fundus images directly due to the uneven illumination of imaging characteristic . so different from commonly used image enhancement methods which enhance retinal fundus image directly ,
the proposed method firstly obtained an image with the basic information of the background through some process of the original image and then fused this image with the original image to suppress background to achieve the goal of image enhancement .
as the image enhancement process is realized by background suppression , the proposed method may reduce occurrence probability of artificial boundaries , abrupt changes in color levels , and the loss of image detail .
we used the normalized convolution with a domain transform proposed by gastal and oliveira   to obtain a background image with the basic information and then fused the image with the original image to achieve retinal fundus image enhancement .
lastly , the fused image was denoised by the fourth order pdes   and the relaxed median filter .
normalized convolution   uses neighbor information to model the image pixel of the original image . in
, normalized convolution was used to obtain edge - preserving smoothed images with a domain transform box kernel .
but if doing some variation for the parameters , the smoothing method can produce an image with the basic information of the background of the retinal fundus image , which does not focus on edge - preserving .
let i represent the original retinal fundus image , and p = ( xp , yp ) denotes the position of a pixel in the original image i , and i(p ) = ( rp , gp , bp ) denotes the pixel value in the 2d rgb color image .
d( ) denotes the domain of p , that is , p  d( ) .
then the normalized convolution with a domain transform is as follows : ( 1)jp=1kpqdiqhtp^,tq^,kp=qdhtp^,tq^,where kp is the normalization factor for p. and t(p^ ) is a domain transform.(2)tp^=ctp0p1+srk=13ikxdx , where ik(x ) is the derivative of kth channel of the retinal color image and s and r are standard deviation of typically gaussian spatial and range filters . as the domain transform ct(x ) is monotonically increasing , an efficient moving - average approach   is used to perform nc with a box filter h(t(p^),t(q^ ) ) .
the box kernel is defined as follows : ( 3)htp^,tq^=tptqr , r=h3,hi=h32ni4n1,where hi is the standard deviation for the kernel used in the ith iteration , n is the total number of iterations , and h is the standard iteration of the desired kernel . in the above section
, we obtained the background image with basic information . in order to obtain an enhancement result , we fuse the background image with the original image . the fusing result is defined as(4)p = iaji , where p is the enhancement result and j and i are the image with the basic information of the background ( represented as j(p ) in section 2.1 ) and the original image , respectively . and a is a parameter factor which could determine the contrast of the image .
noise may be amplified in image fusion step , so some noise suppression process should be done to obtain the enhanced image .
the second order pdes can do high quality denoising , yet the methods tend to cause blocky effects .
the function is as follows : ( 5)pt=2c2p2p;when we get p/t , representing the difference between original image and the denoised imaging containing noise information , we reduced the noise information to get the denoising , where c(|p| ) is as follows : ( 6)cp=11+p / k2,where k was set to be 1 .
the image processed by the fourth order pdes may also reserve some noise , so the relaxed median filter can be used to smooth the image further . assuming that the image processed by the fourth order pdes can be represented as ppde , the function is given as follows : ( 7)prelax_m = rm,wi , j = ppdei , jif  ppdei , jwi , jwi , j,wi , jmotherwise , where [ w(i , j)](m ) is the median value of the samples inside the window w(i , j ) . and
the sliding window w(i , j ) at the window located at the point is as follows:(8)wi , j = ppdei+r , j+r : rw .
in this section , three public databases are used to test the proposed method , namely , the drive database , the stare database , and the diaretdb1 database .
this database is divided into two sets  a training set and a testing set , which is captured using the 45-degree field - of - view digital fundus camera .
the stare database , originally collected by hoover et al . , contains 20 color retinal images with the size of 700  605 pixels , which is captured using the 35-degree field - of - view digital fundus camera .
, contains 89 color retinal images with the size of 1500  1152 pixels , which is captured using the 50-degree field - of - view digital fundus camera .
there are two parameters , s and r , in ( 2 ) of the normalized convolution with a domain transform , and there is one parameter a in ( 4 ) of the image fusion . in order to determine the parameters s and r in ( 2 )
, we changed the values of s and r to test which values are suitable for retinal image enhancement .
as the characteristic of retinal image is relatively stable , an original retinal image which is randomly chosen from the drive database is enhanced by the domain transform and the normalized convolution algorithm with different values of s and r ( s = 1 , 10 , 30 , 60 , 100 , 150 and r = 0.1 , 0.2 , 0.4 , 0.6 , 1 , 1.5 ) . here ,
a is set as 5 randomly . in figure 1 , the parameter r changes by column , and the parameter s changes by row .
from the bottom right corner of figure 1 , we can see that , as the parameters s and r increase , the background of the retinal image is overenhanced gradually and the vessels in the optic disk are missing gradually .
as a compromise , we choose s as 60 and r as 0.4 in this paper . in order to determine the parameter a in ( 4 ) , we varied the value of a to test which value is suitable for retinal image enhancement . the original retinal image which is randomly chosen from the drive database is enhanced by the domain transform and the normalized convolution algorithm with different value of a ( a = 1 , 3 , 5 , 8 , 10 ) . here ,
figure 2(a ) is an original retinal image and figures 2(b)2(f ) are the enhanced images with the different value of a ( a = 1 , 3 , 5 , 8 , 10 ) .
figures 2(b)-2(c ) showed that some dim regions of the original image are not well enhanced . in figures 2(e)-2(f ) , the image is overenhanced and the vessel regions are very clear , but many noises are also produced .
the image and the vessel regions are efficiently enhanced in figure 2(d ) , and fewer noises are produced .
so the enhancement result of figure 2(d ) may be a better result , so we let a = 5 . 

figure 3(a ) is the original retinal image which is randomly chosen from the drive database .   figure 3(b ) is the background image obtained by normalized convolution with a domain transform with the parameter s being 60 and r being 0.4 .  
figure 3(c ) is the image fusing result with the parameter a being 5 .  
figure 3(e ) is the green channel of figure 3(a ) , and figure 3(f ) is the green channel of figure 3(d ) . comparing figure 3(d ) with figure 3(a )
the subregions of the images in figure 3 are used to show the denoising effects .  
figure 4(a ) is the subregion of figure 3(c ) , and figure 4(b ) is the subregion of figure 3(d ) .  
figures 5 and 6 show the image enhancement results of a randomly selected image from the stare database and the diaretdb1 database , respectively .
figures 5(a)5(f ) are the original image from the stare database , the normalized convolution result , the fusion result , the denoising result , the green channel of original image , and the green channel of denoising result , respectively .
similarly , figures 6(a)6(f ) are the original image from the diaretdb1 database , the normalized convolution result , the fusion result , the denoising result , the green channel of original image , and the green channel of denoising result , respectively .
there are two main ways to evaluate image enhancement effects : one is subjective evaluation and the other is objective evaluation .
the subjective evaluation is done by observing the enhancement by experts or persons with image evaluation experience .
the advantage of subjective evaluation is that the evaluation results are more in line with the purpose of image enhancement , but the disadvantage is that the subjective evaluation may vary from person to person , and it is a problem how to quantify the evaluation .
the objective evaluation methods can quantitatively evaluate the image enhancement results , but it is difficult for the indicator of the objective evaluation methods to reflect human 's subject perception .
so we compare the image enhancement results with other methods using both the subjective evaluation and the objective evaluation methods to evaluate the image enhancement results . as vessel
is important information in retinal fundus image , two objective evaluating methods are used to quantify the quality of the enhanced image .
one method is used to quantify the enhancement of the retinal vessels , and the other is used to quantify the enhancement of the whole image .
the measure is called the contrast improvement index , which is defined as follows:(9)cii = cenc , where cen and c are the contrast values for the retinal vessel in the enhanced image and the original image , respectively . here
, the values of cen and c are calculated without the pixels of the black background points outside the pupil . here
, c is defined as follows:(10)c = fbf+b , where f and b are the average gray values of the retinal vessels and the non - vessel regions , respectively .
it is obvious that a larger value of c means a larger difference between the retinal vessels and the non - vessel regions .
cen can be calculated in the same way as c , and the difference is just the fact that the image used to produce cen is the enhanced image . it should be pointed out that the manually segmented retinal vessels of the original image should be available using this method .
the measure is called linear index of fuzziness , which is defined as follows:(11)rfen=2mnx=1my=1nminpxy,1pxy , pxy = sin21fx , yfmax , where fmax is the maximum value of the whole image with size m  n. a larger value of cii shows that the retinal vessels are enhanced better . and
a smaller value of r shows that the whole enhanced image is clearer and has less noise .
therefore , a large value of cii and a small value of r indicate a good image enhancement method .
so only the green channel of the enhanced image is used in image evaluation step .
the image enhancement results of figure 3(e ) with other methods , such as he , clahe , and the methods in [ 7 , 9 ] , are shown in figure 7 . figures 7(a)7(d ) are the enhancement result using he , the enhancement result using clahe , the enhancement result using method in , and the enhancement result using method in , respectively .  
table 1 shows the comparison of cii and r corresponding to different image enhancement results of figure 3(e ) .
it is shown that the proposed method has a larger value of cii and a relatively smaller value of r comparing with the other methods .
it should be pointed out that before calculating cii and r of the image shown in figure 7(d ) it is inverted for the purpose of comparing all the methods at the same condition that the vessels appear darker than the background .
three retinal images randomly chosen from the drive database are also used to compare image enhancement results shown in figure 8 . the first column ( figure 8(a ) ) is the green channel of each original image .
the middle four columns ( figures 8(b)8(e ) ) are the enhancement results of the he , the clahe , and the methods in [ 7 , 9 ] , respectively .
the last column is the results of the proposed method . from the comparison of image enhancement results
, we can see that the he method produces uneven background image which changed the illumination distribution of the original image , and the low - contrast region is not enhanced well .
so many details would be missed by using the he method as shown in figure 8(b ) .
the clahe method could enhance the details of the retail image , but the whole contrast is not improved significantly as shown in figure 8(c ) .
the results of using the method in   are too dim as shown in figure 8(d ) .
the image enhancement results using the method in   lose the details of the background as shown in figure 8(e ) .
the values of cii and r of each image in figure 8 are shown in table 2 .
it shows that the retinal vessels are enhanced better and the whole image is clearer using the proposed method as shown in figure 8(f ) .
the image enhancement results for pathological retinal fundus images chosen from the stare database are shown in figure 9 . the first column ( figure 9(a ) ) is the green channel of each original image .
the middle four columns ( figures 9(b)9(e ) ) are the enhancement results of the he , the clahe , and the methods in [ 7 , 9 ] , respectively .
the last column is the results of the proposed method as shown in figure 9(f ) .
it shows that the proposed method not only enhances the retinal vessels and makes the whole image clearer , but also enhances the pathological regions well .
the values of cii and r of each image in figure 9 are shown in table 3 .
it shows that the proposed method could perform better than the other methods on the pathological images .
the comparison of line charts of cii and r values for the images of drive database is shown in figure 10 .
figures 10(a)-10(b ) are the results using the 20 images in the testing set of drive database . and
figures 10(c)-10(d ) are the results using all the 40 images of drive database including testing set ( 20 images ) and training set ( 20 images ) . in figures 10(a)10(d ) , the x - axis denotes the sequence number of the image , and the y - axis denotes the value of cii and r of the different methods . by the same token , figures 11(a ) and 11(b )
show the line charts of the values of cii and r of the different methods used to enhance retinal fundus images of the stare database , respectively .
it is shown from figures 10 and 11 that the proposed method achieved the largest cii , which indicates that the proposed method is the best in enhancing the retinal vessels . and
the value of r of the proposed method is nearly second small comparing with the other methods , which indicates that the whole image is comparatively clearer after enhancement using the proposed method .
the enhancement performance of the proposed method on both normal and pathological retinal images is comparatively better .
( 1 ) the edges of the vessels change softly and do not cause artificial edges as there are not abrupt changes in the image containing basic information .
( 2 ) as the enhanced image is obtained by fusing the image with basic information of the background and the original image , there is no main detail losing . ( 3 ) a proper noise reduction filter is used to depress the noise caused by the fusing step .
the running times of different methods were calculated on a computer with windows 7 os , a dual core 3.40  ghz cpu , 4  gb of ram , under matlab r2012 software .
the average running time comparisons of different methods on the drive database and stare database are shown in tables 4 and 5 , respectively .
it is shown from the two tables that the fastest method is the he method and the most time consuming method is the proposed method on both the drive database and stare database
. the proposed method needs to do some time consuming processes such as domain transform , convolution , the fourth order pdes , and the relaxed median filter to achieve image enhancement , which makes the proposed method consume much more average running time than all the other methods . as running time
is also a very important factor in clinical application , this is an obvious defect of the proposed method . in the future , if we can find another fast image denoising method suitable for removing the noise caused by image fusion , the running time may be reduced to some extent .
in this paper , a retinal image enhancement method fusing original image and the image containing the basic information of the background is presented .
the proposed method is tested on the retinal images of the drive database , the stare database , and the diaretdb1 database , respectively .
two objective evaluation indexes ( cii and r ) which could measure both the contrast and clarity of the enhanced image are used .
the cii value of the proposed method is distinctly the largest and the r value is the second smallest in all the compared methods on the drive and the stare databases .
it is shown that the proposed method achieves a much better performance on enhancing retinal fundus image comparing with the other methods .
moreover , different from other image enhancement methods mentioned above , the proposed method can handle color images which may be more beneficial to diagnosis by the ophthalmologists .
 retinal fundus image plays an important role in the diagnosis of retinal related diseases 
 . the detailed information of the retinal fundus image such as small vessels , microaneurysms , and exudates may be in low contrast , and retinal image enhancement usually gives help to analyze diseases related to retinal fundus image . 
 current image enhancement methods may lead to artificial boundaries , abrupt changes in color levels , and the loss of image detail . in order to avoid these side effects , 
 a new retinal fundus image enhancement method is proposed . 
 first , the original retinal fundus image was processed by the normalized convolution algorithm with a domain transform to obtain an image with the basic information of the background . 
 then , the image with the basic information of the background was fused with the original retinal fundus image to obtain an enhanced fundus image . 
 lastly , the fused image was denoised by a two - stage denoising method including the fourth order pdes and the relaxed median filter . 
 the retinal image databases , including the drive database , the stare database , and the diaretdb1 database , were used to evaluate image enhancement effects . 
 the results show that the method can enhance the retinal fundus image prominently . and , different from some other fundus image enhancement methods 
 , the proposed method can directly enhance color images . 
1. Introduction
2. Materials and Methods
3. Results and Discussion
4. Conclusions