## OCT Fingerprints: Resilience to Presentation Attacks

## Tarang Chugh and Anil K. Jain Department of Computer Science and Engineering

## Michigan State University, East Lansing, Michigan 48824

{ chughtar, jain @cse.msu.edu }

## Abstract

Optical coherent tomography (OCT) fingerprint technology provides rich depth information, including internal fingerprint (papillary junction) and sweat (eccrine) glands, in addition to imaging any fake layers (presentation attacks) placed over finger skin. Unlike 2D surface fingerprint scans, additional depth information provided by the crosssectional OCT depth profile scans are purported to thwart fingerprint presentation attacks. We develop and evaluate a presentation attack detector (PAD) based on deep convolutional neural network (CNN). Input data to CNN are local patches extracted from the cross-sectional OCT depth profile scans captured using THORLabs Telesto series spectraldomain fingerprint reader. The proposed approach achieves a TDR of 99 73% . @FDR of 0 2% . on a database of 3 413 , bonafide and 357 PA OCT scans, fabricated using 8 different PA materials. By employing a visualization technique, known as CNN-Fixations, we are able to identify the regions in the OCT scan patches that are crucial for fingerprint PAD detection.

(b) 2-D Finger OCT Depth Profile

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-37d3eaee-a44a-4b72-bf44-240726c4f934.jpg)

## 1. Introduction

Fingerprint recognition based authentication systems have become ubiquitous with its footprint in a plethora of different applications such as mobile payments [3], access control [55], international border crossing [1] and national ID [4]. While the primary purpose of a fingerprint recognition system is to ensure a reliable and accurate user authentication, the security of the recognition system itself can be jeopardized by presentation attacks 1 [37, 46].

Most of the fingerprint recognition systems based on traditional readers (e.g., FTIR and capacitive technology) rely upon the friction ridge information on the finger surface

1 The ISO standard IEC 30107-1:2016(E) [28] defines presentation attacks as the 'presentation to the biometric data capture subsystem with the goal of interfering with the operation of the biometric system'.

Figure 1. Different layers of a finger (stratum corneum, epidermis, papillary junction, and dermis) are distinctly visible in a OCT finger scan, along with helical shaped eccrine sweat glands in (a) 3-D finger OCT volume and (b) 2-D finger OCT depth profile. Note that (a) and (b) are OCT scans of different fingers. Image (a) is taken from [16], and (b) is captured using THORLabs Telesto series (TEL1325LV2) SD-OCT scanner [2].

( i.e. stratum corneum). This makes them highly prone to be fooled by presenting fabricated objects (presentation attack instruments or PAIs) with accurate imitation of another individual's bonafide 2 fingerprint ridge-valley structures [39]. Commonly available and inexpensive materials, such as play-doh, gelatin, wood glue, etc., have been uti-

2 In the literature, the term live fingerprint has been primarily used to refer a bonafide fingerprint juxtaposed to spoof fingerprints. However, in the context of all forms of presentation attacks, bonafide fingerprint is a more appropriate term as some PAs such as fingerprint alterations also exhibit characteristics of liveness.

Table 1. Existing studies on OCT-based fingerprint presentation attack detection.

| Study                             | Approach                                                                                                                                                                                                   | OCT Technology                                                         | Database                                                                              | Comments                                                                 |
|-----------------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|------------------------------------------------------------------------|---------------------------------------------------------------------------------------|--------------------------------------------------------------------------|
| Cheng et al., 2006 [11]           | Averaged B-scan slices to generate 1D depth profile; performed auto-correlation analysis; B-scan is 2.2mm in depth and 2.4mm laterally                                                                     | Imalux Corp. Time-domain OCT; capture time: 3s                         | 8 bonafide (8 fingers of one subject) and 10-20 impressions per PA, four PA materials | Manual inspection of auto-correlation response                           |
| Cheng et al., 2007 [12]           | Extended [11] by combining 100 B-Scans to create 3D representation; anisotropic resolution (4762 dpi, 254 dpi)                                                                                             | Imalux Corp. Time-domain OCT; capture time: 300s for 100 scans         | One bonafide finger, one PA                                                           | Visual analysis of 3D representation                                     |
| Bosen et al., 2010 [9]            | Used fingerprint COTS for matching 3D OCT scans; scanned volume: 14mm x 14mm x 3mm; discussed detection of eccrine glands for PAD                                                                          | THORLabs Swept-source OCT (OCS1300SS); capture time: 20s for 3D volume | 153 impressions from 51 fingers for identification experiment; one PA material.       | Visual analysis for PAD; identification performance: FRR = 5% @FAR=0.01% |
| Liu et al., 2010 [34]             | Mapped subsurface eccrine glands with sweat pores on finger surface; exhibited repeatable matching of fingerprints based on sweat pores; discussed absence of sweat pores for fingerprint PAD              | Custom Spectral-domain OCT; capture time: 4min for 3D volume           | Nine bonafide impressions from three fingers, two PA materials                        | Visual analysis of eccrine glands for PAD                                |
| Nasiri- Avanaki et al., 2011 [44] | Used a dynamic focus en-Face OCT to detect any layer placed over finger skin; discussed Doppler OCT to detect blood flow and sweat production for liveness detection                                       | Custom en-Face OCT; capture time is not reported.                      | One bonafide finger, one PA                                                           | Visual analysis of one bonafide finger and one sellotape PA              |
| Liu et al., 2013 [33]             | Auto-correlation analysis between adjacent B-Scans to determine blood flow in micro-vascular pattern                                                                                                       | Swept-source OCT; capture time: 20s                                    | One bonafide with and w/o inhibited blood flow                                        | Exhibited repeatable signs of vitality                                   |
| Meissner et al., 2013 [40]        | Detected number of helical eccrine gland ducts to distinguish bonafide vs PA, scanned volume: 4.5mm x 4mm x 2mm                                                                                            | Swept-source OCT; capture time is not reported.                        | Bonafide: 7 , 458 images, cadavers: 330 images, PA: 2 , 970 images                    | Manual PAD: 100% ; automated PAD: bonafide: 93% and PA: 74% success rate |
| Darlow et al., 2016 [18]          | Detected double bright peaks in depth profile for thin PAs and autocorrelation analysis for thick PAs; 2 different resolutions; scanned volume: 13mm x 13mm x 3mm (500dpi) and 15mm x 15mm x 3mm (867 dpi) | THORLabs Swept-source OCT (OCS1300SS); capture time: 20s for 3D volume | Bonafide: 540 scans from 15 subjects, PA: 28 scans; one PA material + sellotape       | PAD accuracy: 100%                                                       |
| Darlow et al., 2016 [17]          | Measured ridge frequency consistency of the internal fingerprint in non-overlapping blocks;                                                                                                                | THORLabs Swept-source OCT (OCS1300SS)                                  | Bonafide: 20 scans, PA 20 scans; one PA material                                      | PAD accuracy: 100%                                                       |
| Liu et al., 2019 [32]             | Analyzed order and magnitude of bright peaks in 1-D depth signals to detect PAs with different thickness; scanned volume: 15mm x 15mm x 1.8mm                                                              | Custom Spectral-domain OCT                                             | Bonafide: 30 scans from 15 subjects, PA: 60 scans; four PA materials                  | Contact-based (glass platen) OCT scanner; PAD accuracy: 100%             |
| Proposed Approach                 | Trained a deep CNN model using overlapping patches extracted from detected finger depth profile in B-Scans; B-scan is 1.8mm in depth and 14mm laterally                                                    | THORLabs Spectral-domain OCT (TEL1325LV2); capture time: < 1 s         | Bonafide: 3,413 scans from 415 subjects, PA: 357 scans, eight PA materials            | Five-fold cross-validation; TDR = 99.73% @FDR=0.2%                       |

lized to fabricate fingerprint PAIs, capable of circumventing a fingerprint recognition system security with a reported success rate of more than 70% [8, 15]. Such deception may permit unauthorized access to an impostor.

competition held in 2019 [47]. Generally, PAs can be detected by either: (i) software-based approaches, i.e. extract features from the captured fingerprint image [43, 35, 37], or (ii) hardware-based approaches, i.e. using sensor(s) to gather evidence of the liveness of the subject [30, 51, 26].

Given the increasing possibilities to realize presentation attacks (PAs), there is now an urgent requirement for robust PAD as a first line of defense to ensure the security of a fingerprint recognition system. In response to this, a series of fingerprint Liveness Detection (LivDet) competitions [23] have been held since 2009 to advance state-of-the-art and benchmark the proposed PAD solutions, with the latest

Software-based solutions typically work with the grayscale surface fingerprint image (or a sequence of images) captured by a typical contact-based FTIR or capacitive fingerprint reader. The software-based approaches have explored (i) hand-crafted features , such as anatomical [38], physiological [36], and texture-based [22, 24],

Figure 2. Direct view images with red arrows presenting the scanned line and the corresponding cross-sectional B-scan for a (a) bonafide and a (b) pigmented ecoflex presentation attack.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-5dc12d05-55d9-450f-b184-0b6289c04468.jpg)

and (ii) learned features via CNN [45, 49, 14, 21]. In the case of hardware-based approaches, special types of sensors are proposed to detect the characteristics of vitality, such as blood flow [30], skin distortion [5], odor [7], skin color using multi-view reader [19], sub-surface fingerprint imaging using multispectral reader [57, 51], and imaging internal finger structure using optical coherence tomography (OCT) [26].

Optical coherence tomography (OCT) [27] technology allows non-invasive, high-resolution, cross-sectional imaging of internal tissue microstructures by measuring their optical reflections. Optical analogue to Ultrasound [59], it utilizes low-coherence interferometry of near-infrared light ( 900 nm -1325 nm ) and is widely used in biomedical applications, such as ophthalmology [50], oncology [25], dermatology [58] as well as applications in art conservation [31] and fingerprint presentation attack detection [41]. In an OCT scanner, a beam of light is split into a sample arm , i.e. a unit containing the object of interest, and a reference arm i.e. , a unit containing a mirror to reflect back light without any alteration. If the reflected light from the two arms are within coherence distance, it gives rise to an interference pattern representing the depth profile at a single point, also known as A-scan . Laterally combining a series of Ascans along a line can provide a cross-sectional scan, also known as B-scan (see Figs. 1 (b) and 2). Stacking multiple B-scans together can provide a 3D volumetric representation of the scanned object, or the object of our interest i.e. internal structure of a finger (see Figure 1 (a)).

The human skin is a layered tissue with the outermost layer known as epidermis and the external-facing sublayer of epidermis, where the friction ridge structure exists, is known as stratum corneum . The layer below epidermis is known as dermis , and the junction between epidermis and dermis layers is known as papillary junction . The development of friction ridge patterns on papillary junction, which starts as early as in 10-12 weeks of gestation, results into the formation of surface fingerprint on stratum corneum [6]. The surface friction ridge pattern scanned by traditional (optical and capacitive) fingerprint readers are merely an instance or a projection of the, so to say, a master print existing on the papillary junction. There also exist helically shaped ducts in epidermis layer connecting the eccrine (sweat) glands in dermis to the sweat pores on surface. See Figure 1.

Since OCT enables imaging the 3D volumetric morphology of the skin tissue, including the subsurface fingerprint and other internal structures, it has great potential in detecting fingerprint presentation attacks. Existing fingerprint PAD studies in the literature have explored various OCT technologies such as time-domain, fourier-domain, and spectral domain, and developed hand crafted features to detect correlation between the skin layers, blood flow, eccrine glands, compute consistency in ridge frequency. These studies are summarized in Table 1. In this study, we utilize local patches ( 150 × 150 ) extracted from the automatically segmented finger depth profile from input B-scan images to train a deep convolutional neural network.

The main contributions of this paper are:

- 1. Proposed a deep convolutional neural network based PAD approach trained on local patches containing finger depth profile from cross-sectional B-Scans.
- 2. Evaluated the proposed approach on a database of 3,413 bonafide and 357 PA OCT B-scans fabricated using 8 different PA materials and achieved a TDR of 99.73% @ FDR of 0.2% for PAD.
- 3. Identified the regions in the OCT scan patches that are crucial for fingerprint PAD detection by employing a visualization technique, known as CNN-Fixations .

## 2. Proposed Approach

The proposed PAD approach includes two stages, an offline training stage and an online testing stage. The offline training stage involves (i) preprocessing the OCT images (noise removal and image enhancement), (ii) detecting region-of-interest ( i.e. finger depth profile), (iii) extracting local patches from the region-of-interest (ROI), (iv) and training CNN models on the extracted local patches. During the online testing stage, the final spoof detection decision is made based on the average of spoofness scores output from the CNN model for each of the extracted patches. An overview of the proposed approach is presented in Figure 3.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-4eeaa839-299a-45a2-82ab-8a7fb86fac44.jpg)

(150 x 150)

Figure 3. An overview of the proposed fingerprint presentation attack detection approach utilizing local patches extracted from the segmented depth profiles from OCT B-scans.

## 2.1. Preprocessing

Optical Coherent Tomography (OCT) 2D scans are grayscale images with height = 1024 pixels and width = 1900 pixels (see Figs. 4 and 5). These images contain gaussian noise which makes the extraction of region-of-interest (finger depth profile) by simple thresholding prone to errors. We employ Non-Local Means denoising [10] that removes noise by replacing the intensity of a pixel with an average intensity of the similar pixels that may not be present close to each other (non-local) in the image. An optimized opencv python implementation 3 of Non-Local Means denoising, cv2.fastNlMeansDenoising() , is used with filterStrength = 20 , templateWindowSize = 7 , and searchWindowSize = 21 . After de-noising, a morphological operation of image dilation [20], with the kernel size of 5 × 5 , is applied to enhance the image.

## 2.2. Otsu's Binarization

The characteristic differences between a bonafide and a presentation attack OCT image are primarily discernible in the finger depth profile region as shown in Figure 4. The pixel intensity histograms for the grayscale 2D OCT images are bimodal, with the first peak (high intensity values) referring to the finger depth profile region, while the second peak (low intensity values) referring to the background region. In order to segment out the finger depth profile, we apply Otsu's thresholding [48] which finds an adaptive threshold, in the middle of the two peaks, to successfully binarize the input OCT images as shown in Figure 3.

3 https://opencv-python-tutroals.readthedocs.io/ en/latest/py\_tutorials/py\_photo/py\_non\_local\_ means/py\_non\_local\_means.html

Bonafide Finger 2D OCT Depth Profile

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-1c6a63b4-4ac7-4c2c-839f-a5b8fab4b2c8.jpg)

Presentation Attack 2D OCT Depth Profile

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-4577bb7e-356a-46b5-8266-2fa08f6f5173.jpg)

Figure 4. Depth profile of a bonafide finger manifests a layered tissue anatomy quite distinguishable from the depth profile of a presentation attack without any specific structure.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-894997e4-04de-4bf2-bc8b-cd55128b5e8a.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-8b963c8a-1bd0-48bb-ac06-d92b73afe2e9.jpg)

Bonafide Samples

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-705ec6d9-be1b-4a7d-aaa7-bd6de40865f6.jpg)

PA Samples

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-343734fe-559c-42a1-ba11-55ea3f53fc93.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-83ae9d77-1149-4b5f-902b-1c5b181fe2cd.jpg)

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-08adfc55-a2db-4227-ae07-cbb132e5b512.jpg)

- (a) Ballistic Gelatin

(b) Elmer's Glue

(c) Conductive Silicone

Figure 5. Examples of bonafide and presentation attack samples from the OCT fingerprint database utilized in this study.

## 2.3. Local Patch Extraction

Table 2. Summary of the OCT database used in this study.

The binarized image generated after Otsu's binarization is raster scanned, with a stride of 30 pixels (in both x and y -axis), to identify the possible candidates for patch extraction. At each scanned pixel, a window of size 9 × 9 is evaluated and if more than 25% of the pixels ( 20 out of 81 pixels) in the window have non-zero values, the pixel is marked as a candidate for extracting a local patch. This rule is applied to guarantee sufficient depth information in the extracted patches. After the patch candidates are selected, a maximum of 60 local patches of size 150 × 150 are extracted from the original image around the patch candidates. If there are more than 60 candidates, the topmost candidates from each column ( i.e. the points closest to the surface fingerprint) are selected first, before moving to the next row. With the image width of 1900 pixels and a stride of 30 pixels, a maximum of 60 patches are sufficient to provide at least one pass of stratum corneum . The patches are extracted such that the candidate is located at (50 75) , in the 150 × 150 patch. This ensures that the extracted patches cover stratum corneum, epidermis, and papillary junction regions as shown in Figure 3.

## 2.4. Convolution Neural Networks

With the success of AlexNet [29] in ILSVRC-2012 [52], different deep CNN architectures have been proposed in literature, such as VGG, GoogleNet (Inception), Inception v2v4, MobileNet, and ResNet. In this study, we utilize the

| Fingerprint Presentation Attack Material   | #Images   |
|--------------------------------------------|-----------|
| Ballistic Gelatin                          | 34        |
| Clear Ecoflex                              | 7         |
| Tan Ecoflex                                | 49        |
| Yellow Pigmented Silicone                  | 57        |
| Flesh Pigmented Ecoflex                    | 36        |
| Nusil R-2631 Conductive Silicone           | 128       |
| Flesh Pigmented PDMS                       | 42        |
| Elmer's Glue                               | 1         |
| Bandaid                                    | 3         |
| Total PAs                                  | 357       |
| Total Bonafide                             | 3,413     |

Inception-v3 [56] architecture which has exhibited state-ofthe-art performance in patch-based fingerprint presentation attack detection [13, 14]. Our experimental results show that training the models from scratch, using local patches, performs better than fine-tuning a pre-trained network on image patches from other domains (e.g. FTIR fingerprint images).

We utilized the TF-Slim library 4 implementation of the Inception-v3 architecture. The last layer of the architectures, a 1000 -unit softmax layer (originally designed to

4 https://github.com/tensorflow/models/tree/ master/research/slim

classify a query image into one of the the 1 000 , classes of ImageNet dataset) was replaced with a 2 -unit softmax layer for the two-class problem, i.e. Bonafide vs. PA. The output from the softmax layer is in the range [0 , 1] , defined as Spoofness Score . The larger the spoofness score, the higher the likelihood that the input patch belongs to the PA class. For an input test image, the spoofness scores corresponding to each of the local patches, extracted from the input image, are averaged to give a Global Spoofness Score . The optimizer used to train the network was RMSProp, with a batch size of 32, and an adaptive learning rate with exponential decay, starting at 0.01 and ending at 0.0001. Data augmentation techniques, such as random cropping, brightness adjustment, horizontal and vertical flipping, are employed to ensure the trained model is robust to the possible variations in fingerprint images.

Figure 6. Setup of a THORLabs Telesto series Spectral-domain OCT scanner (TEL1325LV2). Image taken from [2].

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-bdc3c6ea-e3af-4371-888a-596262803f2c.jpg)

## 3. Experimental Results

## 3.1. Presentation Attack OCT Database

A database of 3 413 , bonafide and 357 presentation attack (PA) 2D OCT scans is utilized in this study. These scans are captured using THORLabs Telesto series (TEL1325LV2) Spectral-domain OCT scanner [2] (see Figure 6). Table 2 lists the eight PA materials and the corresponding number of scans for each material type. Figure 5 presents few samples of bonafide and PA scans from this database. This dataset is collected at John Hopkins University Applied Physics Lab 5 as part of a large-scale evaluation under IARPA ODIN Project [46] on Presentation Attack Detection.

## 3.2. Results

The proposed approach is evaluated using five-fold cross-validation. Table 3 presents the training and test-

5 https://www.jhuapl.edu/

Table 3. Summary of the five-fold cross-validation and the performance achieved using Inception-v3 model.

| Fold    | # Images (Bonafide / PA)   | # Images (Bonafide / PA)   | TDR (%) @FDR=0.2%   |
|---------|----------------------------|----------------------------|---------------------|
| Fold    | Training                   | Testing                    | TDR (%) @FDR=0.2%   |
| I       | (2,730 / 281)              | (683 / 76)                 | 100 . 00            |
| II      | (2,730 / 283)              | (683 / 74)                 | 98 . 63             |
| III     | (2730 / 288)               | (683 / 71)                 | 100 . 00            |
| IV      | (2731 / 289)               | (682 / 70)                 | 100 . 00            |
| V       | (2731 / 288)               | (682 / 71)                 | 100 . 00            |
| Average | Average                    | Average                    | 99.73 (s.d. = 0.55) |

Figure 7. ROC curves for the five-fold cross-validation experiments. The red curve represents the average performance with grayed region reflecting the confidence interval of one standard deviation.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-286cfcd7-c8c3-4dd9-96c7-8600138fe929.jpg)

ing set details for each fold 6 , along with the achieved PA True Detection Rate (%) @ False Detection Rate = 0 2% . . The selection of this metric is based on the requirements of IARPA ODIN program [46] and represents the percentage of PAs able to breach the biometric system security when the reject rate of legitimate users ≤ 0 2% . . Note that the proposed approach achieves an avg. TDR = 99 73% . (s.d. = 0 55 . ) @ FDR = 0 2% . for the five folds. Figure 7 presents the ROC curves for each of the five folds. In fold-II, only one bonafide scan was misclassified as PA due to incorrect segmentation.

## 3.3. On understanding the learnings of CNN

CNNs have revolutionized computer vision and machine learning research achieving unprecedented performance in many tasks. But these are usually treated as 'black boxes' shedding little light on their internal workings and without answering how they achieve high performance. One way

6 Note that all PA types are uniformly distributed among the five folds without repetition, therefore Elmer's Glue and Bandaid which have less than five samples are missing from some folds.

Figure 8. Patches ( 150 × 150 ) from bonafide and PA OCT B-scans input to the model are presented. The detected CNN-Fixations and a heat map presenting the density of CNN-Fixations are also shown. A high density of fixations are observed along the stratum corneum (surface fingerprint) and at papillary junction in both bonafide and PA patches.

![image](https://ac.marcodsn.me/arxiv-markdown-images/1908.00102v1-figure-31d77b53-f768-4efa-9fb8-a1a24386d901.jpg)

to gain insights into what CNNs learn is through visual exploration, i.e. to identify the image regions that are responsible for the final predictions. Towards this, visualization techniques [54, 53, 42] have been proposed to supplement the class labels predicted by CNN, in our case bonafide or PA, with the discriminated image regions (or saliency maps) exhibiting class-specific patterns learned by CNN architectures. The visualization technique proposed in [42] exploits the learned feature dependencies between consecutive layers of a CNN to identify the discriminative pixels, called CNN-Fixations , in the input image that are responsible for the predicted label. We utilize this visualization technique to understand the representation learning of our CNN models and identify the crucial regions in OCT images responsible for final predictions. Figs. 8 presents CNN-Fixations and the corresponding density heatmaps for two bonafide and two PA image patches that are correctly classified. We observe that there is a high density of fixations along stratum corneum and at papillary junction, suggesting that these are definitely crucial regions in distinguishing bonafide vs PA OCT patches. Note that the only misclassified sample in Fold-II was due to incorrect segmentation, otherwise it would be useful to observe the CNN-Fixations that led to an incorrect prediction.

## 4. Conclusions

The penetrative power of optical coherent tomography (OCT) to image the internal tissue structure of human skin in a non-invasive manner presents a great potential to investigate robustness against fingerprint presentation attacks. We propose and demonstrate a learning-based approach to differentiate between bonafide (live) and eight different types of presentation attacks (spoofs). The proposed approach utilizes local patches automatically extracted from the finger depth profile in 2D OCT B-scans to train an Inception-v3 network model. Our experimental results achieve a TDR of 99 73% . @FDRof 0 2% . on a database of 3 413 , bonafide and 357 PA scans. The crucial regions in the input images for PAD learned by the CNN models, namely stratum corneum and papillary junction , are identified using a visualization technique. In future, we will evaluate the generalization ability of the proposed approach against novel materials that are not seen by the model during training.

## 5. Acknowledgement

This research is based upon work supported in part by the Office of the Director of National Intelligence (ODNI), Intelligence Advanced Research Projects Activity (IARPA),

via IARPA R&amp;D Contract No. 2017 - 17020200004. The views and conclusions contained herein are those of the authors and should not be interpreted as necessarily representing the official policies, either expressed or implied, of ODNI, IARPA, or the U.S. Government. The U.S. Government is authorized to reproduce and distribute reprints for governmental purposes notwithstanding any copyright annotation therein.

## References

- [1] Office of Biometric Identity Management Identification Services. https://www.dhs.gov/ obim-biometric-identification-services , 2016.
- [2] THORLabs Telesto series (TEL1325LV2) Spectraldomain OCT scanner. https://www.thorlabs. com/catalogpages/Obsolete/2017/ TEL1325LV2-BU.pdf , 2017.
- [3] Apple Pay: Payment authorization using Touch ID. https://www.apple.com/business/site/ docs/iOS\_Security\_Guide.pdf , May 2019.
- [4] Unique Identification Authority of India: Dashboard, Govt. of India. https://uidai.gov.in/aadhaar\_ dashboard/ , 2019.
- [5] A. Antonelli, R. Cappelli, D. Maio, and D. Maltoni. Fake Finger Detection by Skin Distortion Analysis. IEEE Transactions on Information Forensics and Security , 1(3):360373, 2006.
- [6] W. Babler. Embryologic Development of Epidermal Ridges and their Configurations. Birth Defects Original Article Series , 27(2):95-112, 1991.
- [7] D. Baldisserra, A. Franco, D. Maio, and D. Maltoni. Fake Fingerprint Detection by Odor Analysis. In Proc. International Conference on Biometrics (ICB) , pages 265-272. Springer, 2006.
- [8] B. Biggio, Z. Akhtar, G. Fumera, G. L. Marcialis, and F. Roli. Security Evaluation of Biometric Authentication Systems under Real Spoofing Attacks. IET Biometrics , 1(1):11-24, 2012.
- [9] A. Bossen, R. Lehmann, and C. Meier. Internal Fingerprint Identification with Optical Coherence Tomography. IEEE Photonics Technology Letters , 22(7):507-509, 2010.
- [10] A. Buades, B. Coll, and J.-M. Morel. Non-local Means Denoising. Image Processing On Line , 1:208-212, 2011.
- [11] Y. Cheng and K. V. Larin. Artificial Fingerprint Recognition by using Optical Coherence Tomography with Autocorrelation Analysis. Applied Optics , 45(36):9238-9245, 2006.
- [12] Y. Cheng and K. V. Larin. In Vivo Two-and Threedimensional Imaging of Artificial and Real Fingerprints With Optical Coherence Tomography. IEEE Photonics Technology Letters , 19(20):1634-1636, 2007.
- [13] T. Chugh, K. Cao, and A. K. Jain. Fingerprint Spoof Detection Using Minutiae-based Local Patches. In Proc. IEEE IJCB , pages 581-589, 2017.
- [14] T. Chugh, K. Cao, and A. K. Jain. Fingerprint Spoof Buster: Use of Minutiae-centered Patches. IEEE Transactions on Information Forensics and Security , 13(9):2190-2202, 2018.
- [15] T. Chugh and A. K. Jain. Fingerprint presentation attack detection: Generalization and efficiency. arXiv preprint arXiv:1812.11574 , 2018.
- [16] L. N. Darlow, J. Connan, and A. Singh. Performance Analysis of a Hybrid Fingerprint Extracted from Optical Coherence Tomography Fingertip Scans. In Proc. International Conference on Biometrics (ICB) , pages 1-8, 2016.
- [17] L. N. Darlow, A. Singh, Y. Moolla, R. Ramokolo, R. Van Wyk, N. Botha, and L. Webb-Ray. Damage Invariant and High Security Acquisition of the Internal Fingerprint using Optical Coherence Tomography. World Congress on Internet Security , 2016.
- [18] L. N. Darlow, L. Webb, and N. Botha. Automated Spoofdetection for Fingerprints using Optical Coherence Tomography. Applied Optics , 55(13):3387-3396, 2016.
- [19] J. J. Engelsma, K. Cao, and A. K. Jain. Raspireader: Open Source Fingerprint Reader. IEEE Transactions on Pattern Analysis &amp; Machine Intelligence , 2018.
- [20] D. A. Forsyth and J. Ponce. Computer Vision: A Modern Approach . Prentice Hall, 2002.
- [21] R. Gajawada, A. Popli, T. Chugh, A. Namboodiri, and A. K. Jain. Universal Material Translator: Towards Spoof Fingerprint Generalization. In IEEE International Conference on Biometrics (ICB) , 2019.
- [22] L. Ghiani, A. Hadid, G. L. Marcialis, and F. Roli. Fingerprint Liveness Detection using Binarized Statistical Image Features. In Proc. IEEE BTAS , pages 1-6, 2013.
- [23] L. Ghiani, D. A. Yambay, V. Mura, G. L. Marcialis, F. Roli, and S. A. Schuckers. Review of the Fingerprint Liveness Detection (LivDet) competition series: 2009 to 2015. Image and Vision Computing , 58:110-128, 2017.
- [24] D. Gragnaniello, G. Poggi, C. Sansone, and L. Verdoliva. Local Contrast Phase Descriptor for Fingerprint Liveness Detection. Pattern Recognition , 48(4):1050-1058, 2015.
- [25] M. R. Hee, C. A. Puliafito, C. Wong, J. S. Duker, E. Reichel, B. Rutledge, J. S. Schuman, E. A. Swanson, and J. G. Fujimoto. Quantitative Assessment of Macular Edema with Optical Coherence Tomography. Archives of Ophthalmology , 113(8):1019-1029, 1995.
- [26] J. N. Hogan. Optical Coherence Tomography Array Based Subdermal Imaging Device, 2019. US Patent App. 16/225,278.
- [27] D. Huang, E. A. Swanson, C. P. Lin, J. S. Schuman, W. G. Stinson, W. Chang, M. R. Hee, T. Flotte, K. Gregory, C. A. Puliafito, et al. Optical Coherence Tomography. Science , 254(5035):1178-1181, 1991.
- [28] International Standards Organization. ISO/IEC 301071:2016, Information Technology-Biometric Presentation Attack Detection-Part 1: Framework. https://www.iso.org/standard/53227.html, 2016.
- [29] A. Krizhevsky, I. Sutskever, and G. E. Hinton. ImageNet Classification with Deep Convolutional Neural Networks. In Proc. NIPS , pages 1097-1105, 2012.
- [30] P. D. Lapsley, J. A. Lee, D. F. Pare Jr, and N. Hoffman. Anti-fraud Biometric Scanner that Accurately Detects Blood Flow, 1998. US Patent 5,737,439, 1998.

- [31] H. Liang, M. G. Cid, R. G. Cucu, G. Dobre, A. G. Podoleanu, J. Pedro, and D. Saunders. En-face Optical Coherence Tomography-a Novel Application of Non-invasive Imaging to Art Conservation. Optics Express , 13(16):6133-6144, 2005.
- [32] F. Liu, G. Liu, and X. Wang. High-accurate and Robust Fingerprint Anti-spoofing System using Optical Coherence Tomography. Expert Systems with Applications , 130:31-44, 2019.
- [33] G. Liu and Z. Chen. Capturing the Vital Vascular Fingerprint with Optical Coherence Tomography. Applied Optics , 52(22):5473-5477, 2013.
- [34] M. Liu and T. Buma. Biometric Mapping of Fingertip Eccrine Glands with Optical Coherence Tomography. IEEE Photonics Technology Letters , 22(22):1677-1679, 2010.
- [35] E. Marasco and A. Ross. A Survey on Antispoofing Schemes for Fingerprint Recognition Systems. ACM Computing Surveys , 47(2):28, 2015.
- [36] E. Marasco and C. Sansone. Combining Perspiration-and Morphology-based Static Features for Fingerprint Liveness Detection. Pattern Recognition Letters , 33(9):1148-1156, 2012.
- [37] S. Marcel, M. S. Nixon, and S. Z. Li, editors. Handbook of Biometric Anti-Spoofing . Springer, 2014.
- [38] G. L. Marcialis, F. Roli, and A. Tidu. Analysis of Fingerprint Pores for Vitality Detection. In Proc. 20th ICPR , pages 1289-1292, 2010.
- [39] T. Matsumoto, H. Matsumoto, K. Yamada, and S. Hoshino. Impact of Artificial Gummy Fingers on Fingerprint Systems. In Proc. SPIE , volume 4677, pages 275-289, 2012.
- [40] S. Meissner, R. Breithaupt, and E. Koch. Defense of Fake Fingerprint Attacks using a Swept Source Laser Optical Coherence Tomography Setup. In Frontiers in Ultrafast Optics: Biomedical, Scientific, and Industrial Applications XIII , volume 8611. SPIE, 2013.
- [41] Y. Moolla, L. Darlow, A. Sharma, A. Singh, and J. Van Der Merwe. Optical Coherence Tomography for Fingerprint Presentation Attack Detection. In Handbook of Biometric Anti-Spoofing , pages 49-70. Springer, 2019.
- [42] K. R. Mopuri, U. Garg, and R. V. Babu. CNN Fixations: An Unraveling Approach to Visualize the Discriminative Image Regions. IEEE Transactions on Image Processing , 28(5):2116-2125, 2018.
- [43] V. Mura, G. Orr` u, R. Casula, A. Sibiriu, G. Loi, P. Tuveri, L. Ghiani, and G. L. Marcialis. LivDet 2017 Fingerprint Liveness Detection Competition 2017. In Proc. ICB , pages 297-302, 2018.
- [44] M.-R. Nasiri-Avanaki, A. Meadway, A. Bradu, R. M. Khoshki, A. Hojjatoleslami, and A. G. Podoleanu. Antispoof Reliable Biometry of Fingerprints using En-face Optical Coherence Tomography. Optics and Photonics Journal , 1(03):91-96, 2011.
- [45] R. F. Nogueira, R. de Alencar Lotufo, and R. C. Machado. Fingerprint Liveness Detection Using Convolutional Neural Networks. IEEE Transactions on Information Forensics and Security , 11(6):1206-1213, 2016.
- [46] ODNI, IARPA. IARPA-BAA-16-04 (Thor). https://www.iarpa.gov/index.php/ research-programs/odin/odin-baa , 2016.
- [47] G. Orr` u, R. Casula, P. Tuveri, C. Bazzoni, G. Dessalvi, M. Micheletto, L. Ghiani, and G. L. Marcialis. LivDet in Action-Fingerprint Liveness Detection Competition 2019. arXiv preprint arXiv:1905.00639 , 2019.
- [48] N. Otsu. A Threshold Selection Method from Gray-level Histograms. IEEE Transactions on Systems, Man, and Cybernetics , 9(1):62-66, 1979.
- [49] F. Pala and B. Bhanu. Deep Triplet Embedding Representations for Liveness Detection. In Deep Learning for Biometrics , pages 287-307. Springer, 2017.
- [50] C. A. Puliafito, M. R. Hee, C. P. Lin, E. Reichel, J. S. Schuman, J. S. Duker, J. A. Izatt, E. A. Swanson, and J. G. Fujimoto. Imaging of Macular Diseases With Optical Coherence Tomography. Ophthalmology , 102(2):217-229, 1995.
- [51] R. K. Rowe and D. P. Sidlauskas. Multispectral biometric sensor, 2006. US Patent 7,147,153.
- [52] O. Russakovsky, J. Deng, H. Su, J. Krause, S. Satheesh, S. Ma, Z. Huang, A. Karpathy, A. Khosla, M. Bernstein, et al. Imagenet Large Scale Visual Recognition Challenge. Proc. IJCV , 115(3):211-252, 2015.
- [53] R. R. Selvaraju, M. Cogswell, A. Das, R. Vedantam, D. Parikh, and D. Batra. Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localization. In Proc. IEEE ICCV , pages 618-626, 2017.
- [54] K. Simonyan, A. Vedaldi, and A. Zisserman. Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Maps. arXiv preprint arXiv:1312.6034 , 2013.
- [55] C. W. Swonger, D. M. Bowers, and R. M. Stock. Fingerprintbased Access Control and Identification Apparatus, 1980. US Patent 4,210,899.
- [56] C. Szegedy, V. Vanhoucke, S. Ioffe, J. Shlens, and Z. Wojna. Rethinking the Inception Architecture for Computer Vision. In Proc. IEEE CVPR , pages 2818-2826, 2016.
- [57] R. Tolosana, M. Gomez-Barrero, J. Kolberg, A. Morales, C. Busch, and J. Ortega-Garcia. Towards Fingerprint Presentation Attack Detection Based on Convolutional Neural Networks and Short Wave Infrared Imaging. In Proc. BIOSIG , pages 1-5, 2018.
- [58] J. Welzel. Optical Coherence Tomography in Dermatology: A Review. Skin Research and Technology: Review article , 7(1):1-9, 2001.
- [59] J. J. Wild and J. M. Reid. Application of Echo-ranging Techniques to the Determination of Structure of Biological Tissues. Science , 115(2983):226-230, 1952.
Tarang Chugh Anil K. Jain
OCT Fingerprints: Resilience to Presentation Attacks
Optical coherent tomography (OCT) fingerprint technology provides rich depth
information, including internal fingerprint (papillary junction) and sweat
(eccrine) glands, in addition to imaging any fake layers (presentation attacks)
placed over finger skin. Unlike 2D surface fingerprint scans, additional depth
information provided by the cross-sectional OCT depth profile scans are
purported to thwart fingerprint presentation attacks. We develop and evaluate a
presentation attack detector (PAD) based on deep convolutional neural network
(CNN). Input data to CNN are local patches extracted from the cross-sectional
OCT depth profile scans captured using THORLabs Telesto series spectral-domain
fingerprint reader. The proposed approach achieves a TDR of 99.73% @ FDR of
0.2% on a database of 3,413 bonafide and 357 PA OCT scans, fabricated using 8
different PA materials. By employing a visualization technique, known as
CNN-Fixations, we are able to identify the regions in the OCT scan patches that
are crucial for fingerprint PAD detection.