## S-SYNTH: Knowledge-Based, Synthetic Generation of Skin Images

∗ ∗ ∗

Andrea Kim , Niloufar Saharkhiz , Elena Sizikova , Miguel Lago, Berkman Sahiner, Jana Delfino, and Aldo Badano

Office of Science and Engineering Laboratories Center for Devices and Radiological Health U.S. Food and Drug Administration Silver Spring, MD 20993 USA elena.sizikova@fda.hhs.gov ∗ -These authors contributed equally to this work.

Abstract. Development of artificial intelligence (AI) techniques in medical imaging requires access to large-scale and diverse datasets for training and evaluation. In dermatology, obtaining such datasets remains challenging due to significant variations in patient populations, illumination conditions, and acquisition system characteristics. In this work, we propose S-SYNTH, the first knowledge-based, adaptable open-source skin simulation framework to rapidly generate synthetic skin, 3D models and digitally rendered images, using an anatomically inspired multi-layer, multi-component skin and growing lesion model. The skin model allows for controlled variation in skin appearance, such as skin color, presence of hair, lesion shape, and blood fraction among other parameters. We use this framework to study the effect of possible variations on the development and evaluation of AI models for skin lesion segmentation, and show that results obtained using synthetic data follow similar comparative trends as real dermatologic images, while mitigating biases and limitations from existing datasets including small dataset size, lack of diversity, and underrepresentation.

Keywords: Synthetic Data · Simulation · Dermatology

## 1 Introduction

Robust and generalizable artificial intelligence (AI) for medical applications requires large datasets representative of intended populations and their subgroups, relying on a time-consuming and laborious annotation process by clinical experts (e.g. labeling pixel-level segmentation masks or identifying findings). In this work, we explore the potential of a skin simulation model and the practical utility of resulting synthetic images in development and evaluation of AI-based techniques.

Segmenting and labeling dermatologic images is time-consuming and challenging, and thus public dermatologic datasets generally contain few examples

and may not equitably represent intended patient populations [1,2]. For instance, the majority of the publicly available dermatologic images are associated with lighter skin populations, and dark skin tones are typically under-represented [3]. This class imbalance has shown to negatively affect darker skin tones in skin lesion segmentation tasks [4]. Such challenges may introduce biases in training and evaluation of medical AI devices for dermatologic applications.

To address these limitations, we propose to simulate dermatologic images with a knowledge-based approach [5], where properties of skin and lesions, determined via detailed physics models, along with rendering conditions are systematically varied. We created S-SYNTH, an open-source skin simulation framework for generating synthetic dermatologic images, and show that subgroup analysis using S-SYNTH images closely mimics comparative performance trends in real-patient skin datasets, while mitigating effects of mislabeled examples and limitations of a limited patient evaluation dataset. Our contributions can be summarized as follows:

- -We describe S-SYNTH, an open-source, flexible framework for creation of highly-detailed 3D skin models and digitally rendered synthetic images of diverse human skin tones, with full control of underlying parameters and the image formation process . 1
- -We systematically evaluate S-SYNTH synthetic images for training and testing applications. Specifically, we show S-SYNTH synthetic images improve segmentation performance when only a limited set of real images is available for training. We also show comparative trends between S-SYNTH synthetic images and real-patient examples (according to skin color and lesion size) are similar.

## 2 Related Work

A particular challenge in practical development and evaluation of dermatologic AI is the lack of labeled datasets. Of the few public labeled datasets that exist, only a fraction have fine grained annotations, such as pixel-level segmentation levels for lesions [6] or hair [7]. The annotation process is error-prone and can have large variations across truthers (particularly when datasets are collected for different purposes and no consistent labeling protocol is established). In part due to these annotation difficulties, there is a lack of transparency and potential bias within the datasets used for dermatologic AI studies. A recent investigation found that from a total of 70 unique studies that involved AI models for dermoscopic imaging, only about 7 (10%) included skin tone information for at least one dataset used [8]. Synthetically generated data has been explored to address these challenges. Generative models have been used to create synthetic skin lesions to tackle the class imbalance problem and improve the performance of the skin lesion classifiers [9,10,11] or enhance lesion segmentation [12,13]. Rezk et al.

1 Code and supporting data are available at: https://github.com/DIDSR/ ssynth-release

Fig. 1. Overview of (a) a digital skin model generated in Houdini, and an example projection of 3 different skin lesion volumes at 5 growing time points, (b) digital rendering, with examples of generated synthetic images and their corresponding lesion masks, and (c) distribution of skin tone for real-patient images (ISIC) and synthetic images, as well as application of synthetic images for training and testing of an AI device for a skin lesion segmentation task.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-dc785d3c-d3c9-4494-b8ee-e9c5d9a15239.jpg)

have shown that synthetic skin images generated using style transfer and deep blending improve skin lesion classification accuracy by increasing skin color diversity [14]. More recently, diffusion models have been used to generate synthetic images to improve skin disease classifier performance [15,16]. Nevertheless, use of AI to generate synthetic images is limited by the requirement of constant supervision and adjustment of hyperparameters [9,10], presence of artifacts, such as skin hair or lighting effects, within the original training dataset [13], and a lack of ability to represent all physical and morphological features of disease [14] and image acquisition systems (see [6] for more information).

## 3 S-SYNTH: Skin Simulation Framework

Our approach for generating synthetic skin involves the construction of a 3D digital object model comprising of skin tissue (epidermis, dermis, hypodermis), blood network, hair, and a lesion, as shown in Fig. 1a. This process is implemented and automated in Houdini [17], a software for 3D modeling, animation, and visual effects, via a Python API. Once created, each model is subsequently processed through a research-oriented rendering system, Mitsuba 3 [18], to generate each synthetic rendering (Fig 1b). The approach can be automated to create large databases with controlled variation for various AI analysis applications ((Fig 1c)). In the following sections, we describe the digital skin model and rendering process.

## 3.1 Digital Skin Model

Skin Tissue Each skin sample is created from a multi-layer model, with each layer representing a component of skin tissue. Thicknesses of the topmost two layers are based on values reported in [19]: epidermis (20-150 µm ) and dermis

(1-4 mm). To introduce geometric variability, we incorporated surface roughness (noise) into the top surfaces of epidermis, hypodermis, and papillary dermis (located between the epidermis and dermis). Roughness values were randomized within predefined constraints, enhancing the naturalistic appearance and diversity of the generated skin models.

Blood Network and Hair The blood network model is created by solving a shortest path problem on randomly distributed points within a tetrahedral mesh generated from a primitive cube. Points from the bottom of the cube, corresponding to the lower blood network capillaries, were designated as start points, while those from top of the cube, representing the upper capillaries, were designated as end points. To generate each blood network model, the numbers and positions of starting and ending points were randomized. Hair models were constructed by manipulating hair properties (density, length, distribution, thickness, and curvature) in Houdini to generate a diverse range of hair apprearances.

Growing Lesion Model We developed a probabilistic, growing lesion model that generates a 3D volume with stochastic growth of lesion shape and size, based on [20]. Growth starts with one active cell (i.e., voxel). We define active cells as those cells that exist and can grow at a given time point. Within each time point, we iterated over the active cells c and selected them for growth based on probabilities (see Fig. 2). To control the growing direction, the probability of an active cell to grow outside the skin is set to extremely low, while the probability for inwards growing is set to be high. Probabilities were based on a Gaussian distribution G , and are updated in each time point for added variability.

Fig. 2. Growing direction probabilities for each cell c in the 3D plane. Note that values are zeros in the outwards direction, to avoid the lesion growth outside the skin.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-a18fee58-44ab-408c-9729-8395f27d3893.jpg)

To control for lesion shape irregularity, we set an irregularity probability for each cell C p , which starts C i number of recursive iterations of the same growing algorithm on that cell's location, independent of the regular growth. Irregular cells can themselves trigger another recursive growth up to a maximum of C r recursions. We generated both regular ( C p = 0 0001 . ) and irregular lesions ( C p = 0 001 . ). Sample images of lesions and growth evolution can be seen in Fig 1. Additional details can be found in the Supplementary Material. Once created,

the 3D lesion volume is inserted into the skin tissue model (see [21] for more details).

## 3.2 Rendering and Image Formation

Optical Material Properties Melanosomes are the primary contributors to optical absorption in the epidermis. In the dermis, optical absorption is mainly attributed to blood, while, in the hypodermis, lipid and fat components are the predominant sources of optical absorption. Thus, each skin layer is assigned an optical material, containing the index of refraction (IOR) and the spectral distribution of the absorption and scattering coefficients. Following the methodology established by Jacques et al. [22], we calculated the optical absorption properties for each the four distinct tissue types: epidermis, dermis, hypodermis, and blood. We model reduced scattering of tissue using µ ′ s = a λ/ ( 500) -b , where λ is the light wavelength [23]. Finally, for each skin layer material, we define a surface scattering model using a bidirectional scattering distribution function (BSDF), based on [24].

Lighting and Camera To account for lighting variations, we render each skin model using a collection of High Dynamic Range Imaging (HDRI) images capturing various environmental lighting conditions from [25]. The Volumetric Path Tracer is a rendering algorithm that simulates the paths taken by light as it interacts with the 3D scene. It is particularly effective for scenes with volumetric effects or materials with complex light interactions. Spectral multiple importance sampling is a technique used to address the spectral nature of light. In scenes with materials that exhibit variations in spectral properties (e.g., spectral absorption), this method accounts for the complex interactions of light with materials across different wavelengths, such as those encountered in biological tissues. A perspective sensor with Mitsuba's HDR Film is placed 1.5cm above the skin with a field of view (FOV) of 75 degrees, facing perpendicularly to the top surface of the epidermis. The Integrator (Mitsuba 3's plugin for the rendering technique) is set to Volumetric Path Tracer with spectral multiple importance sampling. We chose this specific configuration due to its ability to simulate spectrally-varying optical properties across varying skin tones in simulated lighting conditions. We use 124 samples per pixel (SPP) and render images at resolution 1024x1024 pixels. Each image and mask take about three minutes to generate on a GPU. Sample generated images can be seen in Fig. 3.

## 3.3 AI Device Description

To demonstrate the usage of S-SYNTH for augmenting real patient data, we experiment with real and synthetic examples on the task of skin lesion segmentation. which is important for timely treatment decisions [26]. We rely on DermoSegDiff [27], a state of the art diffusion-based skin segmentation model,

Fig. 3. Examples of S-SYNTH images generated with variations of (a) melanosome fraction, (b) blood fraction, (c) hair artifact, and (d) lesion shape.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-df2baca4-b182-4090-bfb7-1e407e5a3fa6.jpg)

to differentiate lesions from the background region. We used the 'dsd\_i01' configuration, with dim\_x=16 , dim\_g=8 , and default training parameters. Images were segmented at resolution 128x128, and results were evaluated with Dice coefficient. We trained one model per experiment and reported standard deviation over test images.

Datasets For real-patient datasets, we used two publicly available skin lesion segmentation datasets: ISIC18 [28] (ISIC) and HAM10K [29] (HAM). The same pre-processing and data splits described in [28,30] were applied, where the ISIC and HAM images were divided into (7200, 1800, 1015) and (1815, 259, 520) for the baseline model (training, validation, test), respectively. We used the individual typology angle (ITA) metric [3] to estimate skin tone from the non-lesion area. Finally, to better match lesion sizes across real and synthetic examples, SSYNTH images were cropped to ensure a variety of lesion sizes. With S-SYNTH, we generated 10,000 images with randomized model properties and lighting, and subsequently 19,965 testing images with controlled variation: 5,445 with blood variation, 9,075 with melanosome fraction variation, 3,630 with different lesion regularity, and 1,815 without hair.

## 4 Results and Discussion

We present segmentation performance based on three aspects: impact of training set composition comprising different ratios of real and synthetic images, impact of various physiological or rendering parameters of the synthetic images when used as test set, and impact of specific characteristics of synthetic images that are measurable on real images.

Synthetic Data for Training We systematically evaluated the effect of the training data composition on the real test set performance (similar to the popular Train-Synthetic-Test-Real (TSTR) protocol [31]) on both ISIC and HAM. As

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-3dc883cd-3931-4671-b794-43b3f54dcba7.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-4621d5ab-28ce-4825-891c-3e06d3f9092b.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-461176db-3939-49d9-9225-45daa64de45a.jpg)

- (a) Real data percentage

(b)

Ratio of

real to

syn- thetic

- (c) Ratio of real to synthetic

Fig. 4. Model performance changes when the training data is composed of (a) different numbers of the real images, (b) different proportions of real images replaced with synthetic images (c) different proportions of synthetic images added to real images.

shown in Fig. 4a, performance improved when more real examples are available for training. When real images are replaced with synthetic images, the resulting performance is comparable to that of the baseline model trained on full ISIC (or HAM) training set (Fig. 4b). However, performance dropped when the training set was fully composed of synthetic images, presumably due to the domain shift between the real and synthetic images [32]. More importantly, each model that was trained on a particular subset of the ISIC (or HAM) and supplemented with synthetic images resulted in a higher Dice score than the model that was trained on the same subset of only the real images. Finally, when full training sets were supplemented with synthetic images (Fig. 4c), performance improved for ISIC, but saturated for HAM, likely because ISIC was too small to learn all modes of variation, which synthetic data helped address. We also found that performance for darker skin tones improved with the addition of synthetic examples (see Supplementary Material).

Synthetic Data for Testing To check whether synthetic images can produce meaningful performance trends, we evaluated models trained on real examples using synthetic test images. Performance dropped for increasing blood fraction (Fig. 5a), and increasing melanosome fraction (Fig. 5b) of the S-SYNTH images. Higher melanosome fraction corresponds to darker skin, and the corresponding performance drop is a known bias in dermatologic AI [14]. Models tested on lesions with regular shape exhibited higher performance compared to the ones tested on irregular lesions (Fig. 5c). Similar to [33], we found that presence of hair slightly decreased performance (Fig. 5d).

To assess the similarity between the real and synthetic images in measurable characteristics, we evaluated performance changes as a function of skin color (ITA), lesion circularity, and lesion relative area. Although performance on synthetic images was lower compared to real images, similar trends were observed. Specifically, performance in both synthetic and real examples increased with

lighter skin (Fig. 6a). As illustrated in (Fig. 6b), the impact of lesion circularity on model performance showed similar trends within the circularity range shared between the real and synthetic images, where more circular images were easier to segment. Finally, performance dropped with larger relative lesion areas (Fig. 6c), possibly due to less precise delineations in larger lesions in the training patient data.

Fig. 5. Model performance when trained on real-patient datasets (ISIC, HAM) and tested on synthetic (S-SYNTH) images generated with different parameters. BF: blood fraction, MF: melanosome fraction.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-5facb0e6-fa50-4005-9527-1e4990fdfcb6.jpg)

Fig. 6. Performance as a function of: (a) skin tone, (b) lesion circularity, and (c) relative lesion area for models trained on HAM dataset and tested on real (HAM, ISIC) or synthetic (S-SYNTH) images.

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-998f0b1c-7e79-4b35-afe8-04efcd8841a1.jpg)

Limitations S-SYNTH is the first skin simulation framework that generates synthetic skin images with controllable variations. There are a number of limitations to our work. First, S-SYNTH does not model any specific disease presentation, and additional work needs to be performed to evaluate the realism of the generated examples. Second, the current rendering techniques utilizes an RGB camera setup, and additional modifications allowing for multispectral imaging, when validated, might be useful for more advanced algorithms that use a broader variety of wavelengths.

## 5 Conclusion and Future Work

We presented S-SYNTH, a novel, knowledge-based simulation pipeline for synthetic generation of dermoscopic images and skin lesions. S-SYNTH procedurally generates multi-layer 3D skin models, with consideration to optical skin characteristics, and digitally renders synthetic images under realistic lighting conditions. Using S-SYNTH, we generated realistic and varied skin surface models for sub-surface scattering simulation in the context of skin lesion segmentation, and compared the resulting synthetic images to public dermatologic benchmarks. We showed that examples created using S-SYNTH can be used to augment limited real datasets and identify performance trends.

## References

- 1. Michael L Chen, Veronica Rotemberg, Jenna C Lester, Roberto A Novoa, Albert S Chiou, and Roxana Daneshjou. Evaluation of diagnosis diversity in artificial intelligence datasets: a scoping review. British Journal of Dermatology , 2023.
- 2. Fabian Gröger, Simone Lionetti, Philippe Gottfrois, Alvaro Gonzalez-Jimenez, Matthew Groh, Roxana Daneshjou, Alexander A Navarini, Marc Pouly, Labelling Consortium, et al. Towards reliable dermatology evaluation benchmarks. In Machine Learning for Health (ML4H) . PMLR, 2023.
- 3. Newton M Kinyanjui, Timothy Odonga, Celia Cintas, Noel CF Codella, Rameswar Panda, Prasanna Sattigeri, and Kush R Varshney. Estimating skin tone and effects on classification performance in dermatology datasets. arXiv:1910.13268 , 2019.
- 4. Marin Benčević, Marija Habijan, Irena Galić, Danilo Babin, and Aleksandra Pižurica. Understanding skin color bias in deep learning-based skin lesion segmentation. Computer Methods and Programs in Biomedicine , 2024.
- 5. Aldo Badano, Miguel Lago, Elena Sizikova, Jana G. Delfino, Shuyue Guan, Mark A. Anastasio, and Berkman Sahiner. The stochastic digital human is now enrolling for in silico imaging trials-methods and tools for generating digital cohorts. Progress in Biomedical Engineering , 2023.
- 6. Zahra Mirikharaji, Kumar Abhishek, Alceu Bissoto, Catarina Barata, Sandra Avila, Eduardo Valle, M Emre Celebi, and Ghassan Hamarneh. A survey on deep learning for skin lesion segmentation. Medical Image Analysis , 2023.
- 7. Sk Imran Hossain, Sudipta Singha Roy, Jocelyn De Goër De Herve, Robert E Mercer, and Engelbert Mephu Nguifo. A skin lesion hair mask dataset with finegrained annotations. Data in Brief , 2023.
- 8. Roxana Daneshjou, Mary P Smith, Mary D Sun, Veronica Rotemberg, and James Zou. Lack of transparency and potential bias in artificial intelligence data sets and algorithms: a scoping review. JAMA Dermatology , 2021.
- 9. Christoph Baur, Shadi Albarqouni, and Nassir Navab. Melanogans: high resolution skin lesion synthesis with gans. arXiv:1804.04338 , 2018.
- 10. Kavita Behara, Ernest Bhero, and John Terhile Agee. Skin lesion synthesis and classification using an improved dcgan classifier. Diagnostics , 2023.
- 11. Amirata Ghorbani, Vivek Natarajan, David Coz, and Yuan Liu. Dermgan: Synthetic generation of clinical skin images with pathology. In Machine Learning for Health (ML4H) . PMLR, 2020.

- 12. Yucong Chi, Lei Bi, Jinman Kim, Dagan Feng, and Ashnil Kumar. Controlled synthesis of dermoscopic images via a new color labeled generative style transfer network to enhance melanoma segmentation. In International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) . IEEE, 2018.
- 14. Eman Rezk, Mohamed Eltorki, Wael El-Dakhakhni, et al. Improving skin color diversity in cancer detection: deep learning approach. JMIR Dermatology , 2022.
- 13. Dario Augusto Borges Oliveira. Controllable skin lesion synthesis using texture patches, bézier curves and conditional gans. In International Symposium on Biomedical Imaging (ISBI) . IEEE, 2020.
- 15. Luke W Sagers, James A Diao, Matthew Groh, Pranav Rajpurkar, Adewole S Adamson, and Arjun K Manrai. Improving dermatology classifiers across populations using images generated by large diffusion models. arXiv:2211.13352 , 2022.
- 17. Sidefx: Houdini, 2022. https://www.sidefx.com/docs/houdini/index.html.
- 16. Luke W Sagers, James A Diao, Luke Melas-Kyriazi, Matthew Groh, Pranav Rajpurkar, Adewole S Adamson, Veronica Rotemberg, Roxana Daneshjou, and Arjun K Manrai. Augmenting medical image classifiers with synthetic data from latent diffusion models. arXiv:2308.12453 , 2023.
- 18. Wenzel Jakob, Sébastien Speierer, Nicolas Roussel, Merlin Nimier-David, Delio Vicini, Tizian Zeltner, Baptiste Nicolet, Miguel Crespo, Vincent Leroy, and Ziyi Zhang. Mitsuba 3 renderer, 2022. https://mitsuba-renderer.org.
- 20. Aunnasha Sengupta, Diksha Sharma, and Aldo Badano. Computational model of tumor growth for in silico trials. In Medical Imaging 2021: Physics of Medical Imaging . SPIE, 2021.
- 19. Kenneth A Walters and Michael S Roberts. The structure and function of skin. In Dermatological and Transdermal Formulations . CRC press, 2002.
- 21. Andrea S Kim, Aunnasha Sengupta, and Aldo Badano. Automated animation pipeline for visualizing in silico tumor growth models. In Medical Imaging 2023: Physics of Medical Imaging . SPIE, 2023.
- 23. Ciaran Bench, Andreas Hauptmann, and Ben Cox. Toward accurate quantitative photoacoustic imaging: learning vascular blood oxygen saturation in three dimensions. Journal of Biomedical Optics , 25(8):085003-085003, 2020.
- 22. Steven L Jacques. Optical properties of biological tissues: a review. Physics in Medicine &amp; Biology , 2013.
- 24. Bruce Walter, Stephen R Marschner, Hongsong Li, and Kenneth E Torrance. Microfacet models for refraction through rough surfaces. In Eurographics Conference on Rendering Techniques , 2007.
- 26. Jiacheng Ruan, Mingye Xie, Jingsheng Gao, Ting Liu, and Yuzhuo Fu. Ege-unet: an efficient group enhanced unet for skin lesion segmentation. In International Conference on Medical Image Computing and Computer-Assisted Intervention (MICCAI) . Springer, 2023.
- 25. Poly Haven: the public 3D asset library. https://polyhaven.com/hdris.
- 27. Afshin Bozorgpour, Yousef Sadegheih, Amirhossein Kazerouni, Reza Azad, and Dorit Merhof. Dermosegdiff: A boundary-aware segmentation diffusion model for skin lesion delineation. In International Workshop on PRedictive Intelligence In MEdicine (PRIME) . Springer, 2023.
- 28. Noel Codella, Veronica Rotemberg, Philipp Tschandl, M Emre Celebi, Stephen Dusza, David Gutman, Brian Helba, Aadi Kalloo, Konstantinos Liopyris, Michael Marchetti, et al. Skin lesion analysis toward melanoma detection 2018: A challenge hosted by the international skin imaging collaboration (ISIC). arXiv:1902.03368 , 2019.

- 29. Philipp Tschandl, Cliff Rosendahl, and Harald Kittler. The HAM10000 dataset, a large collection of multi-source dermatoscopic images of common pigmented skin lesions. scientific data. 2018; 5: 180161. Search in , 2018.
- 31. Cristóbal Esteban, Stephanie L Hyland, and Gunnar Rätsch. Real-valued (medical) time series generation with recurrent conditional gans. arXiv:1706.02633 , 2017.
- 30. Reza Azad, Mohammad T Al-Antary, Moein Heidari, and Dorit Merhof. Transnorm: Transformer provides a strong spatial normalization mechanism for a deep segmentation model. IEEE Access , 2022.
- 32. Hao Guan and Mingxia Liu. Domain adaptation for medical image analysis: a survey. IEEE Transactions on Biomedical Engineering , 2021.
- 33. Wei Li, Alex Noel Joseph Raj, Tardi Tjahjadi, and Zhemin Zhuang. Digital hair removal by deep learning for skin lesion segmentation. Pattern Recognition , 2021.

## 6 Supplementary Materials

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-a742fa6d-1ea0-4875-9517-7048f8e3054e.jpg)

Fig. 7. Distribution of skin tone category based on the mean ITA score of the nondiseased region for (a) HAM dataset with 10015 images, (b) ISIC dataset with 2594 images, and (c) S-SYNTH dataset with 10000 images. The categories are estimated based on [3], however, the examples categorized as "dark" and "tan1" are combined due to the limited number of examples in each group for the real-patient datasets.

Table 1. Assigned values and probabilities to the skin growing lesion parameters.

| Growing step             | S ∼ U (1 , 2)          |
|--------------------------|------------------------|
| Probabilities update     | G ( µ = 0 , σ = 0 . 5) |
| Cancer probability       | C p = 0.0001           |
| Cancer iterations        | C i = 10               |
| Maximum cancer recursion | C r = 2                |

Fig. 8. Examples of S-SYNTH images generated with variations of (a) lighting conditions, (b) samples per pixel (SPP).

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-a841430c-1973-4440-b874-791904bdc7e6.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-352741f1-45b9-46f1-98ec-6246325bde21.jpg)

(a) Examples of uncropped (top row) cropped S-SYNTH images (bottom row)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-a0ee7f62-e9b9-44cf-b65c-d32a6c9fefad.jpg)

and (b) Distribution of lesion relative area and lesion circularity for the real and synthetic images

Fig. 9. (a) Visualization of S-SYNTH images before and after random crop of 0-60% of the original image size around the center (b) Distribution of lesion relative area and lesion circularity for a subset of HAM (500 images), ISIC (259 images), S-SYNTH before cropping (500 images), and S-SYNTH after cropping (500 images).

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-d9aa9de5-4bdf-4b2f-9099-920f033a8796.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-5f5a1320-2e1d-4ef1-9f1c-4509a7023197.jpg)

![Image](https://ac.marcodsn.me/arxiv-markdown-images/2408.00191v1-figure-94035fc0-fa7c-40d4-89cb-d8ba1831daf9.jpg)

(a) Different proportions of (b) Real data replaced with (c) Synthetic data added to real data

synthetic data real data

Fig. 10. Changes of model performance when the training data is composed of (a) different subsets of the real images, (b) different subsets of synthetic images substituted for real images (c) different subsets of synthetic images added to real images. The dice scores are stratified based on the skin tone of the test dataset. H: HAM, I: ISIC, S: S-SYNTH.
Andrea Kim Niloufar Saharkhiz Elena Sizikova Miguel Lago Berkman Sahiner Jana Delfino Aldo Badano
S-SYNTH: Knowledge-Based, Synthetic Generation of Skin Images
Development of artificial intelligence (AI) techniques in medical imaging
requires access to large-scale and diverse datasets for training and
evaluation. In dermatology, obtaining such datasets remains challenging due to
significant variations in patient populations, illumination conditions, and
acquisition system characteristics. In this work, we propose S-SYNTH, the first
knowledge-based, adaptable open-source skin simulation framework to rapidly
generate synthetic skin, 3D models and digitally rendered images, using an
anatomically inspired multi-layer, multi-component skin and growing lesion
model. The skin model allows for controlled variation in skin appearance, such
as skin color, presence of hair, lesion shape, and blood fraction among other
parameters. We use this framework to study the effect of possible variations on
the development and evaluation of AI models for skin lesion segmentation, and
show that results obtained using synthetic data follow similar comparative
trends as real dermatologic images, while mitigating biases and limitations
from existing datasets including small dataset size, lack of diversity, and
underrepresentation.