Privacy-Preserving Vision Transformer Using Images Encrypted with Restricted Random Permutation Matrices
<|reference_start|>Privacy-Preserving Vision Transformer Using Images Encrypted with Restricted Random Permutation Matrices: We propose a novel method for privacy-preserving fine-tuning vision transformers (ViTs) with encrypted images. Conventional methods using encrypted images degrade model performance compared with that of using plain images due to the influence of image encryption. In contrast, the proposed encryption method using restricted random permutation matrices can provide a higher performance than the conventional ones.<|reference_end|>
@article{horio2024privacy-preserving,
    title={Privacy-Preserving Vision Transformer Using Images Encrypted with
  Restricted Random Permutation Matrices},
    author={Kouki Horio, Kiyoshi Nishikawa, Hitoshi Kiya},
    journal={arXiv preprint arXiv:2408.08529},
    year={2024},
    archivePrefix={arXiv},
    eprint={2408.08529},
    primaryClass={cs.CV}
}