Model Immunization from a Condition Number Perspective
Model immunization aims to pre-train models that are difficult to fine-tune
on harmful tasks while retaining their utility on other non-harmful tasks.
Though prior work has shown empirical evidence for immunizing text-to-image
models, the key understanding of when immunization is possible and a precise
definition of an immunized model remain unclear. In this work, we propose a
framework, based on the condition number of a Hessian matrix, to analyze model
immunization for linear models. Building on this framework, we design an
algorithm with regularization terms to control the resulting condition numbers
after pre-training. Empirical results on linear models and non-linear deep-nets
demonstrate the effectiveness of the proposed algorithm on model immunization.
The code is available at
https://github.com/amberyzheng/model-immunization-cond-num.
6848696642e4f9106973f15f
Amber Yijia Zheng
claimed_verified
2025-06-11T08:35:34.550Z
6429ac8e8136224fee087253
/avatars/f7e4f0885e8c4a90c75c4e36ae3fba6e.svg
Amber Yijia Zheng
user
amberyzheng
6848696642e4f9106973f160
Cedar Site Bai
6848696642e4f9106973f161
Brian Bullins
6848696642e4f9106973f162
Raymond A. Yeh
claimed_verified
2025-07-16T08:16:12.187Z
62dac2dff014388f90897039
/avatars/33b5b1e18512d624b41d72cf4879e509.svg
Raymond Yeh
user
raymondyeh
Model Immunization from a Condition Number Perspective
Model immunization aims to pre-train models that are difficult to fine-tune
on harmful tasks while retaining their utility on other non-harmful tasks.
Though prior work has shown empirical evidence for immunizing text-to-image
models, the key understanding of when immunization is possible and a precise
definition of an immunized model remain unclear. In this work, we propose a
framework, based on the condition number of a Hessian matrix, to analyze model
immunization for linear models. Building on this framework, we design an
algorithm with regularization terms to control the resulting condition numbers
after pre-training. Empirical results on linear models and non-linear deep-nets
demonstrate the effectiveness of the proposed algorithm on model immunization.
The code is available at
https://github.com/amberyzheng/model-immunization-cond-num.
An algorithm with regularization terms based on the condition number of a Hessian matrix is proposed to analyze and achieve model immunization, demonstrating effectiveness on both linear models and deep-nets.
Hessian matrix condition number model immunization regularization terms linear models deep-nets