AI Security & Adversarial Attacks › Model Inversion Attacks
How does Model Inversion Attacks work
BeginnerAnswer
An attacker repeatedly queries the model and studies its responses to try to reverse engineer details about the specific data the model was trained on.
Real-world example A model inversion attack might try to reconstruct a recognizable face image from a facial recognition model without ever having direct access to the original training photos.