AI Security & Adversarial Attacks › Model Inversion Attacks

How does Model Inversion Attacks work

Beginner

Answer

An attacker repeatedly queries the model and studies its responses to try to reverse engineer details about the specific data the model was trained on.
Real-world example A model inversion attack might try to reconstruct a recognizable face image from a facial recognition model without ever having direct access to the original training photos.

Common follow-ups: What is AI Security & Adversarial Attacks, How is Model Inversion Attacks evaluated in practice, What tools are commonly used for Model Inversion Attacks