Course Outline
Introduction to AI Threat Modeling
- Factors that render AI systems vulnerable.
- Comparing AI attack surfaces with traditional systems.
- Primary attack vectors: data, model, output, and interface layers.
Adversarial Attacks on AI Models
- Exploring adversarial examples and perturbation techniques.
- Distinguishing between white-box and black-box attacks.
- Overview of FGSM, PGD, and DeepFool methods.
- Techniques for visualizing and creating adversarial samples.
Model Inversion and Privacy Leakage
- Deriving training data from model outputs.
- Mechanisms of membership inference attacks.
- Privacy concerns in classification and generative models.
Data Poisoning and Backdoor Injections
- The impact of poisoned data on model behavior.
- Trigger-based backdoors and Trojan horse attacks.
- Strategies for detection and data sanitization.
Robustness and Defense Techniques
- Implementing adversarial training and data augmentation.
- Utilizing gradient masking and input preprocessing.
- Applying model smoothing and regularization techniques.
Privacy-Preserving AI Defenses
- Fundamentals of differential privacy.
- Managing noise injection and privacy budgets.
- Concepts of federated learning and secure aggregation.
AI Security in Practice
- Conducting threat-aware model evaluation and deployment.
- Applying the Adversarial Robustness Toolbox (ART) in real-world scenarios.
- Industry case studies: analyzing real-world breaches and mitigation strategies.
Summary and Future Directions
Requirements
- A solid understanding of machine learning workflows and model training processes.
- Practical experience with Python and standard ML frameworks like PyTorch or TensorFlow.
- Basic knowledge of security principles or threat modeling concepts is advantageous.
Target Audience
- Machine learning engineers.
- Cybersecurity analysts.
- AI researchers and model validation teams.
Testimonials (3)
inventory and identifying the different risk exposures within AI
Gary Cook - Cybersecurity and Information Technology Risk Division
Course - Introduction to AI Trust, Risk, and Security Management (AI TRiSM)
I really enjoyed learning about AI attacks and the tools out there to begin practicing and actively using for security testing. I took a lot of knowledge away which I didn't have at the beginning and the course met what I hoped it would be. My favorite part shown from the training was Comet Browser and was amazed at what it could do. Definitely something will be looking into more. Overall it was a great course and enjoyed learning all OWASP GenAI Top 10.
Patrick Collins - Optum
Course - OWASP GenAI Security
The profesional knolage and the way how he presented it before us