Portrait of Ilia Shumailov

Ilia
Shumailov

AI Scientist and Team Lead at Meta. Previously founder and CEO of AI Sequrity.

Path

  1. 2026–nowLondon
    Meta Now
    AI Scientist and Team Lead
  2. 2025–2026London
    AI Sequrity
    Founder and CEO
  3. 2023–2025London
    Google DeepMind
    Senior Research Scientist, leading research on the security and privacy of machine learning
  4. 2022–2023Oxford
    Christ Church, University of Oxford
    Junior Research Fellow in the OATML group with Yarin Gal
  5. 2021–2022Toronto
    Vector Institute
    Postgraduate Fellow with Nicolas Papernot and Kassem Fawaz
  6. 2017–2021Cambridge
    Fitzwilliam College, University of Cambridge

Interviews and talks

About

I work on making AI systems secure -- especially agents that read untrusted content, call tools, and act on people’s behalf.

I'm an AI Scientist and Team Lead at Meta in London, where I joined the team for AI security. I work across the Muse Spark and Muse Wonder model families and products such as Muse Code and Muse Agent, along with other AI, safety and security efforts.

Before Meta I founded AI Sequrity, building defensive AI technology for agents, and gave talks on it at Black Hat and RSA. In April 2026 the whole team moved over to Meta. Before that I was a Senior Research Scientist at Google DeepMind, leading research on security and privacy. Amongst other things, I contributed to the Gemini 1.5 and Gemini 2.5 technical reports.

Highlights

Selected security papers

Selected machine learning papers

Papers by venue55

VenuePapers
Security22
IEEE SaTMLIEEE Conference on Secure and Trustworthy Machine Learning
  1. 2026Defeating Prompt Injections by Design
  2. 2026Reasoning Introduces New Poisoning Attacks Yet Makes Them More Complicated
  3. 2026Architectural Backdoors for Within-Batch Data Stealing and Model Inference Manipulation
  4. 2025SEA: Shareable and Explainable Attribution for Query-based Black-box Attacks
  5. 2025Locking Machine Learning Models into Hardware
  6. 2025Inexact Unlearning Needs More Careful Evaluations to Avoid a False Sense of Privacy
  7. 2024ImpNet: Imperceptible and Blackbox-undetectable Backdoors in Compiled Neural Networks
7
USENIX SecurityUSENIX Security Symposium
  1. 2026The Attacker Moves Second: Stronger Adaptive Attacks Bypass Defenses Against LLM Jailbreaks and Prompt Injections
  2. 2024Machine Learning Needs Better Randomness Standards: Randomised Smoothing and PRNG-based Attacks
  3. 2024Gradients Look Alike: Sensitivity is Often Overestimated in DP-SGD
  4. 2023Tubes Among Us: Analog Attack on Automatic Speaker Identification
  5. 2022Towards More Robust Keyword Spotting for Voice Assistants
  6. 2022On the Necessity of Auditable Algorithmic Definitions for Machine Unlearning
6
IEEE EuroS&PIEEE European Symposium on Security and Privacy
  1. 2023When the Curious Abandon Honesty: Federated Learning Is Not Private
  2. 2023Reconstructing Individual Data Points in Federated Learning Hardened with Differential Privacy and Secure Aggregation
  3. 2021Sponge Examples: Energy-Latency Attacks on Neural Networks
3
IEEE S&PIEEE Symposium on Security and Privacy
  1. 2025Architectural Neural Backdoors from First Principles
  2. 2022Bad Characters: Imperceptible NLP Attacks
2
ACM CCSACM Conference on Computer and Communications Security
  1. 2025Cascading Adversarial Bias from Injection to Distillation in Language Models
1
ACM IMCACM Internet Measurement Conference
  1. 2020Turning Up the Dial: the Evolution of a Cybercrime Market Through Set-up, Stable, and Covid-19 Eras
1
APWG eCrimeAPWG Symposium on Electronic Crime Research
  1. 2019Mapping the Underground: Supervised Discovery of Cybercrime Supply ChainsBest Paper Honorable Mention
1
RAIDSymposium on Research in Attacks, Intrusions and Defenses
  1. 2023Boosting Big Brother: Attacking Search Engines with EncodingsBest Paper Award
1
Machine learning31
NeurIPSConference on Neural Information Processing Systems
  1. 2026CaMeLs Can Use Computers Too: System-level Security for Computer Use Agents
  2. 2026GitInject: Real-World Prompt Injection Attacks in AI-Powered CI/CD Pipelines (Evaluations & Datasets Track)
  3. 2026Honeyval: A Comprehensive Evaluation Framework for LLM-powered HTTP Honeypots (Evaluations & Datasets Track)
  4. 2025Exploring the Limits of Strong Membership Inference Attacks on Large Language Models
  5. 2025Machine Unlearning Doesn’t Do What You Think: Lessons for Generative AI Policy and ResearchOral
  6. 2024Beyond Slow Signs in High-fidelity Model Extraction
  7. 2022On the Limitations of Stochastic Pre-processing Defenses
  8. 2022Rapid Model Architecture Adaption for Meta-Learning
  9. 2022In Differential Privacy, There is Truth: On Vote-Histogram Leakage in Ensemble Private Learning
  10. 2021Manipulating SGD with Data Ordering Attacks
10
ICMLInternational Conference on Machine Learning
  1. 2026Extracting Alignment Data in Open Models
  2. 2025Hardware and Software Platform Inference
  3. 2025Interpreting the Repeated Token Phenomenon in Large Language Models
  4. 2025Position: Machine Learning Models Have a Supply Chain Problem
  5. 2024Position: Fundamental Limitations of LLM Censorship Necessitate New Approaches
  6. 2022Rethinking Image-Scaling Attacks: The Interplay Between Vulnerabilities in Machine Learning SystemsTop 2% award
  7. 2021Markpainting: Adversarial Machine Learning Meets InpaintingSpotlight
7
TMLRTransactions on Machine Learning Research
  1. 2026Open Technical Problems in Open-Weight AI Model Risk Management
  2. 2025Privacy Awareness for Information-Sharing Assistants: A Case-Study on Form-Filling with Contextual Integrity
  3. 2024Beyond Labeling Oracles: What Does It Mean to Steal ML Models?
  4. 2024From Differential Privacy to Bounds on Membership Inference: Less Can Be More
4
ACL / EMNLP / NAACLACL, EMNLP and NAACL main conferences
  1. 2025Measuring Memorization in Language Models via Probabilistic Extraction (NAACL)
  2. 2023Revisiting Block-based Quantisation: What is Important for Sub-8-bit LLM Inference? (EMNLP)
  3. 2023Revisiting Automated Prompting: Are We Actually Doing Better? (ACL)
3
ICLRInternational Conference on Learning Representations
  1. 2025Breach by a Thousand Leaks: Unsafe Information Leakage in ‘Safe’ AI Responses
  2. 2025Measuring Memorization in RLHF for Code Completion
2
MLSysConference on Machine Learning and Systems
  1. 2025Supply-Chain Attacks in Machine Learning Frameworks
  2. 2019To Compress or Not to Compress: Understanding the Interactions Between Adversarial Attacks and Neural Network Compression (SysML)
2
ACIIInternational Conference on Affective Computing and Intelligent Interaction
  1. 2017Computational Analysis of Valence and Arousal in Virtual Reality Gaming Using Lower Arm Electromyograms
1
ACM FAccTACM Conference on Fairness, Accountability, and Transparency
  1. 2024Fairness Feedback Loops: Training on Synthetic Data Amplifies Bias
1
CVPRIEEE/CVF Conference on Computer Vision and Pattern Recognition
  1. 2023Architectural Backdoors in Neural Networks
1
Science2
Nature
  1. 2024AI models collapse when trained on recursively generated dataCover
  2. 2024Scalable watermarking for identifying large language model outputsCover
2
Total55

Peer-reviewed papers at main conferences and journals.