Adversarial AI for Autonomous Drone Systems

Adversarial AI for Autonomous Drone Systems

Currently open to new students?

Yes
No

Description

This project aims to investigate vulnerabilities in AI-driven autonomous drone systems and develop a reusable framework for adversarial testing, verification, and validation.
We will study how adversarial attacks can affect learning-based components of a drone autonomy stack, develop methods to systematically discover and characterize failures, and investigate defensive methods to improve robustness. Our current focus is learning-based obstacle avoidance.
A major goal of the project is to build a generalizable automated test bench, rather than an attack that works only on one specific neural network. The framework should make it possible to plug in different autonomy algorithms and systematically evaluate their robustness across nominal, off-nominal, and adversarial scenarios.
Students may work on topics including:
  • Learning-based drone obstacle-avoidance algorithms and implementation of them on simulation and actual drones
  • Automated scenario and test-case generation
  • Defensive methods against discovered vulnerabilities

Skills Desired

Required
  • Strong programming, communication, and collaboration skills
  • Proactive and fast self-learner
  • Interest in robotics, autonomous systems, machine learning, or cyber security
Bonus
  • Familiarity with learning-based obstacle avoidance algorithms.
  • Familiarity with cyber security and vulnerabilities
  • Familiarity with software: ROS2, Python, C++, Linux, Bash, Git, docker, Isaac Sim

Student Learning Objectives

  • Integrate and evaluate modern learning-based perception and obstacle-avoidance algorithms for drones
  • Learn how adversarial attacks are formulated and evaluated against autonomous systems
  • Design reproducible simulation experiments and automated test scenarios
  • Contribute to the design of a reusable verification and validation framework
  • Work with graduate students, researchers, and faculty across robotics and cyber security
  • Potentially contribute to research publications, demonstrations, and open-source software

Classes Accepted into Project

Junior
Senior
Graduate Student
Not a hard limit. We care more about talent and potential.

Compensation

Units 9
Units 12
Pay

Contact

Eungchang Mason Lee  eungchal@andrew.cmu.edu Sebastian Scherer  basti@andrew.cmu.edu