AI and Cybersecurity

Our work in artificial intelligence (AI) and cybersecurity includes examinations of adversarial manipulation and the legal, policy, and other hurdles of cybersecurity research in AI.


Project Resources

  • AI Entanglement: Accounting for dependencies in general-purpose AI policy, regulation, and practice

    Research Paper
  • Ethics in Computer Security Research: A Data-Driven Assessment of the Past, the Present, and the Possible Future

    Research Paper
  • A common pool of privacy problems: Legal and technical lessons from a large-scale web-scraped machine learning dataset

    Research Paper
  • Understanding experiences with compulsory immigration surveillance in the U.S.

    Research Paper
  • Extending the Heilmeier Catechism to Evaluate Security and Privacy Systems: Who is Left Out?

    Research Paper
  • “You Have to Ignore the Dangers”: User Perceptions of the Security and Privacy Benefits of WhatsApp Mods

    Research Paper
  • “We’re utterly ill-prepared to deal with something like this”: Teachers’ Perspectives on Student Generation of Synthetic Nonconsensual Explicit Imagery

    Research Paper
  • “Violation of my body:” Perceptions of AI-generated non-consensual (intimate) imagery

    Research Paper
  • Tech Talk with Kashmir Hill: Your Face Belongs to Us

    Kashmir Hill has been working on a book about facial recognition technology for the last three years. In doing so, she tracked down the early pioneers, found the people fighting against the worst impulses for the technology, and dove into the history of Clearview AI, the ground-breaking startup that first drew her into the topic by building a radical person-finding app that giants in the field, including Google and Facebook, had deemed taboo. Full of previously unreported information and scoops, it will leave readers with a greater understanding of how we got to this point and how to prepare for the future to come. Kashmir Hill is a tech reporter at The New York Times and the author of YOUR FACE BELONGS TO US. She writes about the unexpected and sometimes ominous ways technology is changing our lives, particularly when it comes to our privacy. She joined The Times in 2019, after having worked at Gizmodo Media Group, Fusion, Forbes Magazine, and Above the Law. Her writing has appeared in The New Yorker and The Washington Post. She has degrees from Duke University and New York University, where she studied journalism.

    Video
  • Robust Physical-World Attacks on Deep Learning Visual Classification

    In this paper, presented at the 2018 Conference on Computer Vision and Pattern Recognition (CVPR 2018), researchers show that malicious alterations to real world objects could cause an object classifier to misread an image.

    Research Paper
  • Physical Adversarial Examples for Object Detectors

    Presented at the 12th USENIX Workshop on Offensive Technologies (WOOT '18), this paper explores physical adversarial attacks for object detection models, a broader class of deep learning algorithms widely used to detect and label multiple objects within a scene.

    Research Paper
  • Adversarial Machine Learning: Robust Physical-World Attacks on Machine Learning Modules

    Although deep neural networks (DNNs) perform well in a variety of applications, they are vulnerable to adversarial examples resulting from small-magnitude perturbations added to the input data. However, recent studies have demonstrated that such adversarial examples have limited effectiveness in the physical world due to changing physical conditions—they either completely fail to cause misclassification or only work in restricted cases where a relatively complex image is perturbed and printed on paper.

    News
  • “Is Tricking a Robot Hacking?”

    Research Paper
  • Peeping HALs: Making Sense of Artificial Intelligence and Privacy

    Research Paper
More Project Resources

Past Events

  • Adversarial Machine Learning Research on Display at Science Museum in London Through October 2020

    Please note: The Museum reopened on August 19th. Visitors must pre-book a free ticket in advance. Please visit https://www.sciencemuseum.org.uk/ for further details. Research exploring adversarial machine learning is on display at the Science Museum in London from June 2019 to October 2020 as part of “Driverless: Who is in Control?” This free exhibit includes a modified stop sign developed by a team of researchers to fool driverless cars into misidentifying it and asks “can self-driving cars see the world as well as you can?”

    Event