1. TOWARDS MAKING SYSTEMS FORGET WITH MACHINE UNLEARNING Yinzhi Cao Lehigh University 1

2. The reason to forget Misleading worm signature generators using deliberate noise injection, in Proceedings of the 2006 IEEE Symposium on Security and Privacy, 2006. 2 Spam benign Polluted Model Polluted Model benign Spam benign Forget the data and the lineage

3. One Type of Statistical Query Learning 3 x1x1 x1x1 x2x2 x2x2 x3x3 x3x3 x4x4 x4x4 Learn( Σ i g 1 (x i ), Σ i g 2 (x i ), …, Σ i g m (x i )) Σig1(xi)Σig1(xi) Σig1(xi)Σig1(xi) x1x1 x1x1 x2x2 x2x2 x3x3 x3x3 x4x4 x4x4 Σig2(xi)Σig2(xi) Σig2(xi)Σig2(xi)... Training Data Summations Machine Learning Model

4. Unlearning 4 x1x1 x1x1 x2x2 x2x2 x3x3 x3x3 x4x4 x4x4 Learn( Σ i g 1 (x i ), Σ i g 2 (x i ), …, Σ i g m (x i )) Σig1(xi)Σig1(xi) Σig1(xi)Σig1(xi) x1x1 x1x1 x2x2 x2x2 x3x3 x3x3 x4x4 x4x4 Σig2(xi)Σig2(xi) Σig2(xi)Σig2(xi)... Training Data Summations Machine Learning Model Σ i g 1 (x i )-g 1 (x 4 ) Σ i g 2 (x i )-g 2 (x 4 ) Learn( Σ i g 1 (x i )-g 1 (x 4 ), Σ i g 2 (x i )-g 2 (x 4 ), …, Σ i g m (x i )-g m (x 4 ))

5. Intuition 5

6. Q&A Thank you! Questions? yinzhi.cao@lehigh.edu  Q: What did this guy say in the unlearning talk?  A: I forgot! 6