Announcements Homework 6 due tonight @ 11:59pm AI seminar today (Speech): Speaker localization using CNNs SEIs active now

Today’s learning goals At the end of today, you should be able to Describe how ethical concerns fit into data collection, model design, and applications Explain where recent ethical failures in AI went wrong

The way it’s viewed now

Facebook’s response Chief Security Officer at Facebook

Thinking intelligently about AI ethics Aside from general ethical issues, we can break AI-specific ethical issues down into three areas: Data collection – is your process of collecting data ethical? Model design – are the assumptions you make in your model ethical? Model application – is the way you use your model ethical?

Data collection Engineering task – collect enough data to train the model From a population that represents the target Important questions Have you captured the diversity of the real target population? Collecting political speech on Twitter; just collecting liberal speech biases the model! Are you collecting more data than you need/should? Never need SSNs, for example Should you use income level in predicting criminal risk?

Model design Engineering task – build the model structure around assumptions about the data distribution Important questions Could those assumptions be harmful to users? Using an offline model assumes that test points are independent But what if the order of test points should actually affect the model? (e.g., “I’ll kill him when I see him”; need context to say if “kill” is literal or figurative) Are the features you’re using biased? Number of traffic stops by police

Model application Engineering task – use the trained model to make predictions on data from the right kind of distribution Important questions Is the purpose that you’re using this for ethical? Applying a sentiment classification model to find negative speech about a political leader Is the way that you’re getting/processing predictions ethical? Air traffic control system that assumes its predictor of runway status is always accurate

Exercise: Analyzing ethical breaches

Next time Review session for final: BRING QUESTIONS!