1. Announcements
Homework 6 due 11:59pm AI seminar today (Speech): Speaker localization using CNNs SEIs active now

2. Today’s learning goals
At the end of today, you should be able to
Describe how ethical concerns fit into data collection, model design, and applications
Explain where recent ethical failures in AI went wrong

4. The way it’s viewed now

5. Facebook’s response
Chief Security Officer at Facebook

6. Thinking intelligently about AI ethics
Aside from general ethical issues, we can break AI-specific ethical issues down into three areas:
Data collection – is your process of collecting data ethical?
Model design – are the assumptions you make in your model ethical?
Model application – is the way you use your model ethical?

7. Data collection
Engineering task – collect enough data to train the model
From a population that represents the target
Important questions
Have you captured the diversity of the real target population?
Collecting political speech on Twitter; just collecting liberal speech biases the model!
Are you collecting more data than you need/should?
Never need SSNs, for example
Should you use income level in predicting criminal risk?

8. Model design
Engineering task – build the model structure around assumptions about the data distribution
Important questions
Could those assumptions be harmful to users?
Using an offline model assumes that test points are independent
But what if the order of test points should actually affect the model? (e.g., “I’ll kill him when I see him”; need context to say if “kill” is literal or figurative)
Are the features you’re using biased?
Number of traffic stops by police

9. Model application
Engineering task – use the trained model to make predictions on data from the right kind of distribution
Important questions
Is the purpose that you’re using this for ethical?
Applying a sentiment classification model to find negative speech about a political leader
Is the way that you’re getting/processing predictions ethical?
Air traffic control system that assumes its predictor of runway status is always accurate

10. Exercise: Analyzing ethical breaches

11. Next time
Review session for final: BRING QUESTIONS!