1. Waiting for the Great Leap… Forward? J. Hughes - Institute for Ethics and Emerging Technologies - Trinity College

2. Animal, Human, Cyborg The human- machine distinction is not about createdness but about preserving valued feelings and cognition in posthumans Human-racism Personhood

3. Singularity Accelerating technology Radical historical discontinuity, like the emergence of homo sapiens The invention of greater- than-human intelligence Sublimated millennialism: Rapture of the Nerds But that doesn’t mean they are wrong

4. Scenarios TransHuman Augmentation (Kurzweil) Friendly Super-AI Emergent Global Brain(s) Bad “Hard take- off”: Terminator

5. Acceleration and Discontinuity Technology is accelerating There will be radical civilizational change Utopian and apocalyptic possibilities

6. Enhancement & Brain-Machine Smart drugs, gene therapy, tissue engineering, nanorobots Exocortex Already “extended minds” Direct brain-machine connections Back-ups and uploads

7. Self-Aware AI Consciousness is material, reproducible Sentient, self- willed, greater- than-human machine minds are very likely in the coming fifty years.

8. Self-willed AI Is Very Dangerous Steps must be taken to ensure its safety.

9. Self-aware AI Will Be Radically Alien Empathy for human beings is the product, at least, of embodied mammalian brains.

10. Attempt Empathetic Robots even though attempt is likely futile -Affective computing inadequate -Human experience, emotional reactions, mirror neurons

11. Emergent, Designed, Evolved Self-willed minds may evolve from primitive a- life in the infosphere ecosystem

12. Technoprogressive Policy Many techno-futurists are libertarians (albeit ironic Marxists) Many progressives are Luddites Policies to maximize likelihood of safe, equitable outcomes

13. Human Intelligence Augmentation Keeping up with HAL

14. Global Regulation of Dangerous AI Cybersecurity monitoring of criminal worms, cyberwarfare and emergent a-life Techs of mass destruction require transnational regulation

15. Structural Unemployment Necessary wage slavery vs. self-chosen occupations Need for expanded social wage, reform of Social Security, basic income guarantee

16. Robot Rights Which minds have which rights and responsibilities? Engineering slave minds vs. Flourishing minds, but within social limits

17. Aug-Cog & Uploads as Safer AI Perhaps all advanced self- aware AI should be reverse-engineered human brains, or controlled by meat brains

18. Licensing Superpowers If you need a license to own a gun and drive a car, why not an AI- powered brain? If only governments should have nukes, what about S^AIs?

19. For more information Institute for Ethics and Emerging Technologies ieet.org Me: director@ieet.orgdirector@ieet.org