1. Whole Brain Emulation, as a platform for creating safe AGI Anna Salamon and Carl Shulman

2. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

3. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

4. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

5. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

6. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

7. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

8. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

9. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

10. AGI: More change, faster

11. AGIs can be copied

13. Serial speedup

15. Solving coordination problems

16. Recursive self-improvement

20. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

21. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

22. Intelligence + Goals = Change

23. More intelligence → More change

24. More intelligence → more change

25. Most ways of rearranging our world would kill us

26. Values vary starkly

27. Arbitrary, rewirable receptors

28. Threading the needle

29. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

30. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

31. Copying specific individuals

33. WBEs share our values

35. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

36. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

37. WBEs can also make AGIs. Faster.

38. Eventually WBEs AGI stable cessation of research

39. WBEs can't rapidly self-improve

40. But can try variations

41. Copy what works

42. Save states can improve work skills Save Restore

43. ... and stabilize goals Save Restore

44. Single “upload clans” could take over

46. ... or invent powerful AI

48. Values also lost through competition See Nick Bostrom's "The Future of Human Evolution," http://www.nickbostrom.com/fut/evolution.html

49. Fun Happiness Human genes Love Play Job skills Values also lost through competition

50. business as usual human extinction stable totalitarianism controlled intelligence explosion uncontrolled intelligence explosion

51. business as usual human extinction stable totalitarianism controlled intelligence explosion uncontrolled intelligence explosion WBEs

52. So: is our shot better or worse with WBE?

53. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

54. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

55. WBE can ease coordination

56. Races incentivize risk-taking

57. Safety infrastructure could be designed ahead of time

58. Arms races and time for precautions 1940195019601970 Year of first nuclear test US 1945 USSR 1949 UK 1952 France 1960 PRC 1964

59. Forever in a day 1940195019601970 USSR 1949 UK 1952 France 1960 PRC 1964 July 16, 1945 July 17, 1945 July 18, 1945 July 19, 1945

60. WBE as platform for further tech development

61. The possibility of a highly- controlled structure

62. Carefully chosen, tested components

63. Safety infrastructure could be designed ahead of time

64. ... and stabilize goals Save Restore

65. Moral objections?

66. Even without “WBE systems”, advantages to WBEs

67. Reduced coordination problems

68. Taking the long view

69. Existence proof ?

70. WBE can ease the technical challenge

71. Subjectively slower computers

72. Moore's Law of Mad Science "Every eighteen months, the IQ required to destroy the world drops by one point." —Eliezer Yudkowsky

73. WBE safety monitors: as fast and numerous as AIs

75. Cognitive enhancement for WBEs

76. But modified WBE can become inhuman fast

77. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

78. Outline Background  AGI volatility  Why risky WBEs  Whole Brain Emulation (WBE)  WBE not stable  But may help to build safe AI  Can we make WBE come first?

79. Can we make WBE come first?

80. Inputs to WBE HardwareBrain imagingComputational neuroscience

81. Hard to budge Moore's law And if we succeed, we accelerate AGI, too

82. Could automate brain imaging

83. Neuroscience models most likely bottleneck Hardware Brain imagingComputational neuroscience

84. But same inputs also speed up brain-like AI Hardware Brain imagingComputational neuroscience

85. How much boost each way? ?

86. WBE from partially controlled AI

87. So, what shall we do?

88. business as usual human extinction stable totalitarianism controlled intelligence explosion uncontrolled intelligence explosion

89. business as usual human extinction stable totalitarianism controlled intelligence explosion uncontrolled intelligence explosion WBEs

90. Thank you anna.salamon@singinst.org carl.shulman@singinst.org