1. Greek Research and Technology Network EGI Community Forum 20121 vkoukis@grnet.gr| 20120328 Delivering IaaS for the Greek Academic and Research Community Vangelis Koukis vkoukis@grnet.gr Technical Coordinator,  okeanos Project

2. Greek Research and Technology NetworkEGI Community Forum 20122 vkoukis@grnet.gr| 20120328 Outline   okeanos ?  Rationale  Design  Platform  Features  Opensource  Upcoming

3. Greek Research and Technology NetworkEGI Community Forum 20123 vkoukis@grnet.gr| 20120328 What is  okeanos? ‘okeanos’ is Greek for ‘ocean’. Oceans capture, store and deliver energy, oxygen and life around the planet.

4. Greek Research and Technology Network EGI Community Forum 20124 vkoukis@grnet.gr| 20120328 Simplicity

5. Greek Research and Technology Network EGI Community Forum 20125 vkoukis@grnet.gr| 20120328

6. Greek Research and Technology Network EGI Community Forum 20126 vkoukis@grnet.gr| 20120328 Compute Network Storage Security Virtual Machines Virtual Ethernets Virtual Disks Virtual Firewalls

7. Greek Research and Technology Network EGI Community Forum 20127 vkoukis@grnet.gr| 20120328 Flexibility

8. Greek Research and Technology Network EGI Community Forum 20128 vkoukis@grnet.gr| 20120328

9. Greek Research and Technology Network EGI Community Forum 20129 vkoukis@grnet.gr| 20120328 1x 2x5x 8x

10. Greek Research and Technology NetworkEGI Community Forum 201210 vkoukis@grnet.gr| 20120328  okeanos service  Goal: Production-quality IaaS  Now in Alpha: from July 2011 / 350 VMs / 200 alpha users  Target group: GRNET’s customers  direct: IT depts of connected institutions  indirect: university students, researchers in academia  Users manage resources over  a simple, elegant UI, or  a REST API, for full programmatic control

11. Greek Research and Technology NetworkEGI Community Forum 201211 vkoukis@grnet.gr| 20120328  okeanos service  Compute: Cyclades  Files: Pithos+  Images: Plankton  Identity: Astakos  Volumes: Archipelago  Accounting/Billing: Aquarium

12. Greek Research and Technology Network EGI Community Forum 201212 vkoukis@grnet.gr| 20120328 Rationale

13. Greek Research and Technology NetworkEGI Community Forum 201213 vkoukis@grnet.gr| 20120328 How it all started  Need for easy, secure access to GRNET’s datacenters  User friendliness, simplicity  Scalable to the thousands  #VMs, TBs, users (Pithos:  10k)  running within GRNET’s AAI Federation  Resell or build your own?

14. Greek Research and Technology NetworkEGI Community Forum 201214 vkoukis@grnet.gr| 20120328 Build on commercial IaaS?  Commercial IaaS  Amazon EC2 not an end-user service  Need to develop custom UI, AAI layers  Vendor lock-in  Unsuitable for IT depts persistent, long-term servers, custom networking requirements  Gain know-how, build on own IaaS  reuse for own services

15. Greek Research and Technology NetworkEGI Community Forum 201215 vkoukis@grnet.gr| 20120328 What about opensource?  Eucalyptus, OpenNebula, OpenStack  Need a mature opensource core to build around  Maturity, production-readiness?  proven in production environments, predictable  Extensibility?  Flexibility?  Upgradeability, maintainability?

16. Greek Research and Technology Network EGI Community Forum 201216 vkoukis@grnet.gr| 20120328 Design

17. Greek Research and Technology NetworkEGI Community Forum 201217 vkoukis@grnet.gr| 20120328  okeanos design decisions  Reuse existing components  Build on Google Ganeti  target commodity hardware  release to the community as opensource

18. Greek Research and Technology NetworkEGI Community Forum 201218 vkoukis@grnet.gr| 20120328  okeanos design principles  No need to make the world  No need to support everything  Service developed and maintained by  10-15 people  Start from the architecture…  …then discover, combine, reuse the right components  And for everything that’s not already available  Do it yourself!

19. Greek Research and Technology Network EGI Community Forum 201219 vkoukis@grnet.gr| 20120328

20. Greek Research and Technology NetworkEGI Community Forum 201220 vkoukis@grnet.gr| 20120328 Jigsaw puzzle  Synnefo  custom cloud management software to power  okeanos  Google Ganeti backend  VM cluster management: physical nodes, VMs, migrations  OpenStack APIs: Compute API v1.1, Object Storage API  with custom extensions whenever necessary  Then everything comes together  UI, Networking, Images, Storage, Monitoring, Identity management, Accounting, Billing, Clients, Helpdesk

21. Greek Research and Technology NetworkEGI Community Forum 201221 vkoukis@grnet.gr| 20120328 Why Ganeti?  No need to reinvent the wheel  Scalable, proven software infrastructure  Built with reliability and redundancy in mind  Combines open components (KVM, LVM, DRBD)  Well-maintained, readable code  VM cluster management in production is serious business  reliable VM control, VM migrations, resource allocation  handling node downtime, software upgrades

22. Greek Research and Technology NetworkEGI Community Forum 201222 vkoukis@grnet.gr| 20120328 Why Ganeti?  GRNET already had long experience with Ganeti  provides  280 VMs to NOCs through the ViMa service  involved in development, contributing patches upstream  Build on existing know-how for  okeanos  Common backend, common fixes  reuse of experience and operational procedures  simplified, less error-prone deployment

23. Greek Research and Technology Network EGI Community Forum 201223 vkoukis@grnet.gr| 20120328 Platform

24. Greek Research and Technology NetworkEGI Community Forum 201224 vkoukis@grnet.gr| 20120328 Software Stack Multiple users, multiple resources Multiple VMs on cluster Single VM Synnefo Ganeti KVM REST API

25. Greek Research and Technology NetworkEGI Community Forum 201225 vkoukis@grnet.gr| 20120328 Platform Design user@home admin@home Web ClientCLI ClientWeb Client 2 GRNET datacenter Debian Virtual Hardware OpenStack Compute API v1.1 Direct Outof Band Access Synnefo cloud management software Google Ganeti KVM GRNET Proprietary

26. Greek Research and Technology Network EGI Community Forum 201226 vkoukis@grnet.gr| 20120328 Features

27. Greek Research and Technology NetworkEGI Community Forum 201227 vkoukis@grnet.gr| 20120328 Virtual Machine Actions My_Windows_desktop Shutdown Reboot Start Console Destroy

28. Greek Research and Technology NetworkEGI Community Forum 201228 vkoukis@grnet.gr| 20120328 IaaS – Compute (1)  Virtual Machines  powered by KVM Linux and Windows guests, on Debian hosts  Google Ganeti for VM cluster management  accessible by the end-user over the Web or programmatically (OpenStack Compute v1.1)

29. Greek Research and Technology NetworkEGI Community Forum 201229 vkoukis@grnet.gr| 20120328 IaaS – Compute (2)  User has full control over own VMs  Create Select # CPUs, RAM, System Disk OS selection from pre-defined Images, or custom Images popular Linux distros (Fedora, Debian, Ubuntu) Windows Server 2008 R2  Start, Shutdown, Reboot, Destroy  Out-of-Band console over VNC for troubleshooting

30. Greek Research and Technology NetworkEGI Community Forum 201230 vkoukis@grnet.gr| 20120328 IaaS – Compute (3)  REST API for VM management  OpenStack Compute v1.1 compatible  3rd party tools and client libraries  custom extensions for yet-unsupported functionality  Python & Django implementation  Full-featured UI in JS/jQuery  UI is just another API client  All UI operations happen over the API

31. Greek Research and Technology NetworkEGI Community Forum 201231 vkoukis@grnet.gr| 20120328 IaaS – Network (Virtual Ethernets) Internet Private Network 1 Private Network 2Private Network 3

32. Greek Research and Technology NetworkEGI Community Forum 201232 vkoukis@grnet.gr| 20120328 IaaS – Network - Functionality  Dual IPv4/IPv6 connectivity for each VM  Easy, platform-provided firewalling  Array of pre-configured firewall profiles  Or roll-your-own firewall inside VM  Multiple private, virtual L2 networks  Construct arbitrary network topologies  e.g., deploy VMs in multi-tier configurations  Exported all the way to the API and the UI

33. Greek Research and Technology Network EGI Community Forum 201233 vkoukis@grnet.gr| 20120328 Unity

34. Greek Research and Technology NetworkEGI Community Forum 201234 vkoukis@grnet.gr| 20120328 Spawn Freeze Images Ubuntu my own Ubuntu

35. Greek Research and Technology NetworkEGI Community Forum 201235 vkoukis@grnet.gr| 20120328 Clone Snapshot Images  Storage Ubuntu root Ubuntu + packages

36. Greek Research and Technology NetworkEGI Community Forum 201236 vkoukis@grnet.gr| 20120328 Images – Golden Image golden Debian

37. Greek Research and Technology NetworkEGI Community Forum 201237 vkoukis@grnet.gr| 20120328 IaaS – Storage

38. Greek Research and Technology NetworkEGI Community Forum 201238 vkoukis@grnet.gr| 20120328 Archipelago RADOS Object Storage nodes IaaS – Storage Maps Volume Composer object I/O Monitor nodes Storage

39. Greek Research and Technology NetworkEGI Community Forum 201239 vkoukis@grnet.gr| 20120328 IaaS – Storage (1)  First-phase deployment  System-provided and custom user Images  Redundant storage based on DRBD  VMs survive node downtime or failure  Currently under testing  Reliable distributed storage over RADOS  Combined with custom software for snapshotting, cloning  Dynamic virtual storage volumes

40. Greek Research and Technology NetworkEGI Community Forum 201240 vkoukis@grnet.gr| 20120328 IaaS – Storage (2)  Multi-tier storage architecture  Dedicated Storage Nodes (SSD, SAS, and SATA storage)  OSDs for RADOS  Custom storage layer: Archipelago  manages snapshots, creates clones over RADOS  OS Images held as snapshots  VMs created as clones of snapshots

41. Greek Research and Technology NetworkEGI Community Forum 201241 vkoukis@grnet.gr| 20120328 Custom Images: snf-image  Untrusted images  Host cannot touch user-provided data  Resize fs, change hostname, change passwords, inject files  Split design  snf-image-host  snf-image-helper  All customization in helper VM

42. Greek Research and Technology NetworkEGI Community Forum 201242 vkoukis@grnet.gr| 20120328  OpenStack Object Storage API  Block storage  Content-based addressing for blocks  Every file is a collection of blocks  Web-based, command-line, and native clients  Synchronization, deduplication  An integral part of  okeanos  User files, Image registry for VM Images  Goal: use common backend with Archipelago

43. Greek Research and Technology Network EGI Community Forum 201243 vkoukis@grnet.gr| 20120328 Integration

44. Greek Research and Technology NetworkEGI Community Forum 201244 vkoukis@grnet.gr| 20120328

45. Greek Research and Technology NetworkEGI Community Forum 201245 vkoukis@grnet.gr| 20120328

46. Greek Research and Technology NetworkEGI Community Forum 201246 vkoukis@grnet.gr| 20120328

47. Greek Research and Technology NetworkEGI Community Forum 201247 vkoukis@grnet.gr| 20120328

48. Greek Research and Technology NetworkEGI Community Forum 201248 vkoukis@grnet.gr| 20120328 Support services  Identity: Astakos  Provides the user base for  okeanos  Once authenticated, the user retrieves a common auth token for programmatic access  Accounting / Billing: Aquarium  Underlying crediting and billing infrastructure

49. Greek Research and Technology Network EGI Community Forum 201249 vkoukis@grnet.gr| 20120328 Tools

50. Greek Research and Technology NetworkEGI Community Forum 201250 vkoukis@grnet.gr| 20120328./kamaki $ ipython In [1]: from kamaki.client import Client In [2]: c = Client('http://localhost:8000/api/v1.1', "1234527db2…") In [3]: c.list_flavors() … In [4]: i = c.list_images() In [5]: i[5] {u'created': u'2011-06-09T00:00:00+00:00', u'id': 7, u'metadata': {u'values': {u'OS': u'windows', u'size': u'11000'}}, u'name': u'Windows', u'progress': 100, u'status': u'ACTIVE', u'updated': u'2011-09-12T14:47:12+00:00'} In [6]: c.create_server('mywin1', 3, 5)

51. Greek Research and Technology NetworkEGI Community Forum 201251 vkoukis@grnet.gr| 20120328./kamaki $./kamaki Usage: kamaki [options] … --api=API API can be either openstack or synnefo --url=URL API URL --token=TOKEN use token TOKEN … Commands: flavor info get flavor details flavor list list flavors … image create create image image delete delete image $./kamaki server shutdown 101 --url=http://localhost:8000/api/v1.1 --token=1234527db2…

52. Greek Research and Technology Network EGI Community Forum 201252 vkoukis@grnet.gr| 20120328 Upcoming

53. Greek Research and Technology NetworkEGI Community Forum 201253 vkoukis@grnet.gr| 20120328 Current and Upcoming features  Now: Alpha2  Common user base, custom user images on Pithos+  short-term: Synnefo v0.10, Beta  Ultra-lightweight VMs on Archipelago with RADOS backend  medium-term  OCCI bridge  Volumes: clonable / snapshottable / attachable disks  Upcoming beta in fully populated datacenter

54. Greek Research and Technology Network EGI Community Forum 201254 vkoukis@grnet.gr| 20120328 Sights

55. Greek Research and Technology Network EGI Community Forum 201255 vkoukis@grnet.gr| 20120328

56. Greek Research and Technology Network EGI Community Forum 201256 vkoukis@grnet.gr| 20120328

57. Greek Research and Technology Network EGI Community Forum 201257 vkoukis@grnet.gr| 20120328

58. Greek Research and Technology Network EGI Community Forum 201258 vkoukis@grnet.gr| 20120328

59. Greek Research and Technology Network EGI Community Forum 201259 vkoukis@grnet.gr| 20120328

60. Greek Research and Technology Network EGI Community Forum 201260 vkoukis@grnet.gr| 20120328

61. Greek Research and Technology Network EGI Community Forum 201261 vkoukis@grnet.gr| 20120328

62. Greek Research and Technology Network EGI Community Forum 201262 vkoukis@grnet.gr| 20120328

63. Greek Research and Technology Network EGI Community Forum 201263 vkoukis@grnet.gr| 20120328

64. Greek Research and Technology Network EGI Community Forum 201264 vkoukis@grnet.gr| 20120328

65. Greek Research and Technology Network EGI Community Forum 201265 vkoukis@grnet.gr| 20120328

66. Greek Research and Technology Network EGI Community Forum 201266 vkoukis@grnet.gr| 20120328

67. Greek Research and Technology Network EGI Community Forum 201267 vkoukis@grnet.gr| 20120328

68. Greek Research and Technology Network EGI Community Forum 201268 vkoukis@grnet.gr| 20120328

69. Greek Research and Technology Network EGI Community Forum 201269 vkoukis@grnet.gr| 20120328

70. Greek Research and Technology Network EGI Community Forum 201270 vkoukis@grnet.gr| 20120328

71. Greek Research and Technology Network EGI Community Forum 201271 vkoukis@grnet.gr| 20120328

72. Greek Research and Technology Network EGI Community Forum 201272 vkoukis@grnet.gr| 20120328

73. Greek Research and Technology Network EGI Community Forum 201273 vkoukis@grnet.gr| 20120328

74. Greek Research and Technology Network EGI Community Forum 201274 vkoukis@grnet.gr| 20120328

75. Greek Research and Technology Network EGI Community Forum 201275 vkoukis@grnet.gr| 20120328

76. Greek Research and Technology Network EGI Community Forum 201276 vkoukis@grnet.gr| 20120328

77. Greek Research and Technology Network EGI Community Forum 201277 vkoukis@grnet.gr| 20120328

78. Greek Research and Technology Network EGI Community Forum 201278 vkoukis@grnet.gr| 20120328

79. Greek Research and Technology Network EGI Community Forum 201279 vkoukis@grnet.gr| 20120328

80. Greek Research and Technology Network EGI Community Forum 201280 vkoukis@grnet.gr| 20120328

81. Greek Research and Technology Network EGI Community Forum 201281 vkoukis@grnet.gr| 20120328

82. Greek Research and Technology Network EGI Community Forum 201282 vkoukis@grnet.gr| 20120328

83. Greek Research and Technology Network EGI Community Forum 201283 vkoukis@grnet.gr| 20120328

84. Greek Research and Technology Network EGI Community Forum 201284 vkoukis@grnet.gr| 20120328

85. Greek Research and Technology Network EGI Community Forum 201285 vkoukis@grnet.gr| 20120328

86. Greek Research and Technology Network EGI Community Forum 201286 vkoukis@grnet.gr| 20120328

87. Greek Research and Technology Network EGI Community Forum 201287 vkoukis@grnet.gr| 20120328

88. Greek Research and Technology Network EGI Community Forum 201288 vkoukis@grnet.gr| 20120328

89. Greek Research and Technology Network EGI Community Forum 201289 vkoukis@grnet.gr| 20120328

90. Greek Research and Technology Network EGI Community Forum 201290 vkoukis@grnet.gr| 20120328

91. Greek Research and Technology Network EGI Community Forum 201291 vkoukis@grnet.gr| 20120328

92. Greek Research and Technology Network EGI Community Forum 201292 vkoukis@grnet.gr| 20120328

93. Greek Research and Technology Network EGI Community Forum 201293 vkoukis@grnet.gr| 20120328

94. Greek Research and Technology Network EGI Community Forum 201294 vkoukis@grnet.gr| 20120328

95. Greek Research and Technology Network EGI Community Forum 201295 vkoukis@grnet.gr| 20120328

96. Greek Research and Technology Network EGI Community Forum 201296 vkoukis@grnet.gr| 20120328

97. Greek Research and Technology Network EGI Community Forum 201297 vkoukis@grnet.gr| 20120328

98. Greek Research and Technology Network EGI Community Forum 201298 vkoukis@grnet.gr| 20120328

99. Greek Research and Technology Network EGI Community Forum 201299 vkoukis@grnet.gr| 20120328

100. Greek Research and Technology Network EGI Community Forum 2012100 vkoukis@grnet.gr| 20120328

101. Greek Research and Technology Network EGI Community Forum 2012101 vkoukis@grnet.gr| 20120328

102. Greek Research and Technology Network EGI Community Forum 2012102 vkoukis@grnet.gr| 20120328

103. Greek Research and Technology Network EGI Community Forum 2012103 vkoukis@grnet.gr| 20120328

104. Greek Research and Technology Network EGI Community Forum 2012104 vkoukis@grnet.gr| 20120328

105. Greek Research and Technology Network EGI Community Forum 2012105 vkoukis@grnet.gr| 20120328

106. Greek Research and Technology Network EGI Community Forum 2012106 vkoukis@grnet.gr| 20120328

107. Greek Research and Technology Network EGI Community Forum 2012107 vkoukis@grnet.gr| 20120328

108. Greek Research and Technology Network EGI Community Forum 2012108 vkoukis@grnet.gr| 20120328

109. Greek Research and Technology Network EGI Community Forum 2012109 vkoukis@grnet.gr| 20120328

110. Greek Research and Technology Network EGI Community Forum 2012110 vkoukis@grnet.gr| 20120328

111. Greek Research and Technology NetworkEGI Community Forum 2012111 vkoukis@grnet.gr| 20120328 Opensource  Synnefo: Cyclades / Pithos+ / Astakos  https://code.grnet.gr/projects/synnefo  https://code.grnet.gr/projects/pithos  https://code.grnet.gr/projects/astakos  snf-image  https://code.grnet.gr/projects/snf-image  kamaki  https://code.grnet.gr/projects/kamaki  vncauthproxy  https://code.grnet.gr/projects/snf-vncauthproxy pip install or apt-get install everything!

112. https://okeanos.grnet.gr

113. Greek Research and Technology NetworkEGI Community Forum 2012113 vkoukis@grnet.gr| 20120328 Thank You! Questions?

114. Greek Research and Technology Network EGI Community Forum 2012114 vkoukis@grnet.gr| 20120328 Delivering IaaS for the Greek Academic and Research Community Vangelis Koukis vkoukis@grnet.gr Technical Coordinator,  okeanos Project