1. Cybera Site Report
PRESENTED BY Joe Topjian
31/01/2017
@cybera

2. Who Am I? Joe Topjian Calgary, Alberta, Canada Cybera @cybera
Cybera is the provincial NREN of Alberta.
CANARIE is the federal NREN, which you might have heard of.
@cybera

3. Who Am I?

4. Who Am I?
Here's a partial view of the global Research and Education network.
The dark blue lines represent the Canadian provincial NRENs.

5. Who Am I?
The green represents Cybera's network within Alberta.

6. Rapid Access Cloud
We provide other services on top of our network. The Rapid Access Cloud is one of them.
RAC is a free OpenStack cloud available to anyone in Alberta.

7. Rapid Access Cloud
The spike you see is a large class from the University of Alberta.
But ignoring that, we see a steady increase in use of the cloud.

8. Block Storage Hypervisors virtual machines
Remember: Block Storage provides virtual machines with a persistent attachable disk drive.
Each hypervisor in the cloud has a series of hard drives. Some of them host virtual machines.
virtual machines
Hypervisors

9. Block Storage Hypervisors
We decided to create a gluster cluster out of drives from each hypervisor and
use the OpenStack Cinder GlusterFS driver for our block storage service.
Hypervisors

10. Because no one else was doing it Converged Compute and Storage
Block Storage
Why??
Because no one else was doing it
Converged Compute and Storage
Resilient volumes
Volumes were "plain files"
@cybera

11. Block Storage
$ file volume-f86d8747…
QEMU QCOW Image (unknown version) $ du -sh volume-f86d8747… 608K volume-f86d8747… $ du -sh --apparent-size volume-f86d8747… 5.1G volume-f86d8747…

12. Block Storage
Reality:
Gluster is weird
ElasticSearch would kill the cloud

13. Block Storage
LVM / iSCSI Block Storage
Dedicated hardware
LVM Groups Exported via iSCSI
Switched From virtio to virtio-scsi

14. Block Storage virtio-scsi $ glance image-show c054f947...
Property 'hw_disk_bus' | scsi
Property 'hw_disk_bus_model' | virtio-scsi
Property 'hw_scsi_model' | virtio-scsi
Drives show up as /dev/sdx instead of /dev/vdx
mdadm and zfs work much better.
virtio-scsi is configured as a property in OpenStack images.

15. Block Storage Volume Affinity
$ cinder create --display-name vol01 5 $ cinder create --display-name vol02 5 \ --hint different_host=xxx
$ cinder create --display-name vol03 5 \ --hint different_host=xxx \ --hint different_host=yyy

16. Block Storage
Future Features
Encryption at Rest

17. Object Storage
OpenStack Swift Encryption at Rest
Newton Release
Google "swift encryption at rest"

18. Object Storage
Test:
$ echo "hello world" > file.txt $ swift upload test file.txt

19. Object Storage
Before:
$ cd /srv/node/sdx/objects/... $ grep -R "hello world" *
522/004/10… hello world

20. Object Storage
After:
$ cd /srv/node/sdx/objects/... $ grep -R "hello world" *

21. App Catalog

22. App Catalog

23. App Catalog

24. App Catalog

25. App Catalog

26. App Catalog

27. App Catalog
Future Data/Storage-focused Apps
ownCloud
Spark
Hadoop

28. joe.topjian@cybera.ca twitter.com/cybera
Questions?
Thanks!
twitter.com/cybera