Presentation is loading. Please wait.

Presentation is loading. Please wait.

Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t DBCF GT Performant and Future Proof: MySQL, Memcache and Raspberry Pi.

Published bySpencer McGee Modified over 9 years ago

Similar presentations

Presentation on theme: "Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t DBCF GT Performant and Future Proof: MySQL, Memcache and Raspberry Pi."— Presentation transcript:

1 Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t DBCF GT Performant and Future Proof: MySQL, Memcache and Raspberry Pi Martin Hellmich ( on behalf of the LCGDM team ) EMI INFSO-RI-261611

2 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT What we do today 1.Dmlite on a Raspberry Pi 2.Using memcached for speedup 3.HTTP load balancing Standard Interfaces to Grid Storage – DPM and LFC Update - 2

3 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT Raspberry Pi 700 MHz ARM11 256 MByte RAM 35US$ Standard Interfaces to Grid Storage – DPM and LFC Update - 3

4 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT DPM on there? Fedora 17 Raspberry Pi Remix DPm on EPEL/Fedora  clean builds Some rebuilds per koji necessary Not the newest development versions Standard Interfaces to Grid Storage – DPM and LFC Update - 4

5 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT memcached Distributed memory cache Usage – Add several cache servers to a head node – Share cache between head nodes – Take load off DB Standard Interfaces to Grid Storage – DPM and LFC Update - 5

6 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT Setup 1 Standard Interfaces to Grid Storage – DPM and LFC Update - 6

7 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT Setup 2 Standard Interfaces to Grid Storage – DPM and LFC Update - 7

8 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT Setup 3 Standard Interfaces to Grid Storage – DPM and LFC Update - 8

9 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT Pen Load Balancer Yum install pen Debug start: sudo pen -daf 80 headnode1.cern.ch \ headnode2.cern.ch Standard Interfaces to Grid Storage – DPM and LFC Update - 9

10 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT Setup 4 Standard Interfaces to Grid Storage – DPM and LFC Update - 10

11 CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t GT References Fedora 17 Raspberry Pi Remix http://zenit.senecac.on.ca/wiki/index.php/Raspberr y_Pi_Fedora_Remix Dmlite memcache plugin https://svnweb.cern.ch/trac/lcgdm/wiki/Dpm/Dev/ Dmlite/Plugins/Memcache Memcached wiki http://code.google.com/p/memcached/wiki/NewSt art Pen Load Balancer http://siag.nu/pen/ http://blog.miketoscano.com/?p=7 Standard Interfaces to Grid Storage – DPM and LFC Update - 11

Download ppt "Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t DBCF GT Performant and Future Proof: MySQL, Memcache and Raspberry Pi."

Similar presentations

DPM Monitoring Wahid Bhimji University of Edinburgh, Apr-101Wahid Bhimji – Files access.

DPM Monitoring Wahid Bhimji University of Edinburgh, Apr-101Wahid Bhimji – Files access.
HDFS and S3 plugins Andrea Manzi Martin Hellmich 13/12/2013.

HDFS and S3 plugins Andrea Manzi Martin Hellmich 13/12/2013.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t DBCF GT dpm-xrootd v3 Creating Federated Data Stores for the LHC David.

Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT dpm-xrootd v3 Creating Federated Data Stores for the LHC David.
CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t Data & Storage Services Technical student CERN IT-DSS-FDO University of Vigo WCSFSS 2014.

CERN IT Department CH-1211 Geneva 23 Switzerland t Data & Storage Services Technical student CERN IT-DSS-FDO University of Vigo WCSFSS 2014.
O. Keeble, F. Furano, A. Manzi, A. Ayllon, I. Calvet, M. Hellmich DPM Workshop 2014 DPM Monitoring.

O. Keeble, F. Furano, A. Manzi, A. Ayllon, I. Calvet, M. Hellmich DPM Workshop 2014 DPM Monitoring.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t OIS Open source web analytics.

Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Open source web analytics.
Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t DBCF GT Simplifying Configuration Ricardo Rocha ( on behalf of the LCGDM.

Grid Technology CERN IT Department CH-1211 Geneva 23 Switzerland t DBCF GT Simplifying Configuration Ricardo Rocha ( on behalf of the LCGDM.
CERN - IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t SVN Pilot: CVS Replacement Manuel Guijarro Jonatan Hugo Hugosson Artur Wiecek David.

CERN - IT Department CH-1211 Genève 23 Switzerland t SVN Pilot: CVS Replacement Manuel Guijarro Jonatan Hugo Hugosson Artur Wiecek David.
CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Integrating Lemon Monitoring and Alarming System with the new CERN Agile Infrastructure.

CERN IT Department CH-1211 Genève 23 Switzerland t Integrating Lemon Monitoring and Alarming System with the new CERN Agile Infrastructure.
CERN - IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.

CERN - IT Department CH-1211 Genève 23 Switzerland t Monitoring the ATLAS Distributed Data Management System Ricardo Rocha (CERN) on behalf.
CERN - IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t The High Performance Archiver for the LHC Experiments Manuel Gonzalez Berges CERN, Geneva.

CERN - IT Department CH-1211 Genève 23 Switzerland t The High Performance Archiver for the LHC Experiments Manuel Gonzalez Berges CERN, Geneva.
CERN IT Department CH-1211 Geneva 23 Switzerland t CF Messaging System Ivan, Omar, Sergio 14 march 2012.

CERN IT Department CH-1211 Geneva 23 Switzerland t CF Messaging System Ivan, Omar, Sergio 14 march 2012.
Operating Systems & Infrastructure Services CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t OIS OIS Feedback on Module Responsibilities.

Operating Systems & Infrastructure Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS OIS Feedback on Module Responsibilities.
CERN - IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.

CERN - IT Department CH-1211 Genève 23 Switzerland t Tier0 database extensions and multi-core/64 bit studies Maria Girone, CERN IT-PSS LCG.
CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t EIS section review of recent activities Harry Renshall Andrea Sciabà IT-GS group meeting.

CERN IT Department CH-1211 Genève 23 Switzerland t EIS section review of recent activities Harry Renshall Andrea Sciabà IT-GS group meeting.
CERN IT Department CH-1211 Genève 23 Switzerland www.cern.ch/i t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.

CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t OIS Drupal Database Selection Tim Bell 6 th June.

Operating Systems & Information Services CERN IT Department CH-1211 Geneva 23 Switzerland t OIS Drupal Database Selection Tim Bell 6 th June.
CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, 13-14 November 2008.

CERN IT Department CH-1211 Geneva 23 Switzerland t Storageware Flavia Donno CERN WLCG Collaboration Workshop CERN, November 2008.
Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland www.cern.ch/i t PES Network as a Service Use cases for load balancing.

Platform & Engineering Services CERN IT Department CH-1211 Geneva 23 Switzerland t PES Network as a Service Use cases for load balancing.
MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/2015 21/01/15 2.

MW Readiness Verification Status Andrea Manzi IT/SDC 21/01/ /01/15 2.

Similar presentations

Ads by Google