IGOR MANDRICHENKO 6/16/2014 Database Applications Update.

Slides:



Advertisements
Similar presentations
Reinventing using REST. Anything addressable by a URI is called a resource GET, PUT, POST, DELETE WebDAV (MOVE, LOCK)
Advertisements

CHAPTER 15 WEBPAGE OPTIMIZATION. LEARNING OBJECTIVES How to test your web-page performance How browser and server interactions impact performance What.
WSUS Presented by: Nada Abdullah Ahmed.
PC Application
High Availability 24 hours a day, 7 days a week, 365 days a year… Vik Nagjee Product Manager, Core Technologies InterSystems Corporation.
Maxim Zhvirblya EPAM Systems © 2013 Or make MSSQL breathe easily RBS and Blob Cache in SharePoint 2013.
Experience In Developing Dynamic Web Interfaces: The Case Study of the ALICE Job Reliability Dashboard Eamonn Maguire IT-PSS 30-Aug
1 Content Delivery Networks iBAND2 May 24, 1999 Dave Farber CTO Sandpiper Networks, Inc.
IT:Network:Applications VIRTUAL DESKTOP INFRASTRUCTURE.
Cambodia-India Entrepreneurship Development Centre - : :.... :-:-
F Fermilab Database Experience in Run II Fermilab Run II Database Requirements Online databases are maintained at each experiment and are critical for.
CHEP2006 Network Information and Management Infrastructure Igor Mandrichenko, Eileen Berman, Phil DeMar, Maxim Grigoriev, Joe Klemencic, Donna Lamore,
Data Grid Web Services Chip Watson Jie Chen, Ying Chen, Bryan Hess, Walt Akers.
VMware vCenter Server Module 4.
Installing and Setting up mongoDB replica set PREPARED BY SUDHEER KONDLA SOLUTIONS ARCHITECT.
Simplify your Job – Automatic Storage Management Angelo Session id:
1 Copyright © 2005, Oracle. All rights reserved. Introduction.
Client/Server Architectures
Database Update Kaveh Ranjbar Database Department Manager, RIPE NCC.

Introduction to ASP.NET. Prehistory of ASP.NET Original Internet – text based WWW – static graphical content  HTML (client-side) Need for interactive.
Web 2.0: Concepts and Applications 6 Linking Data.
Using the SAS® Information Delivery Portal
Chapter 8 Implementing Disaster Recovery and High Availability Hands-On Virtual Computing.
Infrastructure for Better Quality Internet Access & Web Publishing without Increasing Bandwidth Prof. Chi Chi Hung School of Computing, National University.
Indo-US Workshop, June23-25, 2003 Building Digital Libraries for Communities using Kepler Framework M. Zubair Old Dominion University.
Scientific Linux Infrastructure Changes Connie Sieh Pat Riehecky Hepix Fall 2012 Oct 15, 2012.
CMW-Admin Joel Lauener BE-CO-IN. CMW-Admin Administration GUI for CMW device servers (FESA, FGC, GM, PROXY, PVSS) Major changes under the hood New log.
Archiving Solutions Software vs. Hosted vs. Appliance Based.
Elizabeth Gallas August 9, 2005 CD Support for D0 Database Projects 1 Elizabeth Gallas Fermilab Computing Division Fermilab CD Grid and Data Management.
C OMPUTING E SSENTIALS Timothy J. O’Leary Linda I. O’Leary Presentations by: Fred Bounds.
WLCG infrastructure monitoring proposal Pablo Saiz IT/SDC/MI 16 th August 2013.
Delta Encoding for HTTP/1.1 Sloutsky Alexander Fink Dmitry Supervised by Lavy Libman.
Digital Literacy Concepts and basic vocabulary. Digital Literacy Knowledge, skills, and behaviors used in digital devices (computers, tablets, smartphones)
Module 9 Planning and Implementing Monitoring and Maintenance.
CERN General Infrastructure Services Department CERN GS Department CH-1211 Geneva 23 Switzerland Db Futures Workshop
CD FY09 Tactical Plan Status FY09 Tactical Plan Status Report for Neutrino Program (MINOS, MINERvA, General) Margaret Votava April 21, 2009 Tactical plan.
Status & development of the software for CALICE-DAQ Tao Wu On behalf of UK Collaboration.
Oct HPS Collaboration Meeting Jeremy McCormick (SLAC) HPS Web 2.0 OR Web Apps and Databases (Oh My!) Jeremy McCormick (SLAC)
MND review. Main directions of work  Development and support of the Experiment Dashboard Applications - Data management monitoring - Job processing monitoring.
1 « Luxembourg, 18 April 2007 « Virtual Library of Official Statistics « Dissemination Working Group.
November 1, 2004 ElizabethGallas -- D0 Luminosity Db 1 D0 Luminosity Database: Checklist for Production Elizabeth Gallas Fermilab Computing Division /
Sponsored by the National Science Foundation 1 March 15, 2011 GENI I&M Update: I&M Service Types, Arrangements, Assembling Goals Architecture Overview.
July 19, 2004Joint Techs – Columbus, OH Network Performance Advisor Tanya M. Brethour NLANR/DAST.
ConTZole Tomáš Kubeš, 2010 atlas-tz-monitoring.cern.ch An Interactive ATLAS Tier-0 Monitoring.
PERFORMANCE MANAGEMENT IMPROVING PERFORMANCE TECHNIQUES Network management system 1.
Computing Infrastructure – Minos 2009/12 ● Downtime schedule – 3 rd Thur monthly ● Dcache upgrades ● Condor / Grid status ● Bluearc performance – cpn lock.
Overview Institution 1 Institution 2 RS RS- Reputation Service Virtual Organization 1 RS Institution 3 Institution 4 RS GRID Virtual Organization 2 RS.
Copyright ©2016 WatchGuard Technologies, Inc. All Rights Reserved WatchGuard Training What’s New in Dimension v2.1.1.
Virtualization of Infrastructure as a Service (IaaS): Redundancy Mechanism of the Controller Node in OpenStack Cloud Computing Platform BY Shahed murshed.
Senior Consultant, MSX Group, LLC
High Availability 24 hours a day, 7 days a week, 365 days a year…
CIIT-Human Computer Interaction-CSC456-Fall-2015-Mr
Distributed Cache Technology in Cloud Computing and its Application in the GIS Software Wang Qi Zhu Yitong Peng Cheng
Technology Strategy Update
SPS Spotlight Series November 2013
POW MND section.
CHAPTER 3 Architectures for Distributed Systems
OpenStack Ani Bicaku 18/04/ © (SG)² Konsortium.
Chapter 12: Automated data collection methods
SharePoint 2019 Changes Point of View.
A Web-Based Data Grid Chip Watson, Ian Bird, Jie Chen,
Cloud computing mechanisms
Information Technology Ms. Abeer Helwa
MVC Controllers.
Network management system
Client/Server Computing and Web Technologies
Setting up PostgreSQL for Production in AWS
SDMX IT Tools SDMX Registry
Presentation transcript:

IGOR MANDRICHENKO 6/16/2014 Database Applications Update

IFBeam DB 6/4/13 SCD FIFE Workshop 2 Migrated to new DB servers, they should last for 3 years  Redesigned DB as it is becoming “large database”  Table partitioning: truncate partition instead of deleting old rows  Better indexes  No downtime during migration thanks to redundancy built into the system Major improvements in device and collector management  Authorized users manage their own device sets (bundles)  Collectors receive new bundle definitions automatically

IFBeam DB High Availability and Continuity  Added 3 rd database replica to the chain  In case one DB server fails, we still have 2 replicas  Virtual IP address to follow master DB instance to reduce downtimes off-hours  With DBAs and SSS, work in progress Presented the system to LBNE  No major changes needed  More data to collect – more disk space 6/4/13 SCD FIFE Workshop 3

IFBeam DB 6/4/13 SCD FIFE Workshop 4 Monitoring  Improvements in NuMI Beam Line monitoring  Added chart caching  Working on moving the plotting to the browser  New System Status page – real time status of the system  Help shifters see and diagnose problems Negotiating off-hours support with PPD

Conditions Databases NOvA Conditions DB generalized into ConDB product  In use by NOvA  NOvA is still working on higher level application interface  LBNE is interested Minerva Conditions DB is another, simpler option  In use by Minerva  uBooNe is looking at it 6/4/13 SCD FIFE Workshop 5

Collaboration Applications ECL Suite  Last release – March 2014  Import/export list of users, institutions, affiliations  User requests  Preparation for integration with HCM  Added Speakers Bureau to the Suite  Developed for DES initially  Other improvements  New GUI style  Saved searches shown as links  Improvements in the shift points quota calculations  High availability ECL database for Minerva and MINOS  Mostly DBAs, SSS, work in progress 6/4/13 SCD FIFE Workshop 6

Redundant Web Services Infrastructure Performance improvements  Added 2 virtual GPCF machines as data servers  Added squid caching for IFBeam DB and NOvA Conditions DB, which gave us significant performance improvement Resource management  HTTP proxy for data services – added more resource monitoring functions Improvements in WDA (web data access library, part of ifdh)  Better delayed retry mechanism  IFBeam DB and conditions databases Higher Availability  Adding GPCF2 ? SCD Cluster ? 6/4/13 SCD FIFE Workshop 7

DES 6/4/13 SCD FIFE Workshop 8 Released DES Publication Board into production More data selection, plotting functionality for the Telemetry Viewer

Web Application Development Framework 6/4/13 SCD FIFE Workshop 9 Common framework used to build data and interactive applications and components