Eyes Off Glass Dinesh Gode Sr. Technical Specialist Oct 9, 2007
Eyes Off Glass Dinesh Gode
Eyes Off Glass 3 Project’s Goal >Eliminate watching multiple monitors in Command Center >Provide automated recovery related to incidents
Eyes Off Glass 4 Phase 1 - Enhance Health Dashboards Product Infrastructure Customer Software Deployment Phase 2 - Expand drill down capabilities from the Dashboards Incident root cause Infrastructure view (example Pass & e-Ticketing) Scheduled Changes Phase 3 - Automate recovery and notification Eyes Off Glass Three Phases / Targets
Eyes Off Glass 5 >Exploit current automation tools >Consolidate scheduling tool across all platforms Expand use of current deployment tools –ADS (Application Deployment System) is now used for e-Pricing, e-certified & Nexus –Scheduler is now interfaced with ADS which is our homegrown Application Deployment System, Source Integrity & Integrity Manager –Scheduler interfaced with TOS and does over 95% of all TPF utilities >Enhance alerting and self recovery automation Automated self recovery of production e-Pricing Query Servers Automated removal of staging query servers from load balancer Automated recovery and inserting staging query servers >CMDB (Configuration Management Database) How do we get there
Eyes Off Glass 6 Three areas of focus for Automation Routine Activities Recovery & Notification Software Deploy
Eyes Off Glass 7 Enterprise Monitoring TEC TOS, Scheduler, z/OS ServiceCenter (Ticketing) Network & Server Monitoring Application/Database Monitoring End User Experience Business Matrix Host Monitoring TEC Console Microsoft Operations Manager (MOM) Service Manager
Eyes Off Glass 8 Enterprise Automation Scheduler Incident Management Service Center (Ticketing) z/OS Tivoli TEC Changeman TOS ADS Source Integrity Integrity Manager Automation Point TPF GDS (Worldspan) OSS (Delta Operation System Support ) Deltamatic (Delta Res) PreProd Servers
Eyes Off Glass 9 Examples of Dashboard >Server / Network monitoring >Tivoli Enterprise Console (TEC) >Service Manager
Eyes Off Glass 10 Server / Network Monitoring
Eyes Off Glass 11 Server / Network Monitoring
Eyes Off Glass 12 Server / Network Monitoring
Eyes Off Glass 13 Server / Network Monitoring
Eyes Off Glass 14 Server / Network Monitoring
Eyes Off Glass 15 Tivoli Enterprise Console
Eyes Off Glass 16 Tivoli Enterprise Console
Eyes Off Glass 17 Service Manager >Dashboard provides real-time consolidated view Top down business view with drill downs –Consolidated technical & end user experience –Customizable dashboards for individual views Standardize views for Command Center –Business view of the health of major products –Technical view of the current infrastructure health –Real-time status view of software deployment Services Health Application Strategic Customer Suppliers Critical Infrastructure Service Manager
Eyes Off Glass 18 Service Manager (drill down)
Eyes Off Glass 19 Benefits >Automated recovery for TPF Automated scheduled & recovery IPLs of GDS & Pre-Production, saving precious down time Eliminates manual intervention for recovery Eliminates human error >Production Scheduling Worldspan scheduling system, handles about 700 TPF jobs per day (1 every 2 minutes) Worldspan scheduling system handles a grand total of about 23,000 jobs per day Interfaces exist to a hosted major airline’s z/OS system – jobs can be run on demand on either system and hosting information is automatically shared
Eyes Off Glass 20 Benefits >Automated Loads of Middle Tier Servers Eliminates hours of manual tasks for loads Eliminates human error Moves Worldspan closer to a common deployment system >Other Automation Automated ticketing from all platforms TPF production, pre-production, and native testing logs made available throughout Worldspan in file form for in-depth analysis, and real-time form for activity tracking and real-time troubleshooting. TPF database changes have been automated. >Eyes off Glass Audible alerts Automated Recovery on all platforms Service Manager – An enterprise wide business oriented Monitoring System
Eyes Off Glass 21 >Questions? Contact: Dinesh Gode Ernie South