1. IBM Systems Group © 2005 IBM Corporationv 3.04 This presentation is intended for the education of IBM and Business Partner sales personnel. It should not be distributed to customers. Resource Dependency Services V2R1M0 September 13, 2005 Jeremy Bauer (jrbauer@us.ibm.com)@us.ibm.com

2. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 2 Agenda §Highlights §Overview §RDS Architecture §Install Artifacts and Configuration §Data Collector Configuration §Collection Results §Problem Determination

3. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 3 Resource Dependency Services Highlights §Provides resource and relationship discovery and collection services from many data sources §Provides a common repository for resources §Supports many resource types §Includes Intelligent Device Discovery for network level scanning §Integrated with Virtualization Engine Security §Provides Topology Web services - used by Virtualization Engine Console for topology generation §Provides viewable resource topologies from the Virtualization Engine Console

4. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 4 Overview

5. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 5 Overview DB2 eWLM IDDTivoli TBSM TAM DB2DirectorCICS WAS Resource Analysis: Discover & collect data from various sources Create a common representation of resources using ODI models Correlate between representations of the same asset across different data sources Analyze, determine and represent relationships Format information for target data store Source Specific Data Extractors Web based configuration Programmatic Consumers: On Demand infrastructre components IBM Products (VEC, BR) Vendors Etc, etc Web Services OS Specific Vendor Interfaces HTTP

6. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 6 Product Requirements §RDS only runs on Linux! (x,i,p, & z Linux) §The WAS VE Management Server profile §The VE Console §DB2 8.2 §IBM Tivoli Directory Server

7. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 7 §Install –RDS is a VE installable unit §Data Collectors –Use scanning and probe technology for resource discovery §Federation –Federate multiple data sources into the RDS model §Analytics Engine/Correlation Engine –Query engine and resource correlator §Intelligent Device Discovery –Base scanning technology from IBM Zurich Research §Configuration –Web-based configuration of data collectors, scheduling, trace/logs §Web Services –Data services –Collection services –Topology services –Resource services RDS Components

8. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 8 RDS Data Collectors §Data Collectors discover and collect information from existing customer applications and repositories, databases, and domain managers.  The remote Data Collector indicates that the collecting process runs on the RDS management server and remotely accesses the specific data source.  In general, the functionality of the remote Data Collectors is as follows: §Connect with the existing remote target. JDBC, JMX, and ODBC are commonly used for this. These targets can be:  repositories (accessible via database connectivity)  applications (accessible via APIs)  domain managers (like EWLM, accessible via APIs)  specific platform / OS implementations (accessible via OS specific supported interfaces like remote job submissions) §Discover and acquire data specific to RDS functionality §Analyze, transform, and correlate the data into RDS resource model §Store appropriate information in the RDS datastore.

9. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 9 RDS Data Sources / Application Environments Incorporate information derived from explicitly ARM instrumented components eWLM Mine metadata about WAS and WAS MQ applications and associated data stores WebSphere Application Svr / MQ Mine metadata about database instances, and associated volumes DB2 for zSeries, Distributed (UDB), and iSeries Incorporate physical topology information found in Director inventories Director Mine metadata about applications, programs, transactions and associated data stores – leverages CPSM interfaces CICS Incorporate business function, server, and storage information from TBSM and TAM repositories Tivoli TBSM and TAM Mine OS services as required to fill gaps, and employ new discovery mechanisms for baseline discovery of IT infrastructure OS Specific and other discovery mechanisms

10. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 10 Discovered/Collected Resource Types ApplicationsAn application is a program that runs within a hosting container or an operating system instance. Data ContainersData containers are like file systems, containing collections of files and attributes associated with those files. Database InstancesA database instance is a collection of interrelated or independent data items stored together to serve one or more applications. Hosting ContainersHosting containers are programs or applications that host other applications (e.g. WAS). Network DevicesNetwork devices are special purpose, dedicated computers like routers and load balancers that help manage network traffic. Network InterfacesA network interface (also known as a network interface controller or NIC) provides the interface control between a system and an external high-speed network. Network SubnetsA subnet is an interconnected, but independent segment of an entire network that is identified by its Internet Protocol (IP) address. Operating SystemsAn operating system is a collection of system programs that control the overall operation of a computer system. ServicesA service is a process or sub-process used to automate common tasks such as verifying security credentials or calibrating system clocks. Storage VolumesA storage volume represents a medium used for storage of data on a computer. A storage volume can be an entire physical hard disk, or portions of a hard disk. SystemsA system represents physical computers or virtual computers, such as logical or physical partitions.

11. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 11 Resource Model

12. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 12 RDS Architecture

13. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 13 Architecture

14. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 14 Architecture – Collection & Discovery

15. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 15 Resources Manageable Resources

16. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 16 RDS in the VE - A User’s Perspective §It can be difficult to explain the process from RDS discovery to having viewable resources in the VE Console Topology Viewer §Getting from RDS Discovery to VEC Topology: 1.Configure and schedule one or more data collectors. 2.Collection runs and then RDS correlation is run. 3.During RDS correlation, if a resource has the key attributes to create a manageable resource, that resource is created. A manageable resource is built using the resource virtualization framework. RDS supplies resources for all of its resource types. 4.Relationships between resources are also specified by RDS between manageable resources. §An import thing to note – RDS can discover many resources that it will not have enough attributes to create a manageable resource viewable from the VEC

17. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 17 Intelligent Device Discovery

18. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 18 Intelligent Device Discovery (IDD) §Base RDS discovery component §An IBM developed tool used to discover and capture all IP network attached devices §It is a network-based IT asset discovery and categorization tool integrating various established network discovery / fingerprinting programs and aggregates their output into a single best-of-breed application built upon an IBM WebSphere Application Server e-business platform. §Totally non-intrusive. No modifications are made to any device discovered. §No software agents or special User/Admin rights are required and nothing is installed or executed on any PC, Server, etc… (Level 1 scanning) §Network directed packets and “smart pings” (No network broadcasts) are used to capture data §Network device discovery includes PC’s, Intel and Unix Servers, LAN Printers, and Network Devices (routers, hubs, etc…)

19. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 19 IDD – Architectural Approach §Windows and Linux used in conjunction to scan the network §Typically Scan IP Ranges 2-3 times to increase accuracy §Portfolio of Scanners/Collectors to identify devices §DB2 used to store the data

20. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 20 IDD - Architecture

21. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 21 Install Artifacts §RDS creates two databases “RMS1” and “RTSDB” in the DB2 instance specified at install time (may be either local or remote, but must be UDB) §RDS installs several enterprise applications in the WAS VEMS profile –RMS.ear : Base RDS functionality. –Application.ear, DataContainer.ear, NetworkDevice.ear, Subnet.ear, OSContainer.ear, OperatingSystem.ear, Container.ear, DatabaseInstance.ear, Service.ear, NetworkDevice.ear, HostingContainer.ear, StorageVolume.ear : Manageable Resources –RTS.ear : RDS Resource Topology Services §IDD Install –Many IDD RPM’s and utility RPMs

22. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 22 RDS Administration

23. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 23 Configuration and Administration UI §Available from the Virtualization Engine Console §Console can be installed on the same or different server than RDS §Configure data collectors §Configure Intelligent Device Discovery §View discovered resources §Configure custom collectors

24. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 24 Finding Resource Dependency Services Available from the Virtualization Engine Console -> Virtualization Engine Setup -> Resource Dependency Service Configuration Navigation Item

25. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 25 Configure Intelligent Device Discovery §Typically the first scan §Finds many base resources such as Systems and Network Devices §Default Campaign “Baseline” is provided §A “Campaign” is a set of configuration parameters

26. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 26 Configure IDD – General Properties §Campaign name §Base Campaign §Short vs. long running §Probe depth

27. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 27 Configure IDD - Credentials §Configure credentials for “scopes” §Add, remove, update credentials

28. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 28 Configure IDD – Credential Scopes §Configure SNMP, WMI, or SSH credentials §Scope can apply to multiple IPs and ranges of IPs

29. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 29 Configure IDD - Network §Configure individual IPs to include or ranges of IPs. §Configure hosts to exclude from the scan §Valid ranges include: –192.168.0.* –192.168.0.1-192.168.0.5 –192.168.0.1;192.168.0.2

30. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 30 Configure Data Collectors for Standard Resources §Create new collectors §Run data collectors §Modify data collectors §Remove data collectors §View status of last run

31. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 31 Configure Data Collectors – New… §Choose the type of collector to create §TBSM, TCM, DCM, IBM Director, EWLM, iSeries, DB2 UDB, WebSphere AS and MQ, and zSeries z/OS

32. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 32 TBSM Data Collector §TBSM uses Microsoft SQL Server as its repository §Choose the SQL Server hostname, port, and database name §Choose “Credentials” to specify credentials §Uses JDBC

33. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 33 TCM Data Collector §The TCM collector accesses the DB2 TCM repository §Specify the hostname, port, database name, and schema of the TCM repository §Choose “Credentials” to specify credentials §Uses JDBC

34. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 34 DCM Data Collector §The DCM collector accesses the DB2 DCM repository §Specify the hostname, port, database name, and schema of the DCM repository §Choose “Credentials” to specify credentials §Uses JDBC

35. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 35 IBM Director Data Collector §Specify hostname of IBM Director Server §Choose “Credentials” to specify credentials §Uses IBM Director Remote SDK

36. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 36 EWLM Data Collector §Specify hostname & port of EWLM host §Specify credentials §EWLM must be installed on same server as RDS §Uses EWLM JMX API

37. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 37 iSeries Data Collector §Specify hostname §Choose whether to use a secure connection (SSL) §SSL must be configured by the user §Specify credentials §Uses IBM Toolbox for Java

38. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 38 DB2 UDB Data Collector - General §DB UDB – Windows, Linux, and Unix platforms §Specify hostname §Choose instances §Uses JDBC

39. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 39 DB2 UDB Data Collector – New Instance §Specify which instances to collect §Specify instance name, port, and optional database names §Set credentials

40. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 40 WebSphere MQ Data Collector §Specify hostname §Specify port and queue manager §Uses JMS

41. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 41 WebSphere Application Server Data Collector §Specify hostname §Specify SOAP admin port (not the http/https admin port) of the WAS server §Set credentials §Uses SOAP over HTTP

42. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 42 zSeries z/OS Data Collector - General §Specify hostname §Specify whether to use a secure connection (SFTP) §Specify port §Set credentials §Uses FTP or SFTP

43. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 43 zSeries z/OS Data Collector - FTP §Set time to wait for Job to return §Set time to wait to go retrieve output if JES wait timed out §Set number of times to attempt FTP’ing output

44. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 44 zSeries z/OS Data Collector - JCL §zSeries collector runs JCL on the host system §Contains JOB Card and JCL §JCL can be modified, if necessary, by a user §JCL can be processed asynchronously §JCL can include other components like CPSM, DB2, and IMS

45. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 45 zSeries z/OS Data Collector - CPSM §Specify CICS CMAS and version §Available CICS CMAS configuration can be used

46. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 46 zSeries z/OS Data Collector – DB2 §Collect from DB2 Subsystems §Add one or more DB2 subsystem names

47. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 47 zSeries z/OS Data Collector - WSAA §Collect data from WebSphere Studio Asset Analyzer §Specify WSAA subsystem and Schema

48. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 48 zSeries z/OS Data Collector – IMS DB §Collect data from IMS database subsystems §Specify the subsystem ID

49. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 49 zSeries z/OS Data Collector – IMS TM §Collect data from the IMS Transaction Manager §Specify IMS Transaction Manager subsystem ID(s)

50. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 50 Scheduling Data Collectors §Each collector can be scheduled to run at a future date and time §Calendar tool to help chose a start date §Collection can occur once or be repeated daily, weekly, or every two weeks §Disable scheduled collection by choosing not to collect

51. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 51 More on Data Collectors §Data collectors run asynchronously §Very simplified status available from the administration panel §WebSphere logs must be viewed for detailed status and messages §One of each type of data collector may run at once to prevent memory overruns and performance issues. §Data collectors of a given type will be queued up if a collector of the same type is already running. §Queued collectors will run after running collectors complete §Collection times vary based on amount of data collected, resource availability, etc.

52. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 52 Configuring Resource Discovery §Work with OS Containers §View other resource types §View resources in tabular form §Allows sorting & filtering

53. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 53 Configuring Resource Discoveries – OS Containers §View discovered OS Containers §Can be used as a starting point to create new data collectors §Data collector will automatically inherit the host name and default port

54. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 54 Configuring Resource Discovery – OS Instance §View OS Instances §View attributes including RDS Identifier §Viewable indicator shows if resource is viewable in the topology viewer

55. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 55 Download Windows IDD Helper §IDD Helper allows additional data to be collected from Windows Servers §Installs on a single Windows server §Must be configured to connect back to the RDS server during install §Securely communicates with server over SSL §Requires and installs IBM JRE if JRE is not available on the Windows Server

56. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 56 Configure Logging and Tracing §RDS Administration links to RDS server WebSphere Administration Console §Logging and tracing all configured through the WebSphere Administration console §Configurable per RDS component §Can specify log/trace level §Can specify which file to use for trace output

57. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 57 Finding Logging and Tracing §Choose the VEMS server Available from the Troubleshooting -> Logs and Trace Navigation Item

58. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 58 Setting up Log and Trace §Choose Diagnostic Trace to turn on Trace log §Choose Change Log Detail levels to configure which components are logged and/or traced to the trace log

59. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 59 Enabling the Trace Log §Check ‘Enable log’ to enable the trace log §Choose ‘File’ to log to a file §Set the max file size §Set the number of historical files

60. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 60 Change the detailed trace levels §Patience is a virtue! §com.ibm.rms.log.* package for RDS logging levels §com.ibm.rms.trc.* package for RDS trace levels

61. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 61 Additional Resources §IDD Homepage at Zurich Research Labs https://idd.zurich.ibm.com/idd2/web/index.jsp https://idd.zurich.ibm.com/idd2/web/index.jsp §RDS in IBM Infocenter URL Available at a later date

62. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 62 Questions…

63. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 63 Notices Produced in the United States of America, 08/04, All Rights Reserved IBM, IBM eServer logo, IBM logo, e-business on demand, DB2, DB2 Connect, DB2 Universal Database, HiperSockets, Enterprise Storage Server, Performance Toolkit for VM, Tivoli, TotalStorage, VM/ESA, WebSphere, z/OS, z/VM and zSeries are trademarks or registered trademarks of International Business Machines Corporation in the United States, other countries or both. Java and all Java-based trademarks and logos are trademarks of Sun Microsystems, Inc. in the United States, other countries or both. UNIX is a registered trademark of The Open Group in the United States and other countries. Intel is a trademark of Intel Corporation in the United States, other countries or both. Linux is a trademark of Linus Torvalds in the United States, other countries, or both. Microsoft, Windows and Windows NT are registered trademarks of Microsoft Corporation Other company, product and service names may be trademarks or service marks of others.

64. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 64 Notices – cont’d Information concerning non-IBM products was obtained from the suppliers of their products or their published announcements. Questions on the capabilities of the non-IBM products should be addressed with the suppliers. IBM hardware products are manufactured from new parts, or new and serviceable used parts. Regardless, our warranty terms apply. IBM may not offer the products, services or features discussed in this document in other countries, and the information may be subject to change without notice. Consult your local IBM business contact for information on the product or services available in your area. All statements regarding IBM’s future direction and intent are subject to change or withdrawal without notice, and represent goals and objectives only. Performance is in Internal Throughput Rate (ITR) ratio based on measurements and projections using standard IBM benchmarks in a controlled environment. The actual throughput that any user will experience will vary depending upon considerations such as the amount of multiprogramming in the user’s job stream, the I/O configuration, the storage configuration, and the workload processed. Therefore, no assurance can be given that an individual user will achieve throughput improvements equivalent to the performance ratios

65. IBM Systems Group © 2005 IBM Corporation Template Version 3.05 IBM Systems Group Field Skills & Educationpage 65 End Of Presentation