DecisionSite and DiscoveryLink Doug Del Prete IBM Life Sciences Visualizing data in novel ways Spotfire User Conference Boston, MA October.

Slides:



Advertisements
Similar presentations
Integrating ChemAxon technology into your End User Applications Java solutions for cheminformatics Ver. Mar., 2005.
Advertisements

Kensington Oracle Edition: Open Discovery Workflow Meets Oracle 10g Professor Yike Guo.
BI Web Intelligence 4.0. Business Challenges Incorrect decisions based on inadequate data Lack of Ad hoc reporting and analysis Delayed decisions.
DB2 Information Integrator Software
FAST Radar System Engineering Overview. FAST Radar Overview –What’s Required? IIS 6.0  With Microsoft.NET Framework 1.1 and SMTP for MS SQL Server.
Warren Heising and Joe Kennedy, IBM Corp. IBM Information Integration: Federated Queries and
This presentation is intended as a detailed WebEx, to bring potential customers to an understanding of Dream Report capabilities. This presentation focuses.
Institute for Software Science – University of ViennaP.Brezany 1 Databases and the Grid Peter Brezany Institute für Scientific Computing University of.
3-1 Chapter 3 Data and Knowledge Management
Building Enterprise Information Portal using Oracle Portal 3
Unlock Your Data Rich connectivity Robust data integration Enterprise-class manageability Deliver Relevant Information Intuitive design environment.
1 BrainWave Biosolutions Limited Accelerating Life Science Research through Technology.
® IBM Software Group © IBM Corporation IBM Information Server Deliver – Federation Server.
Session-01. Hibernate Framework ? Why we use Hibernate ?
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
CRYSTAL REPORTS Jacob Grogan. CRYSTAL REPORTS AND WHY IT’S USEFUL? “ Crystal Reports is a popular Windows-based report generation program that allows.
Confidential ODBC May 7, Features What is ODBC? Why Create an ODBC Driver for Rochade? How do we Expose Rochade as Relational Transformation.
PI Data Access via OLE DB/SQL
Copyright © 2006, SAS Institute Inc. All rights reserved. Enterprise Guide 4.2 : A Primer SHRUG : Spring 2010 Presented by: Josée Ranger-Lacroix SAS Institute.
September 6, 2015 Connecting Client Applications to Informix Databases using IBM Informix Connect and ODBC James Edmiston Database Consultant Quest Information.
Cizer.NET Reporting Forum for Business Intelligence Copyright © 2005 Cizer Software OR
Ihr Logo Data Explorer - A data profiling tool. Your Logo Agenda  Introduction  Existing System  Limitations of Existing System  Proposed Solution.
MySQL GUI Administration Tools Rob Donahue Manager, Distributed Systems Development May 7th, 2001 Rob Donahue Manager, Distributed Systems Development.
Data Integration Problem How to access data across 22 different data systems, most operating on different hardware, using different software, and having.
M icrosoft Data Warehousing - SQL Server State of the Technology Presentation by Sujata Angara Nakul Johri Sang Ho Park.
SharePoint 2010 Business Intelligence Module 10: Reporting Services.
OPC Database.NET. OPC Systems.NET What is OPC Systems.NET? OPC Systems.NET is a suite of.NET and HTML5 products for SCADA, HMI, Data Historian, and live.
Information Systems Chapter 5 Building the database Part 1. Unsing Access.
Life Sciences Integrated Demo Joyce Peng Senior Product Manager, Life Sciences Oracle Corporation
1 Overview of Databases. 2 Content Databases Example: Access Structure Query language (SQL)
PO320: Reporting with the EPM Solution Keshav Puttaswamy Program Manager Lead Project Business Unit Microsoft Corporation.
Nynox.com Nynox Help Desk Affordable Help Desk Solution.
Fundamentals of Database Chapter 7 Database Technologies.
Best of Both Worlds: Information Management Solutions SmartCore Management Dashboards.
Release 11i Workshops Dallas, TX Raleigh, NC Denver, CO Atlanta, GA Detroit, MI Tim Sharpe Oracle E-Business Suite Release 11i Discoverer.
National Center for Supercomputing Applications NCSA OPIE Presentation November 2000.
SQL Server 2005 Reporting Services: Product Overview Niran Luckcanakul (MCSD, MCDBA, MCT) Project manager ISONET Co.,Ltd.
1 Geospatial and Business Intelligence Jean-Sébastien Turcotte Executive VP San Francisco - April 2007 Streamlining web mapping applications.
1 Chapter Overview Performing Configuration Tasks Setting Up Additional Features Performing Maintenance Tasks.
What is database?  Any Method for access info into Application from DataBase?  ODBC is standard for Accessing Data.  Problem with ODBC:  Information.
Federated Database Set Up Greg Magsamen ITK478 SIA.
3 Copyright © 2009, Oracle. All rights reserved. Accessing Non-Oracle Sources.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Building a Topic Map Repository Xia Lin Drexel University Philadelphia, PA Jian Qin Syracuse University Syracuse, NY * Presented at Knowledge Technologies.
6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.
Copyright © 2006 Pilothouse Consulting Inc. All rights reserved. Search Overview Search Features: WSS and Office Search Architecture Content Sources and.
Building Dashboards SharePoint and Business Intelligence.
© 2006 Altova GmbH. All Rights Reserved. Altova ® Product Line Overview.
Distributed Data Analysis & Dissemination System (D-DADS ) Special Interest Group on Data Integration June 2000.
WEB SERVER SOFTWARE FEATURE SETS
Integrating the Mainframe Liberating Enterprise Data.
Integrating the Mainframe Liberating Enterprise Data.
Copyright 2007, Information Builders. Slide 1 iWay Web Services and WebFOCUS Consumption Michael Florkowski Information Builders.
Relational Database Systems Bartosz Zagorowicz. Flat Databases  Originally databases were flat.  All information was stored in a long text file, called.
Introduction to SQL Server 2000 Reporting Services Jeff Dumas Technical Specialist Microsoft Corporation
SharePoint 2007 Business Intelligence October 23 th, 2008 Neil Iversen - Inetium.
Physical Layer of a Repository. March 6, 2009 Agenda – What is a Repository? –What is meant by Physical Layer? –Data Source, Connection Pool, Tables and.
Microsoft Power Query: an Excel Users Dream for Data Extraction and Cleansing Presented by: Belinda Allen Smith & Allen Consulting, Inc.
1 Copyright © 2008, Oracle. All rights reserved. Repository Basics.
Slide 1 © 2016, Lera Technologies. All Rights Reserved. Oracle Business Intelligence By Lera Technologies.
Microsoft Power Query 101 Belinda Allen Smith & Allen Consulting, Inc.
ODP V2 Data Provider overview. 22 Scope Data Provider provides access to data and metadata of the local data systems. Data Provider is a wrapper, installed.
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
SharePoint 2007 Business Intelligence
11gR2 Integration Extensibility
ODBC, OCCI and JDBC overview
The Client/Server Database Environment
Introduction of Week 11 Return assignment 9-1 Collect assignment 10-1
AIMS Equipment & Automation monitoring solution
Presentation transcript:

DecisionSite and DiscoveryLink Doug Del Prete IBM Life Sciences Visualizing data in novel ways Spotfire User Conference Boston, MA October 28, 2003

DecisionSite and DiscoveryLink 1 What is DiscoveryLink?  DiscoveryLink (DL) is a powerful technology available from IBM that will allow you to view many data sources – even non-relational ones like BLAST and HMMER – as one heterogeneous “virtual relational database”  Basically, a wide variety of data sources are all made to look like SQL-based tables/views, which makes it easy to access them and integrate all of this data together in an optimized way

DecisionSite and DiscoveryLink 2 What is DiscoveryLink?  DiscoveryLink is based on the latest Information Integrator middleware technology, now a major IBM software initiative for data federation/integration  All data sources essentially become “SQL aware”, and do so under a cost-based optimizer that works against both relational and non-relational data sources and their associated queries

DecisionSite and DiscoveryLink 3 Information Integration: Issues For Scientists For IT

DecisionSite and DiscoveryLink 4 Information Integration: Solution For Scientists For IT

DecisionSite and DiscoveryLink 5 Information Integration: Question Q: Show me all the compounds similar to ketanserin that have been tested against members of the serotonin family and have characteristics of a good drug.

DecisionSite and DiscoveryLink 6 Term Operator Value Compound SimilarTo Ketanserin ReceptorHomologousSerotonin IC50<=1E-8 Molwt>375 Molwt<425 logP>4 <6 BLAST WrapperXML Wrapper Oracle Wrapper ODBC Wrapper BLAST Data Source Oracle Compound DB in Germany Assay Results in MySQL Discovery Link Result Set (Visualization ) Parameters IIM Query Solution XML Document Q: Show me all the compounds similar to ketanserin that have been tested against members of the serotonin family and have characteristics of a good drug. Architecture Information Integration: IT Translation

DecisionSite and DiscoveryLink 7 Solution Architecture SELECT a.compound_id, b.ic50, b.screen_name FROM CMPNDDBS a, ACTIVITY_DATA b, BLASTP c WHERE a.compound_id = b.compound_id AND SimilarTo(a.compound_struct,:KETANSERIN_MOL) > 0.88 AND c.input_seq = :SEROTONIN AND c.protein_id = b.screen_name AND b.ic50 <= AND a.mol_wt BETWEEN 375 AND 425 AND a.logP BETWEEN 4 AND 5 DL Query BLAST WrapperXML WrapperOracle WrapperODBC Wrapper BLAST Data Source Oracle Coumpound DB in Germany Assay Results in MySQL Discovery Link Result Set (Visulaizati on) IIM Query XML Document Q: Show me all the compounds similar to ketanserin that have been tested against members of the serotonin family and have characteristics of a good drug. Information Integration: IT Translation

DecisionSite and DiscoveryLink 8 Q: Show me all the compounds similar to ketanserin that have been tested against members of the serotonin family and have characteristics of a good drug. Results Information Integration: Final Result Compnd ID HTR1A US1111 HTR1B US1234 HTR1D US2534 HTR1E US 1111 HTR1F US2534 HTR2A US 1111 HTR2B US4791 HTR2C US 1111 HTR4 US1234 HTR5A US1111 HTR6 US1111 US <

DecisionSite and DiscoveryLink 9 Wrapper instance definition RDB, Spreadsheet, Flat Files, Algorithms, etc. In diverse locations text Rq rs Rq rs Spotfire DecisionSite, Synapsia, Customer Application, SQL command line, etc. (JDBC/ODBC) Information Integrator Views Administration through Information Integrator Control center Catalog DB2 Data loader SwissProt KEGG dbEST Locus Link UNIGENE and more … Wrappers DB2 Oracle Oracle Cartridge MS SQL Server Sybase Informix Teradata ODBC (MySQL, Postgres…) Excel Flat Files in CSV format Documentum Blast XML ENTREZ (NCBI portal) HMMer Extended Search BioRS Wrapper Development Toolkit Server Definition User Mapping Nicknames Definition Optimizer Log Wrappers plan DiscoveryLink – Overall Architecture

DecisionSite and DiscoveryLink 10 DiscoveryLink: A Robust Solution Access to multiple, heterogeneous sources Complex queries across distributed data sources Leverage existing IT infrastructure and use specialized functions of existing databases Integrating analysis tools and business intelligence Can put a SQL front-end and user security on data sources such as BLAST, Pubmed, Genbank, HMMER, XML Can use for fast and easy ad-hoc extensions to a data warehouse/mart Benefits

DecisionSite and DiscoveryLink 11 DiscoveryLink Value Proposition A proven scalable data integration solution that enables efficient and effective queries across disparate data sources, thereby improving R&D efficiencies and productivity. This translates into greater flexibility and competitive advantage in the marketplace.

DecisionSite and DiscoveryLink 12 DecisionSite and DiscoveryLink

13 DecisionSite and DiscoveryLink  DecisionSite, in its own right, can access many data sources to drive its powerful set of visualizations – i.e. any data source that is JDBC compliant can be configured as a data source  But DiscoveryLink as the data access engine can extend the reach of DecisionSite in both the types of data sources and performance/scalability  These two products together provide a robust, flexible “best of breed” approach to analyzing your data:  DecisionSite as the user interface/front-end to DL  DiscoveryLink as a federated data source access engine for DS

DecisionSite and DiscoveryLink 14 DecisionSite Server Information Interaction Services Relational DBMiddleware DB2/ DiscoveryLink JDBC WebServices Txt/csv/etc… DecisionSite and DiscoveryLink BLAST/ HMMER XML Relational (Optimized Joins) Pubmed/ Genbank …

DecisionSite and DiscoveryLink 15 Benefits Overview  Access more data sources – BLAST, HMMER, Genbank, Documentum, BioRS, etc.  Access existing DecisionSite data sources faster/easier – XML, Postgres, MS Access, etc.  Extend/augment an existing visualization with information from any of the above data sources  Optimized queries cross-joined across all data sources – relational and non-relational – all under one JDBC connection

DecisionSite and DiscoveryLink 16 Visualize a BLAST result under DS/DL!

DecisionSite and DiscoveryLink 17 DecisionSite and DiscoveryLink  Based on the natural fit of DiscoveryLink into DecisionSite’s IIM (Information Interaction Model)  Under the Information Interaction Designer (IID), you reference “Nicknames”, which are “virtual tables”, pointing to other tables/views and non- relational objects pre-configured under DiscoveryLink  These data sources naturally available to Information Builder and Information Library/Links, and beyond

DecisionSite and DiscoveryLink 18 DecisionSite and BLAST See how easy it is to configure a data source like BLAST to be used under DecisionSite

DecisionSite and DiscoveryLink 19 Indicate BLAST Server/Algorithm

DecisionSite and DiscoveryLink 20 Configure Defline

DecisionSite and DiscoveryLink 21 View complete BLAST Nickname

DecisionSite and DiscoveryLink 22 Configure under Information Designer

DecisionSite and DiscoveryLink 23 Configure under Information Builder

DecisionSite and DiscoveryLink 24 This is all done quickly and easily, even though there is no JDBC driver for BLAST readily available! DecisionSite and BLAST

DecisionSite and DiscoveryLink 25 DecisionSite and XML Similarly, see how easy it is to configure XML to be used under DecisionSite

DecisionSite and DiscoveryLink 26 Provide XML Schema/File Location

DecisionSite and DiscoveryLink 27 Create all the relational Nicknames

DecisionSite and DiscoveryLink 28 Configure Parent/Child Join

DecisionSite and DiscoveryLink 29 Again, this can all be done quickly and easily, without having to find and manually configure a JDBC driver via a text editor, and then restarting DecisionSite, etc. DecisionSite and XML

DecisionSite and DiscoveryLink 30 Merged Queries - Example  In IID, set up the BLAST and Entrez Data Models  Also the Nucleotide/BLAST join via Accession #  Configure a BLAST Information Link  Configure a Nucleotide Information Link  Run BLAST visualization  From the visualization, run the Entrez Information Link to get all the applicable metadata information about each displayed Accession (in Details-on- Demand, Table, etc.)

DecisionSite and DiscoveryLink 31 Query Optimization  Under IID, configure key Joins under DB2/ DiscoveryLink  This includes established DecisionSite data like Oracle and MySQL (very quickly configured in DiscoveryLink Control Center)  The Information Link makes only one JDBC connection to access all the data sources!  The underlying SQL query invokes the DB2 Optimizer to improve performance even more

DecisionSite and DiscoveryLink 32 Query Optimization  Great for large relational data sets such as joining assay results with a chemical compound database, etc.

DecisionSite and DiscoveryLink 33 DecisionSite and DiscoveryLink - Summary You can extend all the powerful features of DecisionSite, like guided analytics and posters, to visualize information from more data sources, in an easier manner, and do so in an optimized environment

DecisionSite and DiscoveryLink 34 DEMO Visualize a BLAST protein similarity search against SwissProt

Thank you. Doug Del Prete IBM Life Sciences USA Questions?