Data Integration Progress. BIRN Data Integration Framework 2. Create conceptual links to a shared ontology 1. Create multimodal databases 3. Situate the.

Slides:



Advertisements
Similar presentations
Interfacing processing and visualization tools: FIPS to Slicer3 and the QueryAtlas.
Advertisements

CACORE TOOLS FEATURES. caCORE SDK Features caCORE Workbench Plugin EA/ArgoUML Plug-in development Integrated support of semantic integration in the plugin.
CM143 Web Week 6 Links & Navigation CSS Styling & Mouseovers.
Data Integration & Ontology Working Group(s) Report and Deliverables.
SWIM WEB PORTAL by Dipti Aswath SWIM Meeting ORNL Oct 15-17, 2007.
Building on the BIRN Workshop BIRN Systems Architecture Overview Philip Papadopoulos – BIRN CC, Systems Architect.
OO Development Process. UML and Process UML standardizes notation, not process –Increase likelihood of widespread acceptance There is significant variability.
New Approaches to GIS and Atlas Production Infrastructure for spatial data integration: across scales and projects Ilya Zaslavsky David Valentine San Diego.
P2P Information Interoperability & Decision Support Domain Application SEMANTIC INTEROP QUERY PROCESSING GIS INTEROP P2P ● Heterogeneous semantic ● Semantic.
Web Interface for the Visually Challenged by: Group Nine.
Editing Description Logic Ontologies with the Protege OWL Plugin.
MSc Education Supporting Infrastructure Emil Doychev Vladimir Valkanov University of Plovdiv Bulgaria.
COHSE Informed WWW Link Navigation Using Ontologies Prof. Carole Goble, Sean Bechhofer Dr. Leslie Carr, Prof. Wendy Hall, Prof. David De Roure, Steve Harris,
System Design/Implementation and Support for Build 2 PDS Management Council Face-to-Face Mountain View, CA Nov 30 - Dec 1, 2011 Sean Hardman.
NA-MIC National Alliance for Medical Image Computing Core 1b – Engineering End-user Platform Steve Pieper Isomics, Inc.
Semantic Interoperability Jérôme Euzenat INRIA & LIG France Natasha Noy Stanford University USA.
Atlas Interoperablity I & II: progress to date, requirements gathering Session I: 8:30 – 10am Session II: 10:15 – 12pm.
CMPS 435 F08 These slides are designed to accompany Web Engineering: A Practitioner’s Approach (McGraw-Hill 2008) by Roger Pressman and David Lowe, copyright.
DYNAMICS CRM AS AN xRM DEVELOPMENT PLATFORM Jim Novak Solution Architect Celedon Partners, LLC
Rahul Raman, Ram Sasisekharan Bioinformatics Core Massachusetts Institute of Technology Glue Grants Bioinformatics Meeting April 22-23, 2004 San Diego,
Atlas Interoperability Session Ilya Zaslavsky, Willy Wong + Bill Bug + Heng Yuan.
BIRN Update Carl Kesselman Professor of Industrial and Systems Engineering Information Sciences Institute Fellow Viterbi School of Engineering University.
FI-CORE Data Context Media Management Chapter Release 4.1 & Sprint Review.
Data Management BIRN supports data intensive activities including: – Imaging, Microscopy, Genomics, Time Series, Analytics and more… BIRN utilities scale:
Mark Ellisman, Ph.D. Professor of Neurosciences and Bioengineering Director, BIRN Coordinating Center Center for Research on Biological Systems University.
Atlas Interoperablity I & II: progress to date, requirements gathering Session I: 8:30 – 10am Session II: 10:15 – 12pm.
1 Schema Registries Steven Hughes, Lou Reich, Dan Crichton NASA 21 October 2015.
Ocean Observatories Initiative Data Management (DM) Subsystem Overview Michael Meisinger September 29, 2009.
The Roadmap to Software Factories Tools, Patterns and Frameworks.
Clinical Measures Genotype Local Storage BIRN Rack SRB MCAT HID/ XNAT/ LONI DUP Calibration & Analysis Tools GRID Portal Mediator Institution A BIRN Rack.
Unified Modeling Language* Keng Siau University of Nebraska-Lincoln *Adapted from “Software Architecture and the UML” by Grady Booch.
2004 All Hands Meeting FBIRN 2005 – Database and Informatics Working Group David Keator.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
The Biomedical Informatics Research Network Carl Kesselman BIRN Principal Investigator Professor of Industrial and Systems Engineering Information Sciences.
ICCS WSES BOF Discussion. Possible Topics Scientific workflows and Grid infrastructure Utilization of computing resources in scientific workflows; Virtual.
Any data..! Any where..! Any time..! Linking Process and Content in a Distributed Spatial Production System Pierre Lafond HydraSpace Solutions Inc
Information Integration BIRN supports integration across complex data sources – Can process wide variety of structured & semi-structured sources (DBMS,
GCRC Meeting 2004 BIRN Coordinating Center Software Development Vicky Rowley.
EZReg Jun Ma Xu Nathan Plesnicher Jerin Schneider Chris Kennewick Sharon Lin Brian Watanabe.
Neuroinformatics Working Group Update 10/26/2009 H Jeremy Bockholt.
MBAT Programmers Meeting From MBAT to WOMBAT Web-based Ontology-based.
Biomedical Informatics Research Network BIRN Workflow Portal.
12 Oct 2003VO Tutorial, ADASS Strasbourg, Data Access Layer (DAL) Tutorial Doug Tody, National Radio Astronomy Observatory T HE US N ATIONAL V IRTUAL.
System/SDWG Update Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
Needs and Progress: Summary Flexible, powerful, modular atlas interface, and a query gateway to multiple types of data (GeneNetwork, Barlow, Smith, CCDB,
LONI Pipeline Jagadeeswaran LONI,UCLA. Site PI: Arthur W Toga Director, Laboratory of Neuro Imaging Co-Director, Brain Mapping Center Director, Training.
CUAHSI HIS: Science Challenges Linking small integrated research sites (
No Euphemisms Required: BIRN on the Leading Edge of Community Ontology Development.
Glossary WMS – OGC Web Mapping Services WFS – OGC Web Feature Services XML- Extensible Markup Language OGC – Open GIS Consortium ADN –
PDS4 Demonstration Management Council Face-to-Face Flagstaff, AZ August 22-23, 2011 Sean Hardman.
MBAT Infrastructure Controversial remarks…. What is an atlas?  a set of 2D images or a 3D volume in a specified coordinate system with a set of spatially.
2007 Mouse All Hands Meeting BIRN Ontology Day Jeff Grethe & Bill Bug (BIRN OTF) - March 7th, 2007.
2005 AHM Mouse BIRN. Goals Review progress on mouse BIRN milestones Update priorities and milestones for SFN, next spring, and next fall 2006 Clarify.
REQUIREMENTS GATHERING Moderators: M Miller Goals: To allow participants to provide feedback to the developers (BIRN-CC and test bed applications) of what.
1 CLASS – Simple NOAA Archive Access Portal SNAAP Eric Kihn and Rob Prentice NGDC CLASS Developers Meeting July 14th, 2008 Simple NOAA Archive Access Portal.
Atlas Interoperablity I & II: progress to date, requirements gathering Session I: 8:30 – 10am Session II: 10:15 – 12pm.
Mouse BIRN AHM 2007 Mouse BIRN-related activities at NCMIR- UCSD & BIRN-CC: “What we did and what we will do. Mouse BIRN-related activities at NCMIR- UCSD.
Biomedical Informatics Research Network The BIRN Architecture: An Overview Jeffrey S. Grethe, BIRN-CC 10/9/02 BIRN All Hands Meeting 2002.
High Risk 1. Ensure productive use of GRID computing through participation of biologists to shape the development of the GRID. 2. Develop user-friendly.
Contributions to mouse BIRN tools and resources Maryann Martone and Mark Ellisman University of California, San Diego 2008.
MBAT Mouse All Hands Meeting What is included in MBAT 1.1 (existing features…) Visualization Tool –3D atlas –Brain Graph –Label, mask volume Query.
Integrated Departmental Information Service IDIS provides integration in three aspects Integrate relational querying and text retrieval Integrate search.
2005 All Hands Meeting Data & Data Integration Working Group Summary.
Origami: Scientific Distributed Workflow in McIDAS-V Maciek Smuga-Otto, Bruce Flynn (also Bob Knuteson, Ray Garcia) SSEC.
All Hands Meeting 2003 BIRN Portal Abel W. Lin. Overview Outline: Purpose of BIRN Portal Architecture Interaction with Grid Tools Functionality Current.
All Hands Meeting 2004 Clinician’s Requirements for HID Query and Statistics Interface Christine Fennema-Notestine, Ph.D. David Kennedy, Ph.D.
All Hands Meeting 2005 BIRN-CC: Building, Maintaining and Maturing a National Information Infrastructure to Enable and Advance Biomedical Research.
BIRN: Where We Have Been, Where We are Going. Carl Kesselman BIRN Principal Investigator Professor of Industrial and Systems Engineering Information Sciences.
UCSD Neuron-Centered Database
Knowledge Based Workflow Building Architecture
Presentation transcript:

Data Integration Progress

BIRN Data Integration Framework 2. Create conceptual links to a shared ontology 1. Create multimodal databases 3. Situate the data in a common spatial framework 4. Use mediator to navigate and query across data sources

Data Integration Deployment & Utilization Significant events in last year related to BIRN data integration progress –Test bed database availability –BIRNLex and BIRN ontology development –Hardening of data integration environment Enhanced production deployment of BIRN Data Integration Environment as part of BIRN 3.0 release –Enhancements driven by distributed queries against BIRN data sources –Significant performance improvements Deployment in the BIRN test beds –Mouse BIRN - Utilization within atlasing environment (i.e. MBAT and SmartAtlas) –Function BIRN - Queries across fBIRN HID databases, addition of BrainMap

BIRN CC – Test Bed Data Integration Deployment Function BIRN –Vadim Astakhov, David Little, Edward Ross, Daniel Wei, Vicky Rowley, David Keator (fBIRN/UCI), Dingying Wei (fBIRN/UCI), Burak Ozyurt (fBIRN/UCSD), Angie Laird/Angela Uecker (BrainMap) Mouse BIRN –Vadim Astakhov, Brian Sanders, Daniel Wei, Steve Anderson (Mouse BIRN/UCLA), Bill Bug (Mouse BIRN/Drexel), Asif Memon (Mouse BIRN/UCSD), Heng Yuan (Mouse BIRN/UCLA) Morphometry BIRN –Vadim Astakhov, David Little, Daniel Wei, Dan Marcus (Morphometry BIRN/WUSTL)

Data Integration Utilization With BIRN 3.0 release, have begun tracking utilization of data integration environment In first month of tracking - more than 2,000 queries were issued

Data Integration Sources Data integration team has worked closely with test beds to register databases from testbeds Registration of external data sources (e.g. BrainMap) Driven by test bed requirements

Access to Data Integration Environment Tool Developers Data Integration Specialists Domain Scientists Web Services Data Integration Tools Concept Based Visual Query Environment

Data Integration Services Data Integration Environment accessible through web service interface Driven by requirements and direct interaction with test beds Utilization in Mouse BIRN Atlas Environments (e.g. MBAT) Services being deployed for Human Imaging Database

BIRN Data Integration Tools Three core data integration tools hardened and made available through the BIRN Portal Database Registration Integrated View Construction Query Development and Execution

Concept Based User Interface Has been developed based on feedback from community at Ontology boot-camp and test bed AHMs Provides access to BIRN ontological sources Allows for the construction of queries based on familiar concepts - architecture handles the generation of integrated vies

Evolution of the BIRN Data Integration Environment BIRN mediator has evolved significantly in response to emerging technologies and user requirements/preferences –Two development streams: mediator and source database Initially our only way of querying integrated data was based on a query form –Downside: users had to know the integrated schema –Upside: Many really complex queries can be formulated Users wanted –A simple keyword style query interface –An ontology augmented keyword style query interface Extension Developed –Created a new mechanism to accept a set of keywords –Automatically construct an integrated query –Provide users choices of the results they want back