Tools for e-Research Mat Wyatt. 2 e-Research Sensor nets data compute… Models/ software/ workflows colleagues instruments.

Slides:



Advertisements
Similar presentations
Chapter 8: Operating Systems and Utility Programs
Advertisements

Common Instrument Middleware Architecture and Federation of Instrument Resources for X-ray Crystallography Rick McMullen Indiana University.
National Partnership for Advanced Computational Infrastructure San Diego Supercomputer Center Data Grids for Collection Federation Reagan W. Moore University.
GPE4UNICORE Grid Programming Environment for UNICORE
Data Grid: Storage Resource Broker Mike Smorul. SRB Overview Developed at San Diego Supercomputing Center. Provides the abstraction mechanisms needed.
Chapter 22: Cloud Computing and Related Security Issues Guide to Computer Network Security.
Reusable Components for Grid Computing Portals Marlon Pierce Community Grids Lab Indiana University.
Red Hat Linux Network. Red Hat Network Red Hat Network is the environment for system- level support and management of Red Hat Linux networks. Red Hat.
ARCHER Overview October e-Research Challenges Acquiring data from instruments Storing and managing large quantities of data Processing large quantities.
JAVA Technology. Java Technology Java technology is a portfolio of products that are based on the power of networks and the idea that the same software.
On Developing Data Grid Workflows using Storage Resource Broker (SRB) and Kepler Tim H. Wong - UC Davis Efrat Frank - SDSC Bertram Ludäscher - UC Davis.
Robust Tools for Archiving and Preserving Digital Data Joseph JaJa, Mike Smorul, and Mike McGann Institute for Advanced Computer Studies Department of.
Asper School of Business University of Manitoba Systems Analysis & Design Instructor: Bob Travica System architectures Updated: November 2014.
Interpret Application Specifications
On Developing Data Grid Workflows using Storage Resource Broker (SRB) and Kepler Tim H. Wong - UC Davis Efrat Frank - SDSC Dr. Bertram Ludäscher - UC Davis.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
.NET, and Service Gateways Group members: Andre Tran, Priyanka Gangishetty, Irena Mao, Wileen Chiu.
Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.
Remote Instrumentation and Sensor Networks on the Great Barrier Reef CIMA based sensor networks… Ian Atkinson
INFSO-RI Enabling Grids for E-sciencE FloodGrid application Ladislav Hluchy, Viet D. Tran Institute of Informatics, SAS Slovakia.
Grid Computing, B. Wilkinson, a.1 Grid Portals.
Introduction to the Atlas Platform Mobile & Pervasive Computing Laboratory Department of Computer and Information Sciences and Engineering University of.
PolarGrid Geoffrey Fox (PI) Indiana University Associate Dean for Graduate Studies and Research, School of Informatics and Computing, Indiana University.
ANSTO E-Science workshop Romain Quilici University of Sydney CIMA CIMA Instrument Remote Control Instrument Remote Control Integration with GridSphere.
CONFIDENTIAL 1. 2 Designing the Intelligent Energy Gateway 2009 CONFIDENTIAL.
Grids and Portals for VLAB Marlon Pierce Community Grids Lab Indiana University.
Crystal-25 April The Rising Power of the Web Browser: Douglas du Boulay, Clinton Chee, Romain Quilici, Peter Turner, Mathew Wyatt. Part of a.
ICTP, April 2007 CIMA in Australia Ian Atkinson HPRC Manager, ITR School of Maths, Physics and IT James Cook University.
Plan  Introduction  What is Cloud Computing?  Why is it called ‘’Cloud Computing’’?  Characteristics of Cloud Computing  Advantages of Cloud Computing.
Fisheries Oceanography Collaboration Software Donald Denbo NOAA/PMEL-UW/JISAO Presented by Nancy Soreide NOAA/PMEL AMS 2002/IIPS 10.3.
Crystal25 Hunter Valley, Australia, 11 April 2007 Crystal25 Hunter Valley, Australia, 11 April 2007 JAINIS (JCU and Indiana Instrument Services): A Grid.
Web Services BOF This is a proposed new working group coming out of the Grid Computing Environments Research Group, as an outgrowth of their investigations.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Hands-On Microsoft Windows Server Implementing Microsoft Internet Information Services Microsoft Internet Information Services (IIS) –Software included.
Java Portals and Portlets Submitted By: Rashi Chopra CIS 764 Fall 2007 Rashi Chopra.
Convert generic gUSE Portal into a science gateway Akos Balasko 02/07/
Grid Computing & Semantic Web. Grid Computing Proposed with the idea of electric power grid; Aims at integrating large-scale (global scale) computing.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Applications.
Jini Architecture Introduction System Overview An Example.
CASE (Computer-Aided Software Engineering) Tools Software that is used to support software process activities. Provides software process support by:- –
1 e-Science AHM st Aug – 3 rd Sept 2004 Nottingham Distributed Storage management using SRB on UK National Grid Service Manandhar A, Haines K,
E-Curator: A Web-based Curatorial Tool Ian Brown, Mona Hess Sally MacDonald, Francesca Millar Yean-Hoon Ong, Stuart Robson Graeme Were UCL Museums & Collections.
Some comments on Portals and Grid Computing Environments PTLIU Laboratory for Community Grids Geoffrey Fox, Marlon Pierce Computer Science, Informatics,
August 2003 At A Glance The IRC is a platform independent, extensible, and adaptive framework that provides robust, interactive, and distributed control.
Internet of Things. IoT Novel paradigm – Rapidly gaining ground in the wireless scenario Basic idea – Pervasive presence around us a variety of things.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Biomedical Informatics Research Network The Storage Resource Broker & Integration with NMI Middleware Arcot Rajasekar, BIRN-CC SDSC October 9th 2002 BIRN.
Portals, Services, Interfaces Marlon Pierce Indiana University March 15, 2002.
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
Shibboleth, SRB, PGL & Plone Russell Sim. MyProxy client uses portal with Web SSO protected with an SP transformation of attributes to certs by MyProxy.
Rights Management for Shared Collections Storage Resource Broker Reagan W. Moore
R e D R e S S Portals, Desktop Applications and Distributed Services for e-Research - Updated vision - Rob Crouchley and Rob Allan With thanks to Chuck.
ANSTO MMSN e-Science Workshop #2 Dec ANSTO MMSN e-Science Workshop #2 December
© Copyright IBM Corporation 2016 Diagram Template IBM Cloud Architecture Center Using the Diagram Template This template is for use in creating a visual.
5/29/2001Y. D. Wu & M. Liu1 Content Management for Digital Library May 29, 2001.
Preservation Data Services Persistent Archive Research Group Reagan W. Moore October 1, 2003.
Portals and Portlet Containers How Portals play an important role in e-Research applications. Mathew Wyatt.
ARCHER Building data and information management tools for the complete research life-cycle July 2006.
Data Grids, Digital Libraries and Persistent Archives: An Integrated Approach to Publishing, Sharing and Archiving Data. Written By: R. Moore, A. Rajasekar,
DMQ4:Instruments & Sensors for online remote access
A Study of Wireless Virtual Network Computing
GGF15 – Grids and Network Virtualization
Distributed Systems Bina Ramamurthy 11/30/2018 B.Ramamurthy.
Distributed Systems Bina Ramamurthy 12/2/2018 B.Ramamurthy.
Cloud computing mechanisms
Portals, Desktop Applications and Distributed Services for e-Research
Sensor Networks – Motes, Smart Spaces, and Beyond
Cloud Computing LegalRun Solutions Why It’s Right for You!
from the global market leader in digital signage media player
Presentation transcript:

Tools for e-Research Mat Wyatt

2 e-Research Sensor nets data compute… Models/ software/ workflows colleagues instruments

3 Storage Resource Broker (SRB) Uniform interface for connecting to heterogeneous data storage resources over a network. MCAT - value added metadata. ZONE - ’virtual’ space where entities within that space are free to interact.

4 Personal Grid Library (PGL) Implementation of a web-based digital library (JSR168 portlets) Provides an interface to templated metadata manipulation  Define appropriate metadata tags  Metadata displayed based on template SRB to manage digital objects Schema placed in library directory

5 PGL Interface

6 YourSRB Pervasive Computing Model  Field Work, edge of network activity… PGL for the desktop Cross Platform Peer-to-Peer advantageous

7 Jcu And Indiana Instrument Services (JAINIS+Usyd)

Sensor Data Flows ––Wireless data links Sensor Networks Temp, salinity, Light, turbidity, etc. Data ‘Sinks’ Internet Microwave links - via humidity ducting SRB MCAT Data Repository Disk/Tape Storage (multiple locations) Data Sinks enable Simple sensor configuration Interface Scalability / ease of maintenance Model for ‘plug and play’ sensor configuration Security Automatically update backend data structures Developed by DART for Davies Reef SN Platform Network & sensor monitoring AODC-JF & other portals Data Manager CIMA SOAP Interface Kepler mediated Experimental logic Workflow & computational pipelines, Automatic metatdata generation Local and remote Grid computing Compute resources Custom portals / Research codes Sensor Devices Inexpensive, commodity inspired Ad hoc network Above and below water wireless network & wired Many partners involved Great Barrier Reef Ocean Observing System

9 ReefGrid (Davies Reef) CIMA Instrument Representative Data Manager CIMA SOAP Interface GridSphere Portal SRB Data Repository (data and metadata) Kepler mediated Experimental logic SRB MCAT PGL Applications/ Processing Data Sinks/ Sensors CIMA core code from IU JCU/DART reengineered CIMA code SDSC Components Workflow & computational Pipelines, Automatic metatdata generation Live Data Feeds, Instrument Control

10 Web Services for Remote Portlets (WSRP) Producer/Consumer model Producers can be closer to the model Use a proxy portlet at the client  Non Java specific (JSR168, Swing, Plone) Useful for CIMA? Possibly To be aligned in JSR286