Enabling Cloud and Grid Powered Image Phenotyping Nirav Merchant iPlant Collaborative

Slides:



Advertisements
Similar presentations
Abuse Testing Laboratory Management Laboratory Management.
Advertisements

XProtect ® Express Integration made easy. With support for up to 48 cameras, XProtect Express is easy and affordable IP video surveillance software with.
Enterprise Content Management Departmental Solutions Enterprisewide Document/Content Management at half the cost of competitive systems ImageSite is:
ECM RFP 101 Presented by: Carol Mitchell C.M. Mitchell Consulting.
Objective Understand web-based digital media production methods, software, and hardware. Course Weight : 10%
Network Management Overview IACT 918 July 2004 Gene Awyzio SITACS University of Wollongong.
Manasa Guduru Sai Prasanth Sridhar Malini srinivasan Sinduja Narasimhan Reference: Aymerich, F. M., Fenu, G., & Surcis, S. (2008). An approach to a cloud.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
1 iPlant Data Store (iDS) Supporting the Lifecycle of Data Nirav Merchant 1.
Internet GIS. A vast network connecting computers throughout the world Computers on the Internet are physically connected Computers on the Internet use.
Section 13.1 Add a hit counter to a Web page Identify the limitations of hit counters Describe the information gathered by tracking systems Create a guest.
IT 210 The Internet & World Wide Web introduction.
IPlant Collaborative Powering a New Plant Biology iPlant Collaborative Powering a New Plant Biology.
Crystal Hoyer Program Manager IIS Team Preview of features that will be announced at MIX09 Please do not blog, take pictures or video of session.
Customized cloud platform for computing on your terms !
BISQUE: Enabling Cloud and Grid Powered Image Analysis Ramona Walls iPlant Collaborative
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
Data to Discovery The iPlant Collaborative Community Cyberinfrastructure for Life Science Nirav Merchant iPlant / University.
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
Publishing and Visualizing Large-Scale Semantically-enabled Earth Science Resources on the Web Benno Lee 1 Sumit Purohit 2
Computing on the Cloud Jason Detchevery March 4 th 2009.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
material assembled from the web pages at
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
Customized cloud platform for computing on your terms ! Nirav Merchant
Objective Understand concepts used to web-based digital media. Course Weight : 5%
IPlant cyberifrastructure to support ecological modeling Presented at the Species Distribution Modeling Group at the American Museum of Natural History.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
Enabling Cloud and Grid Powered Image Phenotyping Martha Narro iPlant Collaborative Adapted.
Data Management BIRN supports data intensive activities including: – Imaging, Microscopy, Genomics, Time Series, Analytics and more… BIRN utilities scale:
The Future of the iPlant Cyberinfrastructure: Coming Attractions.
IPlant Collaborative Hands-on Cyberinfrastructure Workshop – Part 2 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 29, 2015,
Web: Minimal Metadata for Data Services Through DIALOGUE Neil Chue Hong AHM2007.
Using Biological Cyberinfrastructure Scaling Science and People: Applications in Data Storage, HPC, Cloud Analysis, and Bioinformatics Training Scaling.
ITGS Databases.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
The iPlant Collaborative Using iPlant for sharing, managing, and analyzing ecological data Ramona Walls Presented at ESA 2014 – Ignite session August 12,
1 NETE4631 Working with Cloud-based Storage Lecture Notes #11.
IPlant Collaborative Hands-on Cyberinfrastructure Workshop - Part 1 R. Walls University of Arizona Biodiversity Information Standards (TDWG) Sep. 28, 2015,
Overview of Atmosphere
Enabling Cloud and Grid Powered Image Phenotyping
A Technical Overview Bill Branan DuraCloud Technical Lead.
3/12/2013Computer Engg, IIT(BHU)1 CLOUD COMPUTING-1.
Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.
Bringing your favorite analysis applications to iPlant using Docker containers Nirav Merchant
Windows Azure poDRw_Xi3Aw.
Understanding Web-Based Digital Media Production Methods, Software, and Hardware Objective
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
The Virtual Observatory and Ecological Informatics System (VOEIS): Using RESTful architecture and an extensible data model to provide a unique data management.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Overview of Atmosphere.
Transforming Science Through Data-driven Discovery Workshop Overview Ohio State University MCIC Jason Williams – Lead, CyVerse – Education, Outreach, Training.
Transforming Science Through Data-driven Discovery Using CyVerse Cyberinfrastructure to Enable Data Intensive Research, Collaboration, and Education Joslynn.
WHY VIDEO SURVELLIANCE
Integrating Scientific Tools and Web Portals
CyVerse Tools and Services
Tools and Services Workshop
Customized cloud platform for computing on your terms !
Joslynn Lee – Data Science Educator
Amazon Storage- S3 and Glacier
Joseph JaJa, Mike Smorul, and Sangchul Song
On the road: Test automation in practice for a BMW map update service
Tools and Services Workshop Overview of Atmosphere
WELCOME Mobile Applications Testing
Introduction to Cloud Computing
Cyberinfrastructure for the Life Sciences
Objective Understand web-based digital media production methods, software, and hardware. Course Weight : 10%
Lesson 9: GUI HTML Editors and Mobile Web Sites
Storing and Accessing G-OnRamp’s Assembly Hubs outside of Galaxy
WHY VIDEO SURVELLIANCE
Presentation transcript:

Enabling Cloud and Grid Powered Image Phenotyping Nirav Merchant iPlant Collaborative

Topic Coverage Motivation Key Components Overview of BISQUE Roadmap and future direction

Motivation High throughput imaging is essential for enabling genome scale phenotyping efforts Affordable automation for image acquisition (e.g. robotic high throughput systems) is creating vast amounts of imaging data (rapidly) Many laboratories have custom or commercial setup for high throughput image acquisition (but lack the comparable analysis platform) Super resolution microscopy and multi-channel images are pushing the boundaries of storage and computational capabilities

Image acquisition Robotic image acquisition of root tips (Spalding Lab.)

Image Acquisition Multiple setups recording movies for root growth (Spalding Lab.)

Motivation II New improved algorithms and analysis routines are being constantly published Applying these algorithms to existing data is challenging for biologists Sharing and collaborating with large image data sets is challenging There is no common platform to try multiple methods/algorithms on collection of images Data management is challenging for high throughput methods (metadata is key) Establishing consistent protocol for image analysis is challenging when using multiple applications/platforms ONE SIZE FITS ALL APPROACH DOES NOT WORK

Key iPlant infrastructure iPlant Data Store (iDS) Computational Grid (HPC, HTC) Atmosphere (Cloud Infrastructure)* BISQUE*

iPlant Data Store Connecting people with data and computation: Lifecycle of Data  Transfer  Storage  Analysis  Visualization  Metadata Mark-up  Search and Discover  Share/Collaborate  Publish  Transfer  Storage  Analysis  Visualization  Metadata Mark-up  Search and Discover  Share/Collaborate  Publish

Why cloud ? Standalone interactive GUI-based applications are frequently required for analysis GUI apps not easily to transform into web apps (or run on grid/command line etc.) Need to handle complex software dependencies (e.g specific version on software/library) Users needing full control of their software stack (occasional sudo/super users access) Need to share desktop/applications for collaborative analysis (remote collaborators)

So how does it work ? Configured VM (all required s/w) iPlant Data store High Bandwidth Transfer

How does it look ?

Why Bisque Allows algorithms developers to publish new analysis methods and make it completely web accessible with ease Biologists can choose from multiple analysis options for their images, overlay results to validate findings without altering original image content Produce interactive plots, visualization using built in API Share results, images, annotations with collaborators via secure link. Integrated with iPlant storage and computation infrastructure

Bisque features Rich internet application (completely web based) Draws upon features from popular large scale photo sharing sites and high resolution aerial imagery (google maps) Ability to import and export over 100+ image formats, movies Ability to import extremely large image sets using iPlant storage infrastructure Can display 20Kx20K image using standard web browser Utilizes distributed computing (connected to XSEDE) and workflow engines (Pegasus, Condor) to scale analysis

Whole seedling-size analysis High resolution flat bed scanner image of seeds Edge detection and analysis by PhytoBisque Source: Edgar Spalding

Simple Steps for Using it Concept of Mini-Apps Browse and select image (or video) Run analysis Overlay results and verify Export data

PhytoBisque interface Searching, browsing

PhytoBisque Interface Viewing large (18Kx17k pixel image) and performing analysis on selected section

Participants Bisque (Univ. of California, Santa Barbara) – B. S. Manjunath – Kris Kvelikval – Dmitry Fedorov Phytomorph (Univ. of Wisconsin, Madison) – Edgar Spalding – Nathan Miller – Logan Johnson

Users Currently we have 5+ groups actively using this infrastructure 3 Graduate course 2 Summer courses/workshops 1 Pollen Network RCN NSF ADBC Thematic Collections Network (Yale University led)

Main application: – Support: – Project Website –