Outline  BatchMake Overview  BatchMake and XNAT Integration  XNAT Overview  GridWizard.

Slides:



Advertisements
Similar presentations
LEAD Portal: a TeraGrid Gateway and Application Service Architecture Marcus Christie and Suresh Marru Indiana University LEAD Project (
Advertisements

National Alliance for Medical Image Computing Slicer3 plugins Common architecture for interactive and batch processing.
Grid Wizard Enterprise Basic Tutorial Using Web Control Panel.
NGS computation services: API's,
National Alliance for Medical Image Computing Slicer3 plugins Common architecture for interactive and batch processing.
Java Script Session1 INTRODUCTION.
National Alliance for Medical Image Computing Anatomy of a plugin Common architecture for interactive and batch processing.
Why python? Automate processes Batch programming Faster Open source Easy recognition of errors Good for data management What is python? Scripting programming.
Understanding Analysis Reports In HP LoadRunner
PHP on Windows Improvements in PHP-Microsoft Interoperability PHP World Kongress Munich, Germany November 9, 2010.
A Guide to Oracle9i1 Creating an Integrated Database Application Chapter 8.
Workload Management Massimo Sgaravatto INFN Padova.
Web-Enabling the Warehouse Chapter 16. Benefits of Web-Enabling a Data Warehouse Better-informed decision making Lower costs of deployment and management.
1 CS428 Web Engineering Lecture 18 Introduction (PHP - I)
Slide 1 of 9 Presenting 24x7 Scheduler The art of computer automation Press PageDown key or click to advance.
Web Programming Language Dr. Ken Cosh Week 1 (Introduction)
NA-MIC National Alliance for Medical Image Computing Informatics tools & services for NA-MIC Dan Marcus Neuroinformatics Research Group.
Eclipse is an open source IDE (Integrated Development Environment) for developing applications in Java, C/C++, HTML, Cobol, Perl, etc. The official Eclipse.
An Introduction to ASP.NET Web Pages 2 Module 1: Webmatrix Installation and Your First Web Site Tom Perkins.
WHAT IS PHP PHP is an HTML-embedded scripting language primarily used for dynamic Web applications.
Group 4: Web based applications/ crowdsourcing Marcel Prastawa Ziv Yaniv Patrick Reynolds Stephen Aylward Sean Megason.
Module 2: Using Transact-SQL Querying Tools. Overview SQL Query Analyzer Using the Object Browser Tool in SQL Query Analyzer Using Templates in SQL Query.
Remote Visualization of Large Datasets with MIDAS & ParaViewWeb Web3D – Paris 2011 Julien Jomier, Kitware
Module 1: Installing Windows XP Professional. Overview Manually Installing Windows XP Professional Automating a Windows XP Professional Installation Using.
- 1 - Grid Programming Environment (GPE) Ralf Ratering Intel Parallel and Distributed Solutions Division (PDSD)
NA-MIC National Alliance for Medical Image Computing NAMIC-Kit Update Will Schroeder Jim Miller Bill Lorensen.
National Alliance for Medical Image Computing Grid Computing with BatchMake Julien Jomier Kitware Inc.
Analysis of SQL injection prevention using a proxy server By: David Rowe Supervisor: Barry Irwin.
Neuroimage Analysis Center An NCRR National Resource Center Slicer Workflow Engine: Aim Supplement 3D Slicer with Workflow Management.
EXtensible Neuroimaging Archive Toolkit (XNAT) Washington University Neuroinformatics Group.
NA-MIC National Alliance for Medical Image Computing shapeAnalysisMANCOVA_Wizar d Lucile Bompard, Clement Vacher, Beatriz Paniagua, Martin.
Introducing Reporting Services for SQL Server 2005.
NA-MIC National Alliance for Medical Image Computing Core 1b – Engineering Highlights, Aims and Architecture Will Schroeder Kitware.
INFSO-RI Module 01 ETICS Overview Alberto Di Meglio.
Contents 1.Introduction, architecture 2.Live demonstration 3.Extensibility.
INFSO-RI Module 01 ETICS Overview Etics Online Tutorial Marian ŻUREK Baltic Grid II Summer School Vilnius, 2-3 July 2009.
BIRT Deployment Plan BIRT Reporting Server Server to Server Integration Integration with Client Side Scripting.
CERN - IT Department CH-1211 Genève 23 Switzerland t DB Development Tools Benthic SQL Developer Application Express WLCG Service Reliability.
Stuart Wakefield Imperial College London Evolution of BOSS, a tool for job submission and tracking W. Bacchi, G. Codispoti, C. Grandi, INFN Bologna D.
Intro to PHP Carl-Erik Svensson. What is PHP? PHP is a widely-used general-purpose scripting language that is especially suited for Web development and.
JavaScript Syntax, how to use it in a HTML document
NA-MIC National Alliance for Medical Image Computing Process-, Work-Flow in Medical Image Processing Guido Gerig
NOVA A Networked Object-Based EnVironment for Analysis “Framework Components for Distributed Computing” Pavel Nevski, Sasha Vanyashin, Torre Wenaus US.
MySQL and GRID status Gabriele Carcassi 9 September 2002.
1 The EDIT System, Overview European Commission – Eurostat.
Neuroimage Analysis Center An NCRR National Resource Center NAC Engineering Core Steve Pieper, Core PI SPL; Isomics, Inc.
IPlant Discovery Environment An Overview. What is it? The Discovery Environment has been described in many ways… “It’s a virtual workbench…” “It’s where.
Learningcomputer.com SQL Server 2008 – Management Studio.
LONI Pipeline Jagadeeswaran LONI,UCLA. Site PI: Arthur W Toga Director, Laboratory of Neuro Imaging Co-Director, Brain Mapping Center Director, Training.
Status Report on the Validation Framework S. Banerjee, D. Elvira, H. Wenzel, J. Yarba Fermilab 15th Geant4 Collaboration Workshop 10/06/
GridChem Architecture Overview Rion Dooley. Presentation Outline Computational Chemistry Grid (CCG) Current Architectural Overview CCG Future Architectural.
REPORTING SOFTWARE for BUILDING & INDUSTRIAL AUTOMATION.
NA-MIC National Alliance for Medical Image Computing Non-Interactive Tools Stephen Aylward, Kitware
 To start using PHP, you can:  Find a web host with PHP and MySQL support  Install a web server on your own PC, and then install PHP and MySQL.
NA-MIC National Alliance for Medical Image Computing Slicer3 Update
Selenium server By, Kartikeya Rastogi Mayur Sapre Mosheca. R
BalticGrid-II Project EGEE UF’09 Conference, , Catania Partner’s logo Framework for Grid Applications Migrating Desktop Framework for Grid.
NA-MIC National Alliance for Medical Image Computing Core 1b – Engineering Data Management Daniel Marcus Washington University.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Oracle HFM Implementation Boot Camp Presented by Saravanan Singaravadivelan Developed by Saravanan Singaravadivelan Senior Consultant Qubix International.
J-guar Customization Tool Devanshu Bawa Customization Specialist SOLUTION PARTNERS TRAINING 2016.
Overview on the work performed during EPIKH Training Faiza MEDJEK /INFN, CATANIA 1.
Web Programming Language
Deployment of Flows Loretta Auvil
Introduction to Dynamic Web Programming
ITCS-3190.
UCSD / BIRN Coordinating Center NAMIC Group
Tutorial 6 PHP & MySQL Li Xu
NAC: Optimized registration in Slicer
Presentation transcript:

Outline  BatchMake Overview  BatchMake and XNAT Integration  XNAT Overview  GridWizard

BatchMake Overview  Goals  BatchMake  Slicer BatchMake Modules  Use-case High-throughput mouse brain morphology  Funding NIH/NLM A2D2 Award, NAMIC, NIH/NIMH STTR Phase I, High Throughput Web- Based Image Analysis of Mouse Brain MR Imaging Studies, UNC, PI: M. Styner,

Goals  Facilitate the development and deployment of scripts for high-throughput image processing  Simplify the specification and reporting of statistical experiments  Use cases Develop the script using 10 images on a local PC, and deploy using 1,000s of images on a Grid Conduct and report a Taguchi experiment to determine the significant parameters of a method Conduct leave-on-out analyses to compare two different methods

BatchMake  Scripting language  Editor  Processing engines  Report Server

Scripting Language  Modeled after CMake Set( VAR value ) ListFilesInDir( VAR dir ) ForEach( VAR list ) ForNFold( ITERATION TRAININGSET i TESTINGSET i fullSet numberOfFolds )  Extensible

Scripting Language  Applications that use Slicer execution model are available as commands # Find RegisterImages and determine # its command-line parameters RegisterImage ) Set( RI.FixedImage filename) Set( RI.MovingImage filename) Set( RI.Registration “Bspline”) Run( RI )

Editor  Syntax highlighting  Define non-Slicer apps as commands  Launch a processing engine  Monitor results Loops are unrolled ○ Jobs ○ Data ○ Steps

Processing Engines  Launched from Editor  Launched from command-line  Local processing (bash / bat)  Condor Grid  Sun Grid  KWGrid  Globus (limited support)

Report Server: BatchBoards  Script declares an experiment design, independent vars, dependent vars, thumbnails, and a BatchBoard server  BatchBoard server (website and mysql database) receives data from scripts, provides a database browser, provides experiment reports.

BatchBoard Reports  Taguchi table webpage  Graphs of independent vs. dependent vars.  Color highlighting when dependent vars passes a threshold

Slicer Modules (approx.)  Enable BatchMake (automatic with GetBuildTest2)  “Batch Processing” filter group Applications/CLI/BatchMake  EMSegmenter  GaussianBlur (“hello world”)

High-throughput mouse brain morphology (Phase II)  The proposed web-based system with the server side modules will be evaluated directly by end-users in the following studies: Fragile X mouse behavioral phenotype from Phase 1, Neuregulin modulated schizophrenia mouse phenotype, Postnatal alcohol exposure in adolescent mice, Intra-uterine cocaine exposure in rats.

BatchMake and XNAT  Explore data via XNAT  Export pointers to interesting data as an XNAT Catalog  BatchMake commands exist for creating lists from XNAT Catalogs  BatchMake commands exist for downloading data from XNAT (status?)

XNAT  Server  Desktop  File format for meta-data and data collections

Grid Wizard  Command-line tool for distributing a program to a variety of compute services