CICC Project Meeting Developed two web services (VotableToTabbedFileService – convert votable to tabbed file) and (ExtractionFromSingleVotableService –

Slides:

Advertisements

Similar presentations

3/22/2006Community Grids Lab1 VOTable Services. 3/22/2006Community Grids Lab2 ServiceDescriptionInputOutput FileGenerator Service Combines clusterfile.

Advertisements

Community Grids Lab1 CICC Project Meeting VOTable Developed VotableToSpreadsheet Service which accepts VOTable file location as an input, converts to Excel.

Community Grids Lab1 CICC Project Meeting Developed two web services (VotableToTabbedFileService – convert votable to tabbed file) and (ExtractionFromSingleVotableService.

WP 1 Members of Wp1: INFN Cesnet DATAMAT PPARC. WP 1 What does WP1 do? Broker Submission mechanism JDL/JCL and other UIs Logging computational economics.

Remote Executable Remote Executable Condor Submit Ninf-C Master Program NinfCall( funcname, input_data, output_data ); Monitor Log File Execute Machine.

Evaluation of the Globus Toolkit: Status Roberto Cucchi – INFN Cnaf Antonia Ghiselli – INFN Cnaf Giuseppe Lo Biondo – INFN Milano Francesco Prelz – INFN.

Wrapping Scientific Applications as Web Services Gopi Kandaswamy (RENCI) Marlon Pierce (IU)

Chemical Informatics and Cyber- infrastructure Building Blocks Chemical Informatics Resources:  Deluge of experimental data > 100,000 compounds screened.

SEE-GRID-SCI Hands-On Session: Workload Management System (WMS) Installation and Configuration Dusan Vudragovic Institute of Physics.

GRID workload management system and CMS fall production Massimo Sgaravatto INFN Padova.

GRID Workload Management System Massimo Sgaravatto INFN Padova.

First steps implementing a High Throughput workload management system Massimo Sgaravatto INFN Padova

Alain Roy Computer Sciences Department University of Wisconsin-Madison An Introduction To Condor International.

National Alliance for Medical Image Computing Grid Computing with BatchMake Julien Jomier Kitware Inc.

Track 1: Cluster and Grid Computing NBCR Summer Institute Session 2.2: Cluster and Grid Computing: Case studies Condor introduction August 9, 2006 Nadya.

SCI-BUS is supported by the FP7 Capacities Programme under contract RI ER-FLOW is supported by the FP7 Infrastructures under contract RI

Workload Management WP Status and next steps Massimo Sgaravatto INFN Padova.

The gLite API – PART I Giuseppe LA ROCCA INFN Catania ACGRID-II School 2-14 November 2009 Kuala Lumpur - Malaysia.

E-science grid facility for Europe and Latin America OurGrid E2GRIS1 Rafael Silva Universidade Federal de Campina.

Grid Computing I CONDOR.

Compiled Matlab on Condor: a recipe 30 th October 2007 Clare Giacomantonio.

Condor Birdbath Web Service interface to Condor

DataGrid WP1 Massimo Sgaravatto INFN Padova. WP1 (Grid Workload Management) Objective of the first DataGrid workpackage is (according to the project "Technical.

Database control Introduction. The Database control is a tool that used by the database administrator to control the database. To enter to Database control.

Condor: High-throughput Computing From Clusters to Grid Computing P. Kacsuk – M. Livny MTA SYTAKI – Univ. of Wisconsin-Madison

NGS Innovation Forum, Manchester4 th November 2008 Condor and the NGS John Kewley NGS Support Centre Manager.

Bulk Model Construction and Molecular Replacement in CCP4 Automation Ronan Keegan, Norman Stein, Martyn Winn.

Using Cyberaide JavaScript to develop Ajax based Grid Apps – A Tutorial for Grid App Developers Gregor von Laszewski Fugang Wang Jun 22, 2009.

© Geodise Project, University of Southampton, Geodise Middleware & Optimisation Graeme Pound, Hakki Eres, Gang Xue & Matthew Fairman Summer 2003.

Moby Web Services Iván Párraga García MSc on Bioinformatics for Health Sciences May 2006.

Google Refine for Data Quality / Integrity. Context BioVeL Data Refinement Workflow Synonym Expansion / Occurrence Retrieval Data Selection Data Quality.

Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.

Grid, Web services and Taverna Machiel Jansen Richard Holland.

AliEn AliEn at OSC The ALICE distributed computing environment by Bjørn S. Nilsen The Ohio State University.

INFO 344 Web Tools And Development CK Wang University of Washington Spring 2014.

1 Task 4 – Advanced Topics - Introduction  Chris Woyton  Support/Training 

© Geodise Project, University of Southampton, Geodise Middleware Graeme Pound, Gang Xue & Matthew Fairman Summer 2003.

SHIWA and Coarse-grained Workflow Interoperability Gabor Terstyanszky, University of Westminster Summer School Budapest July 2012 SHIWA is supported.

© Geodise Project, University of Southampton, Geodise Compute Toolbox Functions CommandFunctionCommandFunction gd_certinfo.

Matthew Farrellee Computer Sciences Department University of Wisconsin-Madison Condor and Web Services.

Grid Workload Management (WP 1) Massimo Sgaravatto INFN Padova.

EGEE-II INFSO-RI Enabling Grids for E-sciencE Practical using WMProxy advanced job submission.

EGEE 3 rd conference - Athens – 20/04/2005 CREAM JDL vs JSDL Massimo Sgaravatto INFN - Padova.

Centre for Parallel Computing Tamas Kiss Centre for Parallel Computing A Distributed Rendering Service Tamas Kiss Centre for Parallel Computing Research.

An Introduction to Designing and Executing Workflows with Taverna Part 2 – Importing and exporting data Norman Morrison University of Manchester Credits:

FESR Trinacria Grid Virtual Laboratory Practical using WMProxy advanced job submission Emidio Giorgio INFN Catania.

Building CICC Web services

Introduction to the Application Hosting Environment

EGEE tutorial, Job Description Language - more control over your Job Assaf Gottlieb Tel-Aviv University EGEE is a project.

An Introduction to Designing and Executing Workflows with Taverna

Condor: Job Management

Some ideas for the future

Building and Testing using Condor

MIK 2.1 DBNS - introduction to WS-PGRADE, 2013

Globus Job Management. Globus Job Management Globus Job Management A: GRAM B: Globus Job Commands C: Laboratory: globusrun.

CICC Project Meeting Introduction to VOTable 1.1

Haiyan Meng and Douglas Thain

Basic Grid Projects – Condor (Part I)

Taverna Tutorial exercise 2: REST services from BioCatalogue

CICC Portal Ability to submit a BCI Job.

Wide Area Workload Management Work Package DATAGRID project

Xpath service Getting data out of XML Aleksandra Pawlik materials by Katy Wolstencroft University of Manchester 1.

GRID Workload Management System for CMS fall production

Geoprocessing Services in JavaScript

Condor-G Making Condor Grid Enabled

iSP Overview for worksheet Invoice submission users

Credential Management in HTCondor

Condor-G: An Update.

Intro to Web Services Consuming the Web.

Presentation transcript:

CICC Project Meeting Developed two web services (VotableToTabbedFileService – convert votable to tabbed file) and (ExtractionFromSingleVotableService – extract columns from votable into tabbed file) These webservices support votable communication between webservices These webservices are required to convert output from each webservice into tabbedfile and again tabbedfile into votable (by VotableConverterService) while feeding back to the webservice Community Grids Lab

VotableToTabbedFileService Input: String – Location of votable.xml file Output: String – Location of Tabbed file in form of URL Function: Parses the votable.xml file using SAVOT, retrieves column names and data, saves it into TabbedFile and returns URL of TabbedFile. URL of Service: http://gf1.ucs.indiana.edu:9080/axis/services/VotableToTabbedFileService?wsdl Community Grids Lab

Taverna WorkFlow For VotableToTabbedFileService Community Grids Lab

Input for VotableToTabbedFileService Community Grids Lab

Output URL From VotableToTabbedFileService Community Grids Lab

VotableToTabbedFile.txt Community Grids Lab

ExtractionFromSingleVotableService Input: String – Location of votable.xml file String[] – Column Names from votable.xml Output: String – Location of Tabbed file in form of URL Function: Parses the votable.xml file using SAVOT, retrieves data from votable.xml for Input ColumnNames, saves it into TabbedFile and returns URL of TabbedFile. URL of Service: http://gf1.ucs.indiana.edu:9080/axis/services/ExtractionFromSingleVotableService?wsdl Community Grids Lab

Taverna WorkFlow For ExtractionFromSingleVotableService Community Grids Lab

Input for ExtractionFromSingleVotableService Community Grids Lab

Output URL FromExtractionFromSingleVotableService Community Grids Lab

ExtractionFromVotable.txt Community Grids Lab

Condor Working on Condor (Workload Management System) to search best available machine from the pool of machines for job execution according to criteria specified in job submission file. Set up Condor(6.7.18) central manager on Linux server(156.56.104.135) and glide-in Gf1.ucs.indiana.edu(with Globus) to central manager. Able to advertise machine specific classad to central manager. Next step would be to advertise Gf1.ucs.indiana.edu machine’s classad to central manager and try to submit and execute Globus job according to specific criteria of job submission file Community Grids Lab