Interactive web tools Raymond Ripp 9 mars 2010.

Slides:



Advertisements
Similar presentations
How to analyse list of genes Raymond Ripp 19 février 2013.
Advertisements

1 Galaxy Decomposition Service Yogesh Wadadekar (STScI) Milan Bogosavljević (Caltech) Ashish Mahabal (Caltech)
MAP REDUCE PROGRAMMING Dr G Sudha Sadasivam. Map - reduce sort/merge based distributed processing Best for batch- oriented processing Sort/merge is primitive.
DCC/FCUP Grid Computing 1 Resource Management Systems.
AppManager 7: Deep Technical Dive Tim Sedlack & Michi Schniebel Sr. Product Managers.
Guillaume Berthommier¹, Dominique Santiard-Baron², Olivier Poch¹ and Raymond Ripp¹ ¹ Laboratoire de BioInformatique et Génomique Intégratives IGBMC (CNRS.
L. Poidevin, W. Raffelsberger, R. Reddy, G. Berthommier, N. Gagnière, R. Ripp and O. Poch Laboratoire de BioInformatique et Génomique Intégratives IGBMC.
Cross-curricular Assignment Using your case study…
Multiple Tiers in Action
Computer Science 101 Web Access to Databases Overview of Web Access to Databases.
Maintaining a Microsoft SQL Server 2008 Database SQLServer-Training.com.
INFM 603: Information Technology and Organizational Context Jimmy Lin The iSchool University of Maryland Thursday, October 18, 2012 Session 7: PHP.
Server-side Scripting Powering the webs favourite services.
Lecture 7 Interaction. Topics Implementing data flows An internet solution Transactions in MySQL 4-tier systems – business rule/presentation separation.
GxDb a universal tool to collect, analyse, manage and visualize transcriptomic data Wolfgang Raffelsberger, Raymond Ripp and Laetitia Poidevin BingGi Days.
LOGO Scheduling system for distributed MPD data processing Gertsenberger K. V. Joint Institute for Nuclear Research, Dubna.
Bigben Pittsburgh Supercomputing Center J. Ray Scott
Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.
NMED 3850 A Advanced Online Design January 12, 2010 V. Mahadevan.
Wenjing Wu Andrej Filipčič David Cameron Eric Lancon Claire Adam Bourdarios & others.
Andrey Meeting 7 October 2003 General scheme: jobs are planned to go where data are and to less loaded clusters SUNY.
IRODS: the use of rules and micro services for automatic data conversion and signal pattern searching Martyn Fletcher, Tom Jackson, Bojian Liang, Michael.
Case Study Dynamic Website - Three Tier Architecture
LOGO Development of the distributed computing system for the MPD at the NICA collider, analytical estimations Mathematical Modeling and Computational Physics.
Stored Procedures. Definition a stored procedure is a set of Structured Query Language (SQL) statements with an assigned name that's stored in the database.
Introduction to Taverna Online and Interaction service Aleksandra Pawlik University of Manchester.
Fed : one program for many web sites and databases Raymond Ripp.
How Web Database Architectures Work CPS181s April 8, 2003.
Interactive analysis of lists …on the web Raymond Ripp 19 février 2013.
Interactive analysis of lists …on the web Raymond Ripp 19 février 2013.
PROCESSES We will learn more about: ¨ Multi-user processing and multi −tasking ¨ Multi-user processing and multi −tasking ¨ Process types ¨ Process types.
Interactive web tools Raymond Ripp 9 mars Batch Processing and Web Interaction  GxDb GxUpload GxAnalysis GxQuerying GxDisplay  ImAnno Annotation.
Tips & Tricks Tips & Tricks Christian Danuser, Nordic User Meeting 2012.
Wouter Verkerke, NIKHEF 1 Using ‘stoomboot’ for NIKHEF-ATLAS batch computing What is ‘stoomboot’ – Hardware –16 machines, each 2x quad-core Pentium = 128.
Copyright © 2010 Pearson Education, Inc. or its affiliate(s). All rights reserved.1 | Assessment & Information 1 Online Testing Administrator Training.
MESA A Simple Microarray Data Management Server. General MESA is a prototype web-based database solution for the massive amounts of initial data generated.
Grid Computing: An Overview and Tutorial Kenny Daily BIT Presentation 22/09/2016.
Start-SPPowerShell – Introduction to PowerShell for SharePoint Admins and Developers Paul BAker.
2nd year Computer Science & Engineer
3-Tier Architectures (or 3-Tier Applications)
IWS/Graph – Product Presentation
GRID COMPUTING.
Welcome to Indiana University Clusters
Welcome to Indiana University Clusters
OVirt Data Warehouse 02/11/11 Yaniv Dary BI Software Engineer, Red Hat.
Key Points Unfolding the Situations to Drill a Framework in PHP
U.S. ATLAS Grid Production Experience
Web Development Web Servers.
Introduction and Principles
Chapter 2 Client/Server Applications
Using SQL Server through Command Prompt
FIZZ Database General presentation.
TYPES OF SERVER. TYPES OF SERVER What is a server.
Monitoring Session Intro
PHP / MySQL Introduction
Bomgar Remote support software
Free Braindumps - Pass Exam - Dumps4download
Dynamic Web Pages (Flash, JavaScript)
SharePoint Saturday Omaha April 2016
Senior Design III – Spring 2011 Levi Lynch
Patrick Dreher Research Scientist & Associate Director
Exploring the Power of EPDM Tasks - Working with and Developing Tasks in EPDM By: Marc Young XLM Solutions
Module 01 ETICS Overview ETICS Online Tutorials
Exploring the Power of EPDM Tasks Working with and Developing Tasks in SolidWorks Enterprise PDM (EPDM) By: Marc Young xLM Solutions
Architecture of the web
PHP Forms and Databases.
Unit 32 Every class minute counts! 2 assignments 3 tasks/assignment
Introduction to JavaScript
Risk Map Project By Qinghua Long Research Software Engineer
Presentation transcript:

Interactive web tools Raymond Ripp 9 mars 2010

Batch Processing and Web Interaction GxDb GxUpload GxAnalysis GxQuerying GxDisplay ImAnno Annotation Analysis Querying Display R Normalisation Signal Intensity Ratio Quality control Cluspack StringInteractome Go GPS … lists of genes

GxDb

GxDb Upload procedure

Resume an existing session

GxDb ressources /GxData GxDb SQL database http://gx.igbmc.fr Languages used: PHP (HTML) - Upload - PipeWork - RadarGenerator - Fed R - Treatment and analysis protocol - RReportGenerator SQL Tcl - Gx (~ Gscope) - Probeset loading C - Cluspack /GxData GxDb SQL database alnitak http://gx.igbmc.fr Web Services Café des sciences QSub Ordonnanceur Star3 Star4 Star5 Star6 Star7 Star8 GxDb Website Upload Querying Display GxDb requires many ressources that are summarized here. Here, it’s the user who access the website GxDb First case, he queries the database. The question is sended to web server (alnitak) which interrogates the database. The answer comes back to alnitak then to the user. Second case, he upload his .cel file. The data are sended to alnitak which tranfers data to database or disk. Third case, he launch the automatic protocol, this information is always sended to alnitak and through cafe des sciences, it launch the program on a star. Qsub is a command of the Sun Grid Engine which is able indeed to identify the least charged machine and submit your job to it. The ordonnanceur is a scheduler which waits the creation of files before launch the continuation of programs Here, you have all languages used 9

Ordonnanceur 1/3 Upload … up to 30’ Normalisation … 2 hours then run Normalisation … 2 hours then load into the sql database and run the Clustering … several hours “Hello !!! All is done ! ” PHP PHP Tcl R PHP PHP Tcl Cluspack PHP PHP

Ordonnanceur 2/3 Suppose you create /genomics/link/Ordonnanceur/myscript.tcl_todo.txt Every minute, the Ordonnanceur : If there is no …_inprogess.txt Copies it into myscript.tcl_inprogess.txt Copies it into myscript.tcl Runs myscript.tcl If myscript.tcl wants to wait (1’) for something exec Ordonnanceur DeleteInProgress MySelf exec Ordonnanceur DeleteScript MySelf exit If myscript.tcl has finished its task exec Ordonnanceur DeleteAll MySelf

Ordonnanceur 3/3 To create your Todo … : All is logged Get the status Ordonnanceur CreateToDo MyScript.tcl … and you get a unique name All is logged …/Ordonnanceur/MyScript.log …/Ordonnanceur/log/Ordonnanceur.log Get the status Ordonnanceur GetToDo Ordonnanceur GetInProgess Ordonnanceur GetLog Ordonnanceur GetDone

Querying, Display, Lists of Genes GxDb managing What is available Probesets, Genes Experiments, Arraytypes Analysis software, Clustering software Samples, Organisms, Individuals, etc. RealExps Signal Intensities RadarGenerator Clustering Cluster context, Cluster composition Clusters of a gene, Groups of genes String Interactome GO, GSEA Meta-Analysis

The RadarGenerator PipeWork

Radar Generator

Radar Display

About Clustering

HtmlTable (PipeWork’s standard output)

DoOnList

DoOnList from ClusterComposition

StringInteractome output

StringInteractome WithAny.string

Cluspack Clusters of congRD1 RMA gcRMA Nb_clu Max Min Avg Km_dpc 2 20283 1081 10682 62 4949 1 390 Mm_aic 140 341 3 152 150 356 8 161 Mm_bic 33 1182 29 647 44 927 19 549 MAS5.0 dChip 21656 1321 9137 20162 1762 157 484 27 174 160 400 171 39 1337 38 702 40 1211 36 685 PLIER VSN 19151 1419 10285 5 15586 23 4007 137 327 301 143 1152 13 571 32 1205 25 626

ImAnno ISH images annotation Cst3

ImAnno ISH images annotation

ImAnno Sieves

ImAnno DoOnList

ImAnno Cluspack Display

Run StringInteractome from DoOnList

Back to existing StringInteractome

ImAnno ISH images annotation

KUROV Kolliger Utriculus Retina Olfactif Vibriss

All possible KUROV combinations

Conclusions … and To Do It works … The user can create his own lists and run several analysis tools We have to add more and more tools. Test it. Nice colors … Some technical problems (multi sessions) Perfomance Add new functionalities …