The use of the SCMS-EMI as scientific gateway in BCC of NGI_UA Authors: Andrii Golovynskyi, Andrii Malenko, Valentyna Cherepynets V. Glushkov Institute.

Slides:



Advertisements
Similar presentations
PRAGMA BioSciences Portal Raj Chhabra Susumu Date Junya Seo Yohei Sawai.
Advertisements

Building Portals to access Grid Middleware National Technical University of Athens Konstantinos Dolkas, On behalf of Andreas Menychtas.
Welcome to eDMR This PowerPoint presentation is designed to show eDMR users how to login and begin using the eDMR system.
GXP in nutshell You can send jobs (Unix shell command line) to many machines, very fast Very small prerequisites –Each node has python (ver or later)
DIGIDOC A web based tool to Manage Documents. System Overview DigiDoc is a web-based customizable, integrated solution for Business Process Management.
XSEDE 13 July 24, Galaxy Team: PSC Team:
XP Information Technology Center - KFUPM1 Microsoft Office FrontPage 2003 Creating a Web Site.
Hands-On Microsoft Windows Server 2003 Administration Chapter 10 Monitoring and Troubleshooting Windows Server 2003.
Office of Science U.S. Department of Energy Grids and Portals at NERSC Presented by Steve Chan.
Nu Project Management Office A web based tool to Manage Projects.
Module 6 Windows 2000 Professional 6.1 Installation 6.2 Administration/User Interface 6.3 User Accounts 6.4 Managing the File System 6.5 Services.
High Performance Computing (HPC) at Center for Information Communication and Technology in UTM.
Sergey Belov, Tatiana Goloskokova, Vladimir Korenkov, Nikolay Kutovskiy, Danila Oleynik, Artem Petrosyan, Roman Semenov, Alexander Uzhinskiy LIT JINR The.
1 Introduction to Web Development. Web Basics The Web consists of computers on the Internet connected to each other in a specific way Used in all levels.
Hands-On Microsoft Windows Server 2008 Chapter 1 Introduction to Windows Server 2008.
EUROPEAN UNION Polish Infrastructure for Supporting Computational Science in the European Research Space Cracow Grid Workshop’10 Kraków, October 11-13,
Linux+ Guide to Linux Certification Chapter Three Linux Installation and Usage.
Riccardo Bruno INFN.CT Sevilla, Sep 2007 The GENIUS Grid portal.
DIRAC Web User Interface A.Casajus (Universitat de Barcelona) M.Sapunov (CPPM Marseille) On behalf of the LHCb DIRAC Team.
GRACE Project IST EGAAP meeting – Den Haag, 25/11/2004 Giuseppe Sisto – Telecom Italia Lab.
Guide to Linux Installation and Administration, 2e1 Chapter 8 Basic Administration Tasks.
Cloud Usage Overview The IBM SmartCloud Enterprise infrastructure provides an API and a GUI to the users. This is being used by the CloudBroker Platform.
1. Introduction  The JavaScript Grid Portal is trying to find a way to access Grid through Web browser, while using Web 2.0 technologies  The portal.
Grid Computing - AAU 14/ Grid Computing Josva Kleist Danish Center for Grid Computing
CHAPTER FOUR COMPUTER SOFTWARE.
Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski
Module 7: Fundamentals of Administering Windows Server 2008.
Nicholas LoulloudesMarch 3 rd, 2009 g-Eclipse Testing and Benchmarking Grid Infrastructures using the g-Eclipse Framework Nicholas Loulloudes On behalf.
Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.
07/06/11 New Features of WS-PGRADE (and gUSE) 2010 Q Q2 Miklós Kozlovszky MTA SZTAKI LPDS.
GridFE: Web-accessible Grid System Front End Jared Yanovich, PSC Robert Budden, PSC.
Opton 4 short presentation1 Opton 4 User friendly operating software for Symmetron’s Stylitis data loggers.
CERN IT Department CH-1211 Genève 23 Switzerland t Internet Services Job Monitoring for the LHC experiments Irina Sidorova (CERN, JINR) on.
Grid Technologies  Slide text. What is Grid?  The World Wide Web provides seamless access to information that is stored in many millions of different.
Javascript Cog Kit By Zhenhua Guo. Grid Applications Currently, most grid related applications are written as separate software. –server side: Globus,
The PROGRESS Grid Service Provider Maciej Bogdański Portals & Portlets 2003 Edinburgh, July 14th-17th.
Resource Brokering in the PROGRESS Project Juliusz Pukacki Grid Resource Management Workshop, October 2003.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
The iPlant Collaborative Community Cyberinfrastructure for Life Science Tools and Services Workshop Discovery Environment Overview.
EGEE-II INFSO-RI Enabling Grids for E-sciencE The GILDA training infrastructure.
6/1/2001 Supplementing Aleph Reports Using The Crystal Reports Web Component Server Presented by Bob Gerrity Head.
NEES Cyberinfrastructure Center at the San Diego Supercomputer Center, UCSD George E. Brown, Jr. Network for Earthquake Engineering Simulation NEES TeraGrid.
How to Read gUSE Documents Orange Docs Series for General Pruposes RELEASE ISSUE POLICY LICENSE HOW TO READ GUSE DOCUMENTS GUSE IN A NUTSHELL by Tibor.
FRANEC and BaSTI grid integration Massimo Sponza INAF - Osservatorio Astronomico di Trieste.
Tbox is a monitoring solution for all your computer systems Unifies and simplifies management of system surveillance Notifies you in the event of.
Architecture View Models A model is a complete, simplified description of a system from a particular perspective or viewpoint. There is no single view.
VIGNAN'S NIRULA INSTITUTE OF TECHNOLOGY & SCIENCE FOR WOMEN TOOLS LINKS PRESENTED BY 1.P.NAVEENA09NN1A A.SOUJANYA09NN1A R.PRASANNA09NN1A1251.
International Symposium on Grid Computing (ISGC-07), Taipei - March 26-29, 2007 Of 16 1 A Novel Grid Resource Broker Cum Meta Scheduler - Asvija B System.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
Using the ARCS Grid and Compute Cloud Jim McGovern.
ISG We build general capability Introduction to Olympus Shawn T. Brown, PhD ISG MISSION 2.0 Lead Director of Public Health Applications Pittsburgh Supercomputing.
EGI-InSPIRE RI EGI-InSPIRE EGI-InSPIRE RI How to integrate portals with the EGI monitoring system Dusan Vudragovic.
INFSO-RI SA2 ETICS2 first Review Valerio Venturi INFN Bruxelles, 3 April 2009 Infrastructure Support.
Top-performing urban school district in Florida Introduction to TIDE 1.
As a distinctive management software product, DN4 platform can provide useful and convenient remote management and inquiry services. Through DN4, users.
Tutorial on Science Gateways, Roma, Catania Science Gateway Framework Motivations, architecture, features Riccardo Rotondo.
SHIWA Simulation Platform (SSP) Gabor Terstyanszky, University of Westminster EGI Community Forum Munnich March 2012 SHIWA is supported by the FP7.
Gang Chen, Institute of High Energy Physics Feb. 27, 2012, CHAIN workshop,Taipei Co-ordination & Harmonisation of Advanced e-Infrastructures Research Infrastructures.
G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.
InSilicoLab – Grid Environment for Supporting Numerical Experiments in Chemistry Joanna Kocot, Daniel Harężlak, Klemens Noga, Mariusz Sterzel, Tomasz Szepieniec.
Antonio Fuentes RedIRIS Barcelona, 15 Abril 2008 The GENIUS Grid portal.
The EPIKH Project (Exchange Programme to advance e-Infrastructure Know-How) gLite Grid Introduction Salma Saber Electronic.
RBS Remote Business Support System
Printer Admin Print Job Manager
Patrick Dreher Research Scientist & Associate Director
HC Hyper-V Module GUI Portal VPS Templates Web Console
Final Review 27th March Final Review 27th March 2019.
Presentation transcript:

The use of the SCMS-EMI as scientific gateway in BCC of NGI_UA Authors: Andrii Golovynskyi, Andrii Malenko, Valentyna Cherepynets V. Glushkov Institute of Cybernetics NAS of Ukraine, Kiev Leonid Belous B. Verkin Institute for Low Temperature Physics and Engineering NAS of Ukraine, Kharkov Present: Sergiy Svistunov Bogolyubov Institute for Theoretical Physics NAS of Ukraine, Kiev

U KRAINIAN N ATIONAL G RID Currently Grid infrastructure represented by resources of more than 30 institutes and universities (more than 2900 CPU and 250 TB of disk memory) which are operating under the ARC middleware. In average site has only CPU cores!! Grid infrastructure in Ukraine has been built by applying two programs: "Implementation of grid technologies and creation of clusters in the National Academy of Sciences of Ukraine" and "Information and Communication Technologies in Education and Science “.

B ASIC C OORDINATION C ENTER In order to ensure the integration of Grid infrastructure of Ukraine and EGI.eu infrastructure, it was established Basic Coordination Center (BCC) which performs functions of Resource Infrastructure Provider at technical and operational level. BCC is a nonstructural subdivision of the Bogolyubov Institute for Theoretical Physics, located in Kiev, Ukraine, which represent itself as main organization for management of Ukrainian National Grid Project. Currently in NGI_UA includes 12 grid sites from UNG BCC provides management and coordination of projects based on supporting of operational structure of NGI_UA (resource centers and core services of NGI_UA).

SCIENCE GATEWAY ( PROBLEMS AND POSSIBLE SOLUTION ) The problem of understandable and accessible user interface is relevant and important for all types of software. This is especially significant for high-performance computing, where traditional interfaces for user access are very specific and require additional technical knowledge. Current development of grid and cloud computing doesn`t reduce the problem of creating a user-friendly interface. Possible solution of this problem is development of web-based science gateway. It is solution that integrates scientific applications and data collections into a web portal so scientists can easily access the resources of grid-infrastructure to submit their tasks and manage their data.

K EY FEATURES OF THE SCMS-EMI Super Computer Management System (SCMS-EMI) provides access to high performance computing resources via the web interface. Platform independent interface (Windows/Unix/Mac) working in all major browsers: IE, Firefox, Opera, Chrome, and Safari. Extensive use of Web 2.0 and Ajax technologies.. Transparent operations in grid, similar to operations on a local cluster, that allows user quickly move from cluster to grid with unified UI. Intuitive multilingual graphical user interface designed for both beginners and advanced users. Support is provided not only for Ukrainian, Russian, English languages, but for other as well. SCMS-EMI requires studying minimum of documentation.

K EY FEATURES OF THE SCMS-EMI Provided support ARC, gLite and UNICORE middleware. for basic usage, there is no difference between work on local cluster and in grid; advanced users can to work in command-line interface. Main features of SCMS-EMI for user: choice of available resources (defined by membership in virtual organizations or available clusters, where user is authenticated), task submission, tracking task execution process and viewing task results; help to organize and simplify workflow for scientific and applied parallel software packages such as Abinit, Amber, Gamess, Gaussian, Gromacs, Namd, NWChem, etc).

SCMS-EMI: S TRUCTURE

SCMS-EMI: Authorization 1 Stage -> user is able to connect to SCMS-EMI system just using pair of login/password 2 Stage -> for using grid possibilities, user should enter password of X.509 certificate, stored ~/.globus (user’s home directory)

SCMS-EMI: Authorization

SCMS-EMI: Interface – Main window The interface was designed to perform typical user operations: - operations with files; - task submission; - tracking the job; - preview results of submitted task; - communication between users and support team; - ability to use grid opportunities and typical operations there.

File Management tool provides typical file operations: creation of files and folders; cut/copy/paste; uploading files from local computer to user folder on cluster; downloading files from cluster and grid; inline file preview and editing with syntax highlighting for popular programming languages; file tracking, changing attributes and etc. SCMS-EMI: Interface – Part 1 - File Manager

SCMS-EMI: Interface - Part 2 Task Launch Form Task submission to resource manager queues is performed in Launch Form. It allows user to set all necessary parameters of task. Task submission parameters can be saved to user profiles for further use, that could simplify user operations for launching similar tasks.

SCMS-EMI: Interface - Task Launch Form Grid task submission procedure is similar to job submission on a local cluster. User should fill the Launch Form or provide a valid task description file. Result of the task submition will be displayed in «Submission Log» window.

SCMS-EMI: Interface - Preview of task`s files After successful launch of grid task the corresponding remote folder will be displayed in File Manager. Such folders are indicated with chain icon. SCMS-EMI constantly monitors statuses of grid tasks and automatically copies completed results to corresponding folder on a local cluster. Task runtime files can be previewed during task execution and copied to local cluster for further use.

SCMS-EMI: Interface - Tasks List Menu «Tasks» -> «Launch history». User can preview list of all tasks on local cluster and own grid tasks. In any case user has possibility to cancel task.

SCMS-EMI: Interface - Tasks List After successfully finishing of task, data from the temporary working directory is moved to a permanent folder and after this temporary directory is deleted.

SCMS-EMI: Interface - Tracking Task Results User can preview obtained results.

SCMS-EMI: Interface - Resources User can preview list of queues on local cluster with their time limits and number of available cores. Grid resources are grouped by cluster hostname. Additional information about selected partition or queue is available in the panel «Details».

SCMS-EMI: Interface - Statistics SCMS collects information about completed tasks. Resource usage statistics can be grouped by users, organizations, VO and etc.. Statistics can be exported to CSV or Excel format.

SCMS-EMI: Interface - Monitoring The monitoring subsystem has modules for checking hardware status and software components of cluster: - resource manager (SLURM, Torque, etc.); - error counters of Ethernet and Infiniband switches; -hard disks and RAIDs of servers; -nodes status and temperature; - monitoring of GPU units (temperature, fan speeds, etc.); -health status of UPS batteries; -system log; -GSM/CDMA modem status; -grid middleware operability.

Project web site - Demo account: login: demo password: cluster

Thank You for Attention!