GridChem Developers Conference Focus For Final Year Sudhakar Pamidighantam NCSA 25 August 2006

How to make Impact Improve Pre Processing Tools Improve Processing Experience Improve Post Processing Tools Each one is a challenge Prioritize Deploy Robust Systems Engage Community

How to Make an Impact Pre Processing Current Frustrations for users Discovering Resources Specifying Requirements Estimating Time/memory/disk for the run Reliably Completing the Jobs Starting and Restarting Reliably Moving Between Applications Note: Not a whole lot questions for input generation yet.

Resource capabilities are unclear from Submit Job window Application Quick Description Long Description HPC System System Info (Capability Capacity, Queue wait time) Job Specific Information ( Method Scaling, Sweet spot # of Processors, Memory and Disk Requirements) Discovering Resources

Specifying Requirements Application Specific Guide for requirement specification (Direct and InCore and Semi-Direct methods Choices) Exploiting Memory of the system Exploiting Fast IO Devices Exploiting other System Infrastructure ( Fast Network, Cache etc….)

Estimating Resources for the run Time Depends on size of the system Methods used Benchmark Information ( Intelligent Discovery based on size, methods, systems and processor count) For optimizations, depends on initial guess Memory Use maximum available ( always the best) Vs Minimum Required. For SMPs the latter may be important. Disk ( use whatever is needed with no restrictions )

Reliably Completing the Jobs Once the job is submitted the job should not die abruptly Causes: Improper requirement specifications ( user errors), Lack of proper restart data for continuation runs System Crash/Hang, Application immaturity, Scheduling conflicts If System is down/unreachable Can we suggest alternative resources during job submission? Can we auto restart incomplete jobs?!

Starting and Restarting Reliably Consistency Checks for Inputs Just before submitting/starting for any application Estimating Start times and wait times accurately for multiple systems Grid/MetaScheduling of Multiple GridChem jobs For restarting jobs check the restart information before job is submitted and ensure it will work ( This information is sometimes on MSS)

Input Generation Who Needs GUI? Students/NonTraditional Users, Experts Other GUIs Molecular Editors How to deploy and make GUI’s accessible ( not bury them deep in the client) Improved Enrty Page that shows capabilities and is inviting to generate inputs and launch jobs

GUIs GaussView (Commercial, several others….) JME WebMO Editor JME-CML JChemPaint CSEOnline Crystal Editor Ghemical Gemstone

Post Processing Requirements Common Post Processing Modules NBO Analysis (Unintegrated) Molden Invoke Molden Directly Preprocess data and invoke Molden Other ThirdParty Analysis tools MOPro nancy.fr/english/index_eng.htmlhttp:// nancy.fr/english/index_eng.html NCSAChem(Sellers), PSI(Jorgensen) and Gamess Viewers

Moving Between Applications Ease of moving from one application to another Use one for some methods and others for different ones or property calculations Use results of one run in another application Create a workflow capability to define such transitions Caveats: Some application performance can not be compared with another.

Reducing the Barrier for Computation Reserving Resources Automating Resource Selection with matching job requirements

Future GridChem/CCG Extension Apply for an extension to OCI Seek Input from Program Officer (Miriam Heller) Collaborate with right minded partners (CSEO/GEMSTONE and other Scince Gateways) Show tools can be integrated between existing infrastructure to further specific science projects Visit NSF with good porposals Communicate Leverages across NSF divisions (Chemistry/OCI) to fund extension in scope for Resources in CCG and Applications and Integration in software development Obtain Science Funding Separately