Florida High Performance Computing Summit March 21-22, 2001 Gainesville, Florida

Sunshine Grid: Motivation “The foundation we’re laying today, like the physical infrastructure of a building or city, is the supporting framework necessary for the scientific discoveries of the future.” Arden L. Bement, Director National Science Foundation,

Sunshine Grid: Florida’s Research and Education Cyberinfrastructure Describe the New Florida Initiative Motivation for the Sunshine Grid proposal What is the Sunshine Grid Deliverables o Sunshine Grid Web and DB (Dan Majchrzak) o Support for three science areas (Paul Avery) Time for your thoughts and insights

New Florida Initiative The 2010 Florida Legislature invested a total of $12 million in New Florida Initiative Designed to: o Demonstrate the power of the SUS when it collaborates in areas critical to Floridians. o Produce meaningful outcomes in a short timeframe

Should serve as a change agent for FL Transform FL’s economy beyond tourism, agriculture, and housing Should promote the creation of high- skill, high-wage, knowledge-based employment Results should foster economic recovery, growth, and future prosperity New Florida Initiative

Commercialization Assistance Grants Program o link research activities at Univ. with commercial products o $2 million of the $12 million o State University Research Commercialization Assistance Grants (SURCAG) Program New Florida Scholars Boost Grants Program o Assist in hiring, retaining, and equipping the best faculty candidates and existing faculty o Similar to the former “21st Century World-class Scholars Program,” but with less funding New Florida Clustering Grants Program o Focus a collaboration between or among universities o Fast time-to- delivery o Associated with health, engineering, and/or science New Florida Initiative

Announced in late-summer 2010 Proposals were due mid-Sept. Each University independently selected and ranked proposals Ranked lists were submitted to BOG for final review New Florida Initiative

Sunshine Grid Announcement was made We hit the Ground Running

Sunshine Grid: Motivation Other Efforts Florida Center for Computational Biology (FCCB) o Lead by UFL, in collaboration with FSU, UCF, FIU, and USF o Board of Governors Centers of Excellence Competition, 2007 Collaborative Acquisition of High-performance Storage and Visualization Infrastructure o UF and FSU collaboration o Major Research and Instrumentation – Recovery and Reinvestment Act, NSF, 2009

Sunshine Grid: Motivation Science Paradigms (a la Jim Gray) Experiments o Describing natural phenomena Theory o models for generalizations Computations o Simulate complex phenomena Large-scale Data Exploration o unify experimentation, theory, and simulation

Sunshine Grid: Motivation “Shared NIT infrastructure – be it computational resources, communication networks, community databases, or collaboration tools – has become essential to research in virtually all fields.” o President’s Council on Science and Technology (PCAST), 2010 “By working together, the HPC and CI communities best serve the mutually reinforcing goals of (1) sustaining the entire computational pyramid while (2) generating economic growth via breakthroughs in science and engineering.” o NSF sponsored workshop on Sustainable Funding and Business Models for Academic Cyberinfrastructure Facilities, 2010 “Institutions of higher education should lead efforts to fund and invest in university-specific, state-centric, and regional cyberinfrastructure to create local benefits (in research accomplishment and local economic development) and to aid the global competitiveness of the US and thus the long-term welfare of US citizens.” o NSF Advisory Committee for Cyberinfrastructure Task Force on Campus Bridging, 2011 “Development and acquisition of research instrumentation for shared inter- and/or intra-organizational use are encouraged, as are development efforts that leverage the strengths of private sector partners to build instrument development capacity at academic institutions.” o NFS Major Research Instrumentation Solicitation, 2011

Sunshine Grid: Motivation Florida’s Universities are home to a wealth of world- class resources o Talented scientists o High-end computing facilities o Massive data storage systems o Specialized research instruments o High-speed state-wide network (FLR)

Sunshine Grid: Motivation Organize assets in such a way as their collective impact is greater than the sum of their individual parts.

Sunshine Grid: Motivation Workforce Florida and Enterprise Florida o Strategic Plan for Workforce Development strongly endorses STEM development at FL Univ. Florida STEM Council o Promote ties between industry and academia o “Florida will be a national leader in market relevant STEM talent development and retention”

Sunshine Grid: Proposal Build a coherent cyber-infrastructure across three state universities: o University of Florida o University of South Florida o Florida State University Use this as a base for future development to include ALL of Florida’s public and private Universities.

Cyberinfrastructure Campus Cyberinfrastructure Working Group (EDUCAUSE) & Coalition for Academic Scientific Computation (CASC) Consists of computational systems, data and information management, advanced instruments, visualization environments, and people, all linked together by software and advanced networks to improve scholarly productivity and enable knowledge breakthroughs and discoveries not otherwise possible.

Sunshine Grid: Proposal Goals of proposal closely aligned with New Florida Initiative o Increase research funding o Enable leading-edge research o Provide educational opportunities o Promote healthy economic development

Sunshine Grid: Deliverables Two-pronged approach o Catalog High-end Resources  Internal use: track assets and progress related to linking assets  Showcase STEM resources; attract positive attention to Florida o Support three well defined research projects  well defined goals  need for data storage and compute cycles What we asked from New Florida o 400K per University  $280K in salaries  $120K in capital

New Florida: Cluster Awards 93 proposals submitted to the BOG o Cumulatively worth $32.4 million 31 projects were funded Successful Cluster Awards: o Aerospace, Aging Issues in North Florida, Biomedical Engineering, Climate Change, Coastal Watersheds, Community Health, Cyber-infrastructure, Family Medicine, Geophysical Threats, Medical Prostheses, Neuroscience, Professional Science Master’s Degree, Smart Sensors, and Vector Borne Diseases. Sunshine grid was funded because close alignment with New Florida’s Goals and quick turn around

Sunshine Grid: Award

What we got from New Florida o UF: $200K o FSU: $150K o USF: $100K Internal matching was honored o UF: $200K o FSU: $150K o USF: $140K

Sunshine Grid: Day-to-Day Leadership HPC Directors at UF, FSU, USF - Erik Deumens (UF) - Daniel Majchrzak (USF) - Jim Wilgenbusch (FSU)

Sunshine Grid: Advisory Panel Members Paul Avery (High Energy Physics) (UF) Scott Stagg (Bio Imaging) (FSU) Qingnong Xiao (Climate Modeling) (USF) Joel Hartman (Florida Lamda Rail/SUS CIO) (UCF) Nick Tsinoremas (Private Florida Univ.) (UM) Sunshine Grid PIs (ex officio)

Sunshine Grid: Key Milestones Jan/Feb – Advertise new positions Feb – Invite Sunshine Grid advisory panel members Feb/May – Hire staff at each University April/May – Release version of Sunshine Grid DB/Web May/June – Convene first Sunshine Grid Advisory meeting July – Demonstrate shared storage over FLR Aug – Release Showcase on web of three science projects Nov – Host industry forum to bridge industry and academia Nov – Supercomputing 2011 (SC11), Seattle, WA Nov – Solicit ideas for additional projects

Sunshine Grid: Architecture Components o Searchable catalog of research resources in the state of Florida o Showcase of Florida’s high-end resources o Web-based outreach and education resources o Statewide cyber-infrastructure o People

Sunshine Grid: Architecture Searchable catalog of research resources in the state of Florida o Researchers are a resource ! o Efficient use of resources o Help industry find resources o Enable collaboration

Sunshine Grid: Architecture Searchable catalog of networked research resources in the state of Florida o Web based for easy access o High available cluster infrastructure o Updated by grid personnel o CMS based for ease of maintenance

Sunshine Grid: Architecture Using cloud tag technology o Databases are too inflexible for rapidly changing technologies which leads to inflexible searching and underutilization o Tags are contributor generated labels: FSU, UF, HPC, high energy physics o The Tag Cloud will show the top N tags. The larger or more prominent a tag is, the more it has been used to describe a resource

Sunshine Grid: Architecture Cloud tag technology – example music

Sunshine Grid: Architecture Web-based Outreach and Education o Florida’s Universities (e.g., python tutorials) o Community Colleges o K-12

Sunshine Grid: Architecture A state-wide cyberinfrastructure o Leverages expertise at Universities with existing HPC centers o Allows universities without HPC to provide resources without startup investment o Provides interface to national and international resource (Open Science Grid, TeraGrid/XD) o Provides competitive edge to state researchers, universities, and industry

Sunshine Grid: Architecture A state-wide cyberinfrastructure o Common Authorization/Access Method  Open Science Grid  InCommon  Home-grown

Sunshine Grid: Architecture A state-wide cyberinfrastructure o High speed storage available from across the state  Data may be the most difficult problem to solve  File sharing via distributed Lustre implementation o Shared computational resources  Shared to other Florida Universities  Shared to outreach partners  Built on Florida Lambda Rail (FLR)

Sunshine Grid: Architecture A state-wide cyberinfrastructure o People  Experts  Ambassadors  Collaborators

Sunshine Grid: Research Projects CMS experiment at CERN o UF, FSU (+ FIT, FIU) Cryo Electron Microscopy (CryoEM) o FSU and UF Coupled Ocean Atmosphere o USF and FSU

CMS Experiment at CERN’s Large Hadron Collider

A Proton-Proton Collision Will Record ~10 9 collisions/year

CMS Computing ~10s PB of collision data collected per year o Similar amount of simulated data Worldwide distributed computing resources o US part supported by Open Science Grid UF is a “Tier-2” university site o Data repository for physics analyses o Supports FSU, FIT, FIU

CMS Experiment CMS Experiment Global Grid Online System CERN Computer Center FermiLabKoreaRussia UK FIT 300 MB/s >10 Gb/s Gb/s Gb/s Tier 0 Tier 1 Tier 3 Tier 2 Physics caches PCs FIU UCSD Caltech U Florida >2000 physicists, 60 countries 10s of Petabytes/yr CERN / Outside = 10-20% FSU OSG

Miami 2010 (Dec. 16, 2010) Paul Avery A. Farbin M. Ernst, BNL LH C

Worldwide LHC Computing Grid Miami 2010 (Dec. 16, 2010) Paul Avery From Ian Bird

Open Science Grid: LHC, Chemistry, Bioinformatics, Etc.

CMS Supported Faculty UF o Darin Acosta, Paul Avery, Ivan Furic, Richard Field, Jacobo Konigsberg, Andrey Korytov, Konstantin Matchev, Guenakh Mitselmakher, John Yelton FSU o Todd Adams, Andrew Askew, Harrison Prosper, Sharon Hagopian, Vasken Hagopian, Kurtis Johnson FIT & FIU o Marc Baarmand, Marcus Holhmann, Steve Linn, Pete Markowitz, Jorge Rodriguez

Other Information ?id=3091http://casgroup.fiu.edu/physics/pages.php ?id=3091

CryoEM Automated Cryogenic Transmission Electron Microscope o Determine the three-dimensional structures of large biological molecules at high resolution o Many medical and basic science applications Instruments o FSU: Titan Krios at Institute for Molecular Biology o UF: G2 F20 (forthcoming) o Both have high resolution & high data rates

Titan Krios EM at FSU Resolution ~1 nm

CryoEM Integration with HPC Bring image data and metadata produced by both microscopes to HPC facilities at FSU & UF o Improved retention and availability of cryoEM data o Data will be placed on Lustre file systems for transparent sharing between both campuses o Available to other research groups in Florida

CryoEM Supported Faculty FSU o Scott Stagg, Kenneth Taylor, Kenneth Roux Thomas Roberts, Beth Stroupe UF o Byung-Ho Kang, Mavis Agbandje-McKenna, Robert McKenna

Coupled Ocean-Atmosphere Models State-of-the-art ensemble ocean- atmosphere-wave coupled forecasting system Utilizes latest developments in regional mesoscale atmospheric, ocean, and wave models as well as in ocean and hurricane vortex initialization

Wikipedia

Goals Quantifying the predictability of the ocean- atmosphere-wave coupled system Communicating quantified threats to public agencies for improved decision making

Atmos-Ocean Supported Faculty FSU o R. Hart, E. Chassignet, M. Bourassa, C. Clayson, S. Morey, D. Dukhovskoy USF o R. Weisberg, J. Collins, Q. Xiao

Other Information