High Performance Computing at the City University of New York 11/19/2018 High Performance Computing at the City University of New York Paul C. Muzio Director CUNY HPC Center College of Staten Island-CUNY paul.muzio@csi.cuny.edu 718-982-3413 November 19, 2018

AGENDA Introduction City University of New York (CUNY) Background 11/19/2018 AGENDA Introduction City University of New York (CUNY) Background Demographics Decade of Science Cyber Infrastructure Historical perspective Future directions Selected CUNY Domain Application Areas November 19, 2018

CUNY-Background City College of New York - 1847 Tuition-free college 11/19/2018 CUNY-Background City College of New York - 1847 Tuition-free college Based solely on merit Economically disadvantaged and those precluded from attending the leading universities of the day because of ethnicity or gender. Hunter College - 1870 Tuition-free teacher-training school, based solely on merit, for young women. Incorporated an elementary and high school for gifted children. November 19, 2018

11/19/2018 CUNY-Background Public university located totally within the 300 sq miles of the City of New York Senior Colleges (1847) City College (1870) Hunter College (1919) Baruch College (1930) Brooklyn College (1937) Queens College (1946) New York City College of Technology (1955) College of Staten Island (1964) John Jay College of Criminal Justice (1966) York College (1968) Lehman College (1970) Medgar Evers College Community Colleges (1957) Bronx Community College (1958) Queensborough Community College (1963) Borough of Manhattan Community College (1963) Kingsborough Community College (1968) LaGuardia Community College (1970) Hostos Community College Graduate and Professional Schools (1961) CUNY Graduate Center (1973) Sophie Davis School of Biomedical Education (1983) School of Law (2005) William E. Macaulay Honors College (2006) Graduate School of Journalism (2006) School of Professional Studies (2008) School of Public Health November 19, 2018

“City University of New York” 11/19/2018 Twentieth Century “City University of New York” Established in 1961 and incorporated the pre-existing City public colleges. 23 Institutions. NYC’s 1975 financial crisis End of free tuition Open enrollment Tuition - current $4,600 per year at senior colleges $3,200 at community colleges CUNY college campuses do not have infrastructure facilities to support HPC November 19, 2018

Decade of Science Enhance CUNY’s position as a research university 11/19/2018 Decade of Science Enhance CUNY’s position as a research university Hire 1,200 new faculty Upgrade admission standards while upholding CUNY’s mission of expanding educational opportunities Ended open admissions policy for the senior colleges Provided “immersion” programs at the Community College level Upgrade research facilities Cyber Infrastructure/High Performance Computing Initiative Ab ova Prove its worth the investment November 19, 2018

CUNY-Background Largest urban university in the United States. 11/19/2018 CUNY-Background Largest urban university in the United States. Third largest university system in the United States. Faculty 6,700 full-time 3,500 adjunct 231,000 degree program students. 230,000 adult, continuing and professional education students. College Now Academic enrichment program for 32,500 high school students. Offered at CUNY campuses and more than 300 high schools. University Teacher Academy Free tuition for highly motivated mathematics and science majors who commit to teach in New York City. November 19, 2018

CUNY-Background William E. Macaulay Honors College 11/19/2018 CUNY-Background William E. Macaulay Honors College Graduated its first class in 2005. 3,200 students applied for 360 slots in 2008. 630 more than 2007. 2,400 more than 2001. First-year students have an average SAT score of 1399. University Scholars. Free tuition. Laptop. "cultural passport" for free or reduced-admission to various cultural institutions and venues in New York City. $7,500 expense account that may be used for research and/or study abroad. November 19, 2018

CUNY Demographics Gender 61% female 39% male Ethnicity 11/19/2018 CUNY Demographics Gender 61% female 39% male Ethnicity 0.2% American Indian/Native Alaskan 15.8% Asian/Pacific Islander 27.1% Afro-American 25.7% Hispanic 31.2% White 68% attended New York City public high schools November 19, 2018

CUNY-Alumni Dr. Jonas Salk, Polio Vaccine Bernard Baruch, Financier 11/19/2018 CUNY-Alumni Dr. Jonas Salk, Polio Vaccine Bernard Baruch, Financier Sidney 'Paddy' Chayefsky, Author Felix Frankfurter, US Supreme Court Justice General Colin Powell, former Commander, Joint Chiefs of Staff and Secretary of State Upton Sinclair, Author Robert Kahn, Co-developer of TCP/IP Andy Grove, co-founder and former CEO, Intel Corp. 12 Nobel prize winners Many Pulitzer Prize Winners More CEOs and top executives in America graduated with first degrees from CUNY than any other degree-granting institution in the nation (Standard & Poors) 3 Rhodes Scholars in the last 4 years November 19, 2018

CUNY Commitment CUNY HPC Facility at College of Staten Island 11/19/2018 CUNY Commitment CUNY HPC Facility at College of Staten Island 4,500 sq. ft. of warehouse space $3 million allocated for facility renovation 2.25 MW Chilled water Raised floor $6.5 million allocated for design of a 90,000 square foot Computational Science Facility 2014-15 planned completion Expected cost of $75 million CUNYnet links all campuses WDM between some campuses, at present 1 Gbit between HPC and CUNYnet, at present Faculty hiring November 19, 2018

2009 interim upgrade 2007 to the interim upgrade November 19, 2018 11/19/2018 2009 interim upgrade to the interim upgrade 2007 November 19, 2018

CUNY HPC Philosophy What doesn’t work One size DOES NOT fit all 11/19/2018 CUNY HPC Philosophy What doesn’t work One size DOES NOT fit all Can’t compete for $ with the largest NSF sites Cheap FLOPS is not necessarily the answer Multi-core has its limitations Power and heat Scalability Programmability Is HPC going in the wrong direction (architectural issues)? Don’t put all one’s eggs in one basket MPI? Learning curve Limitations Better alternatives in the future? November 19, 2018

CUNY HPC Philosophy Be unique 11/19/2018 CUNY HPC Philosophy Be unique Establish a capability and reputation for work in key disciplines Bring in new architectures with external funding Demonstrate that investment in HPC is worthwhile Produce external funding for research and students CUNY Central will fund O&M, replenishment and upgrades (including generic cluster systems) November 19, 2018

CUNY HPC Philosophy Why MPI+GPU? 11/19/2018 CUNY HPC Philosophy MPI+GPU ** Spring 2010 delivery NSF funded PGAS Fall 2010 (hopefully) 2011 Others-to be determined **Note: Adds 384 nehalem cores and 24 Nvidia Fermi GPUs to an existing 384 core nehalem SGI ICE system Why MPI+GPU? Certain key algorithms require minimal communications and map well to GPUs Familiarity with vectors Anticipating future HPC chip directions X86 plus vectors on a chip Anticipating future compiler technology November 19, 2018

11/19/2018 MPI-GPU Cluster November 19, 2018

11/19/2018 MPI-GPU Cluster November 19, 2018

MPI-GPU Cluster Environmental science WRF and WRF-chem 11/19/2018 MPI-GPU Cluster Environmental science WRF and WRF-chem NCAR + PGI development Urban traffic and air pollution issues Monte Carlo simulations Finance Condensed matter Photonics Creative media Genomics November 19, 2018

MPI-GPU Application Areas 11/19/2018 MPI-GPU Application Areas Weather, climate, and pollution studies (CCNY-NOAA CREST Center) Study of air pollution in urban areas including: Development of algorithms for sensing atmospheric temperature and moisture profiles, surface temperature, cloud geometric and optical properties, and aerosol and ozone and CO2 concentrations. Analyze sensor noise to facilitate a cost-benefit analysis of lossless versus near-lossless compression and develop suitable analysis metrics, which balance cost, speed, and accuracy. Existing facilities include: Satellite downlinks from weather observational satellites including NOAA EAST GEO Satellite, Moderate Resolution Imaging Spectroradiometer (MODIS9 on TERRA and AQUA platforms), CloudSat, and Cloud-Aerosol Light Detection and Ranging (LIDAR) and Infrared Pathfinder Satellite Observatory (CALIPSO). Developmental activities: Development of advanced data collection and data analysis capabilities. Visualization. Electrical engineering, FPGAs, etc. An important beginning, but we must recognize that it is a modest beginning. In the 1980s, San Diego was the fastest growing city in the US. Business office space was increasing at a rate of 26% per year. New York City had a percentage growth of under 5%, but New York City’s growth was more than the equivalent of building an entirely new San Diego each year. CUNY is, to some extent, in the same position as San Diego. The difference is that, if it wishes, it can exploit funding resources to catapult it into a leadership position in one or more areas. November 19, 2018

MPI-GPU Application Areas 11/19/2018 MPI-GPU Application Areas Computational Finance, Economics, and Mathematics (Baruch and Brooklyn Colleges, College of Staten Island) Critical technologies for New York City’s economic base Wall Street Computational Finance and Economics Baruch College is the largest Business School in the United States Programs in Computational Finance Strong Working Relationships with Wall Street Mathematics Highly Ranked Program in Mathematics An important beginning, but we must recognize that it is a modest beginning. In the 1980s, San Diego was the fastest growing city in the US. Business office space was increasing at a rate of 26% per year. New York City had a percentage growth of under 5%, but New York City’s growth was more than the equivalent of building an entirely new San Diego each year. CUNY is, to some extent, in the same position as San Diego. The difference is that, if it wishes, it can exploit funding resources to catapult it into a leadership position in one or more areas. November 19, 2018

MPI-GPU Application Areas 11/19/2018 MPI-GPU Application Areas Creative Media and Computational Arts (New York City College of Technology) Critical technologies for New York City’s economic base Performing Arts Media Arts Advertising Industry Comprehensive programs at the Senior College and Community College Level Architecture 3-D Visualization (including Scientific Visualization) Computer Engineering and Advanced Programming Techniques Digital Multi-media Motion Capture Autism Studies (with the Institute for Basic Research into Behavioral Disabilities) Kinesiology (Physical Therapy, Sports Programs, Performing Arts) An important beginning, but we must recognize that it is a modest beginning. In the 1980s, San Diego was the fastest growing city in the US. Business office space was increasing at a rate of 26% per year. New York City had a percentage growth of under 5%, but New York City’s growth was more than the equivalent of building an entirely new San Diego each year. CUNY is, to some extent, in the same position as San Diego. The difference is that, if it wishes, it can exploit funding resources to catapult it into a leadership position in one or more areas. November 19, 2018

Native PGAS System Expected Fall 2010 delivery 11/19/2018 Native PGAS System Expected Fall 2010 delivery Native support in hardware for PGAS languages Co-arrays in Fortran Unified parallel C Engineering applications Heart modeling Blast damage Computational fluid dynamics Why? Easier to program Facilitates new approaches/solutions November 19, 2018

11/19/2018 Why PGAS? November 19, 2018

11/19/2018 Why PGAS? November 19, 2018

Please visit us and take a free cruise on one of our cruise ships! 11/19/2018 Thank you!!! Please visit us and take a free cruise on one of our cruise ships! November 19, 2018