Grid Computing Activities within the Department of Computer Science at UNC-Charlotte ITSC 8110 Introduction to Information Technology Research 7:30 pm,

Slides:



Advertisements
Similar presentations
The Access Grid Ivan R. Judson 5/25/2004.
Advertisements

Grid Computing Activities within the Department of Computer Science at UNC-Charlotte ITSC 8110 Introduction to Information Technology Research 7:30 pm,
Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte Mark Holliday Department of Mathematics and Computer Science Western.
Oklahoma Center for High Energy Physics A DOE EPSCoR Proposal Submitted by a consortium of University of Oklahoma, Oklahoma State University, Langston.
Grid Computing, B. Wilkinson, 20045a.1 Security Continued.
High Performance Computing Course Notes Grid Computing.
Andrea Eastman-Mullins Information & Technology Coordinator University of North Carolina, Office of the President Teaching and Learning with Technology.
1 Workshop 20: Teaching a Hands-on Undergraduate Grid Computing Course SIGCSE The 41st ACM Technical Symposium on Computer Science Education Friday.
State-Wide Collaborative Grid Computing Course Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte and Mark Holliday.
U.S. Environmental Protection Agency Central Data Exchange EPA E-Authentication Pilot NOLA Network Node Workshop February 28, 2005.
Application of GRID technologies for satellite data analysis Stepan G. Antushev, Andrey V. Golik and Vitaly K. Fischenko 2007.
1a.1 Introduction to Grid Computing ITCS 4146/5146, UNC-Charlotte, B. Wilkinson, 2007 Jan 17, 2007.
Outline.1 Grid Computing Fall 2005 Tuesday/Thursday 11:00 am - 12:20 pm Instructors Dr. Barry Wilkinson University of North Carolina at Charlotte and Dr.
AssignPrelim1.1 © 2011 B. Wilkinson/Clayton Ferner. Modification date: Aug 22, 2011 Course Preliminaries.
Slides for Grid Computing: Techniques and Applications by Barry Wilkinson, Chapman & Hall/CRC press, © Chapter 1, pp For educational use only.
1 Short Course on Grid Computing Jornadas Chilenas de Computación 2010 INFONOR-CHILE 2010 November 15th - 19th, 2010 Antofagasta, Chile Dr. Barry Wilkinson.
1-2.1 Grid computing infrastructure software Brief introduction to Globus © 2010 B. Wilkinson/Clayton Ferner. Spring 2010 Grid computing course. Modification.
AssignPrelim1.1 ITCS 4146/5146 Grid Computing, 2007, UNC-Charlotte, B. Wilkinson. Jan 13, 2007 Course Preliminaries.
AssignPrelim1.1 ITCS 4146/5146 Grid Computing, 2008, UNC-Charlotte, B. Wilkinson. Aug 25, 2008 Course Preliminaries.
Computing and Data Infrastructure for Large-Scale Science Deploying Production Grids: NASA’s IPG and DOE’s Science Grid William E. Johnston
PRISM Seminar Series – Spring 2009 Dr. Jyoti Mathur Purdue University Friday, February 13, :00pm Birck 1001 Refreshments will be served. For further.
1 Teaching Grid Computing across North Carolina and Beyond Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of.
Copyright B. Wilkinson, This material is the property of Professor Barry Wilkinson (UNC-Charlotte) and is for the sole and exclusive use of the students.
1 Workshop 20: Teaching a Hands-on Undergraduate Grid Computing Course SIGCSE The 41st ACM Technical Symposium on Computer Science Education Friday.
1 Workshop 20: Teaching a Hands-on Undergraduate Grid Computing Course SIGCSE The 41st ACM Technical Symposium on Computer Science Education Friday.
Outline.1 Grid Computing Spring 2007 Tuesday/Thursday 11:00 am - 12:15 pm Instructors Dr. Barry Wilkinson University of North Carolina, Charlotte and Dr.
AssignPrelim1.1 © 2010 B. Wilkinson/Clayton Ferner. Modification date: Dec 20, 2009 Course Preliminaries.
1 Short Course on Grid Computing Jornadas Chilenas de Computación 2010 INFONOR-CHILE 2010 November 15th - 19th, 2010 Antofagasta, Chile Dr. Barry Wilkinson.
Outline.1 Grid Computing Spring 2010 Tuesday/Thursday 11:00 am - 12:15 pm Instructors © 2010 B. Wilkinson/Clayton Ferner. Modification date: Dec 20, 2009.
Tutorial on Distributed High Performance Computing 14:30 – 19:00 (2:30 pm – 7:00 pm) Wednesday November 17, 2010 Jornadas Chilenas de Computación 2010.
Copyright Statement © Jason Rhode and Carol Scheidenhelm This work is the intellectual property of the authors. Permission is granted for this material.
ITCS 6/8010 CUDA Programming, UNC-Charlotte, B. Wilkinson, Jan 22, 2011assignprelim.1 Assignment Preliminaries ITCS 6010/8010 Spring 2011.
1 History and New Developments in State-wide Grid Computing Course NC A & T University Saturday Oct 18, 2008 Dr. Barry Wilkinson University of North Carolina.
Open Science Grid For CI-Days Internet2: Fall Member Meeting, 2007 John McGee – OSG Engagement Manager Renaissance Computing Institute.
Executive summary Grid computing has become an important concept for high performance computing. By taking advantage of the Internet, geographically distributed.
Teaching with Wikis Ken Baclawski College of Computer and Information Science.
1 Grid Computing Barry Wilkinson Department of Computer Science University of North Carolina at Charlotte.
1 " Teaching Parallel Design Patterns to Undergraduates in Computer Science” Panel member SIGCSE The 45 th ACM Technical Symposium on Computer Science.
Friday, October 20, 2006 Barry Wilkinson Department of Computer Science University of North Carolina Charlotte Grid Computing Activities within the Department.
ITCS 4/5145 Cluster Computing, UNC-Charlotte, B. Wilkinson, 2006outline.1 ITCS 4145/5145 Parallel Programming (Cluster Computing) Fall 2006 Barry Wilkinson.
1 “The grid virtualizes heterogeneous geographically disperse resources” "Introduction to Grid Computing with Globus," IBM Redbooks  Using geographically.
Open Science Grid For CI-Days Elizabeth City State University Jan-2008 John McGee – OSG Engagement Manager Manager, Cyberinfrastructure.
ITCS 6/8010 CUDA Programming, UNC-Charlotte, B. Wilkinson, Jan 3, 2011outline.1 ITCS 6010/8010 Topics in Computer Science: GPU Programming for High Performance.
A Geographically-Distributed, Assignment-Structured Undergraduate Grid Computing Course Mark A. Holliday, Barry Wilkinson, Jeffrey House, Samir Daoud,
A Community Information Management System by Pangea Foundation.
Grid Infrastructure group (Charlotte): Barry Wilkinson Jeremy Villalobos Nikul Suthar Keyur Sheth Department of Computer Science UNC-Charlotte March 16,
Panel #2 Discussion SIMVac Symposium 1:30 pm – 2:00 pm April 25, 2006 VisualGrid: An Infrastructure for Visualization and Environmental Research Fostering.
1 SIGCSE 2008 Technical Symposium on Computer Science Education Thursday, March 13, 2008 Towards a Top-Down Approach to Teaching an Undergraduate Grid.
ITCS 4/5010 CUDA Programming, UNC-Charlotte, B. Wilkinson Dec 24, 2012outline.1 ITCS 4010/5010 Topics in Computer Science: GPU Programming for High Performance.
Outline.1 Grid Computing Fall 2008 Tuesday/Thursday 11:00 am - 12:15 pm Instructors Grid Computing, B. Wilkinson, 2008 Aug Dr. Clayton Ferner.
1 Barry Wilkinson University of North Carolina, Charlotte Clayton Ferner University of North Carolina, Wilmington NSF CCLI Showcase SIGCSE 2007 Friday,
SURAGrid Project Meeting Washington, DC Wednesday, February 22, 2006 Barry Wilkinson Department of Computer Science UNC-Charlotte SURAGrid and Grid Computing.
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Outline.1 Grid Computing Fall 2011 Tuesday/Thursday 9:30 am - 10:45 pm Instructors © 2011 B. Wilkinson/Clayton Ferner. Modification date: Aug 22, 2011.
ITCS 4/5145 Parallel Programming, UNC-Charlotte, B. Wilkinson, Dec 26, 2012outline.1 ITCS 4145/5145 Parallel Programming Spring 2013 Barry Wilkinson Department.
Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University.
1 "Workshop 31: Developing a Hands-on Undergraduate Parallel Programming Course with Pattern Programming SIGCSE The 44 th ACM Technical Symposium.
1 Introduction to Teaching Grid Computing Dr. Clayton Ferner University of North Carolina Wilmington Dr. Barry Wilkinson University of North Carolina Charlotte.
1 Workshop 9: General purpose computing using GPUs: Developing a hands-on undergraduate course on CUDA programming SIGCSE The 42 nd ACM Technical.
National Cybersecurity Center of Excellence Increasing the deployment and use of standards-based security technologies Mid-Atlantic Federal Lab Consortium.
Grid technology Security issues Andrey Nifatov A hacker.
EGEE-III INFSO-RI Enabling Grids for E-sciencE EGEE and gLite are registered trademarks Vassiliki Pouli
Deploying Regional Grids Creates Interaction, Ideas, and Integration
Clouds , Grids and Clusters
Grid Computing Course Development team: Barry Wilkinson and Clayton Ferner (Instructors), and Mark Holliday Student assistants: Jeff House and Sam Daoud.
Cloud Computing Student Access and Success Through a DOL Grant
FLC Upper Eastern Shore Industry Day
Grid Computing Software Interface
Presentation transcript:

Grid Computing Activities within the Department of Computer Science at UNC-Charlotte ITSC 8110 Introduction to Information Technology Research 7:30 pm, Wednesday, Nov 1, 2006 Barry Wilkinson Department of Computer Science UNC-Charlotte

Outline Brief description of grid computing Activities: Supercomputing 2003 conference demonstration Grid Computing Course (2004- ) VisualGrid Project (2005- ) SURAGrid

“The grid virtualizes heterogeneous geographically disperse resources” from "Introduction to Grid Computing with Globus," IBM Redbooks  Using geographically distributed and interconnected computers together for computing and for resource sharing. Grid Computing

Usually, involves teams working together on a common goal, sharing computing resources and possibly experimental equipment. Crosses multiple administrative domains. Geographically distributed grid computing team called a virtual organization.

Applications  Originally e-Science applications – Computational intensive Not necessarily one big problem but a problem that has to be solved repeatedly with different parameters. – Data intensive. – Experimental collaborative projects  Now also e-Business applications to improve business models and practices.

Supercomputing 2003 Demonstration  First personal contact with grid computing (November 2003).  Participant in Supercomputing 2003 demo organized by the University of Melbourne (Raj Buyya).  21 countries, numerous sites.

Grid Computing Course  Taught on North Carolina Research and Education televideo network that connects all 16 state campuses and also private institutions  Fall 2004: 8 sites  Fall 2005: 12 sites  Undergraduate/graduate Course Home Page ITCS4010F05  To be offered Spring 2007

Participating Sites, Fall 2005 Participating UNC campuses Private institutions Wake Tech. Community College Lenoir Rhyne College Elon University

Fall 2005 Course grid structure MCNCUNC-WUNC-ANCSUWCUUNC-CASU CA Backup facility, not actually used

Some Publications B. Wilkinson and C. Ferner, “Teaching Grid Computing across North Carolina Part II,” IEEE Distributed Systems Online, vol 7, no 7, B. Wilkinson and C. Ferner, “Teaching Grid Computing across North Carolina Part I,” IEEE Distributed Systems Online, vol 7, no 6, M. A. Holliday, B. Wilkinson, and J. Ruff, “Using an End-to-End Demonstration in an Undergraduate Grid Computing Course,” ACMSE 2006: 44th ACM Southeast Conference, March 10-12, 2006, Melbourne, Florida. B. Wilkinson, M. Holliday, and C. Ferner, “Experiences in Teaching a Geographically Distributed Undergraduate Grid Computing Course,” Workshop, IEEE Int. Symp. Cluster Computing and the Grid (CCGrid2005), Cardiff, UK, May , B. Wilkinson and M. Holliday, “State-Wide Collaborative Grid Computing Course,” 2005 Teaching and Learning with Technology Conference, March 30, 2005, Raleigh, NC. M. A. Holliday, B. Wilkinson, J. House, S. Daoud, and C. Ferner, “A Geographically-Distributed, Assignment-Structured Undergraduate Grid Computing Course,” SIGCSE 2005 Tech. Symp. on Computer Science Education, St. Louis, Missouri, February , 2005.

National Publicity Science Grid This Week Feature story Gridtoday.com

VisualGrid Project  Goal: Collaborative environmental visualization research using a grid computing infrastructure  Started Jan 2006  Involves two sites: – UNC-Charlotte – UNC-Asheville  plus Environment Protection Agency, Raleigh, NC (funding agency) EPA

Project Structure at UNC-C (Virtual Organization)  Visualization Charlotte Visualization Center Bill Ribrasky, Bank of America Endowed Chair of Information Technology (VisualGrid PI) Aidong Lu, Asst. Professor of Computer Science  Environmental Studies Global Inst. of Energy & Environmental Syst. Hilary Inyang, Duke Energy Distinguished Professor Sunyoung Bae, Research Associate Grid Infrastructure Barry Wilkinson, Professor of Computer Science

VisualGrid Infrastructure Group: Goal: To create a geographically distributed set of resources and facilitate collaboration between VisualGrid researchers. Team: Barry Wilkinson Jeremy Villalobos (MS student) Nikul Suthar (MS Student) Keyur Sheth (MS student) Jasper Land (BS student) Department of Computer Science UNC-Charlotte Infrastructure Support 52-node University Research Cluster Chuck Price, Director of University Research Computing Mike Mosley, Senior Systems Developer

Development System (Four 3.4 Ghz dual Xeons) visualgrid.uncc.edu Visualization lab data server (4 Tbytes) Compute resources 52-node (104 processor) University Research Cluster Software: Globus 4.0, Condor. CA Certificate Authority UNC-Charlotte resources UNC-Asheville resources transylvania.tr.cs.unca.edu (8-node system) VisualGrid Configuration VisualGrid portal

National Attention Listed as one of the portals to use OGCE2

 X509 certificates used to provide security in a grid system.  Each user needs a certificate issued by a “certificate authority” (CA).  Grid systems use a so-called user proxy certificates to allow resources to control resources on the user’s behalf. X509 Certificates

CA’s with Mutual Trust UNC-C CA UNC-A CA GT4

Multiple Grid Nodes With multiple grid nodes, users need:  Account on each system, and access control set accordingly.  A certificate acceptable by the local certificate authority (i.e. signed by a CA it trusts)

Getting an account Go to portal and select “register” New User VisualGrid on-line registration form CA/System Administrator Create accounts, set access control, sign certificate, … Fill in form Provide password and other information Request Confirmation Acknowledgement Contact other grid resource administrators if users requests account on their resource

UNC-Asheville Bioinformatics hardware accelerator 52-node UNC-Charlotte university research cluster UNC-C Dept of CS grid computing development system 4TB Windows 2003 data server reached through coit-grid02.uncc.edu (samba mount)

Sample VisualGrid portlets One CMAQ script editing portlet CMAQ portlet, main page CMAQ settings portlet Tabs for various CMAQ actions

VisualGrid Links VisualGrid Infrastructure group page VisualGrid portal VisualGrid Portal User’s Guide wiki

Other work: Collaboration with SURAGrid  Develop and offer Grid course(s) using SURAGrid – Crosses state boundaries.  Integrate EE bioinformatics accelerator into SURAGrid (possible)

Acknowledgements Partial support for the work described here was provided by the National Science Foundation, University of North Carolina Office of the President, and Environmental Protection Agency. National Science Foundation, “Introducing Grid Computing into the Undergraduate Curricula,” ref. DUE , PI: A. B. Wilkinson, co-PI’s Mark Holliday and D. Luginbuhl, $100,000, , Additional Funding,” ref. DUE , PI: B. Wilkinson, $8216, University of North Carolina Office of President, “A Consortium to Promote Computational Science and High Performance Computing,” PI: B. Kurtz (Appalachian State University) co-PIs: B. Berg, W. Campbell, W. Hightower, M. Holliday, J. Hollingworth, R. Hull, D-H Hwang, S. Lea, Y. Li, S. V. Providence, D. Powell, R. Shore, S. Suthaharan, R. Tashakkori, and B. Wilkinson, total $650,000, University of North Carolina Office of President, “Fostering Undergraduate Research Partnerships through a Graphical User Environment for the North Carolina Computing Grid,” PI: R. Vetter (UNC- Wilmington), co-PIs: L. Bartolotii, D. R. Berman, R. Boston, J. Brown, C. Ferner, T. Hudson, T. Janicki, N. Martin, M. McClelland, J. Porter, A. Stapleton, and B. Wilkinson, total $557,634, Environmental Protection Agency, “Proposal to Establish the VisualGrid” PI W. Ribarsky, co-PIs S. Bae, B. Wilkinson, H. Inyang, A. Lu, $485,000, 01/02/ /31/2006.

Questions?