Connect.usatlas.org ci.uchicago.edu ATLAS Connect Technicals & Usability David Champion Computation Institute & Enrico Fermi Institute University of Chicago.

Slides:

Advertisements

Similar presentations

Scaling TeraGrid Access A Testbed for Attribute-based Authorization and Leveraging Campus Identity Management

Advertisements

Pharos Uniprint 8.3.

Campus Grids & Campus Infrastructures Community Rob Gardner Computation Institute / University of Chicago July 17, 2013.

Campus Grids & Campus Infrastructures Community Rob Gardner Computation Institute / University of Chicago June 4, 2013.

A Computation Management Agent for Multi-Institutional Grids

Environmental Council of States Network Authentication and Authorization Services The Shared Security Component February 28, 2005.

National Center for Supercomputing Applications University of Illinois at Urbana-Champaign This material is based upon work supported by the National Science.

Federated Access to US CyberInfrastructure Jim Basney CILogon This material is based upon work supported by the National Science Foundation.

Access and Identity Management for Enterprise Portals Rohit Gupta Director, Identity Management Product Management Oracle Corporation.

Catania Science Gateway Framework Motivations, architecture, features Catania, 09/06/2014Riccardo Rotondo

Minerva Infrastructure Meeting – October 04, 2011.

Makrand Siddhabhatti Tata Institute of Fundamental Research Mumbai 17 Aug

OSG End User Tools Overview OSG Grid school – March 19, 2009 Marco Mambelli - University of Chicago A brief summary about the system.

Building service testbeds on FIRE D5.2.5 Virtual Cluster on Federated Cloud Demonstration Kit August 2012 Version 1.0 Copyright © 2012 CESGA. All rights.

Ways to Connect to OSG Tuesday afternoon, 3:00 pm Lauren Michael Research Computing Facilitator University of Wisconsin-Madison.

MCSE Guide to Microsoft Exchange Server 2003 Administration Chapter Four Configuring Outlook and Outlook Web Access.

GRAM: Software Provider Forum Stuart Martin Computational Institute, University of Chicago & Argonne National Lab TeraGrid 2007 Madison, WI.

U.S. Department of Agriculture eGovernment Program August 14, 2003 eAuthentication Agency Application Pre-Design Meeting eGovernment Program.

Flexibility and user-friendliness of grid portals: the PROGRESS approach Michal Kosiedowski

1 School of Computer, National University of Defense Technology A Profile on the Grid Data Engine (GridDaEn) Xiao Nong

PostalOne! / FAST Data Exchange - Vision 02/15/05.

SURENDER SARA 10GAS Building Corporate KPI’s

Through the development of advanced middleware, Grid computing has evolved to a mature technology in which scientists and researchers can leverage to gain.

GridFE: Web-accessible Grid System Front End Jared Yanovich, PSC Robert Budden, PSC.

Scalable Systems Software Center Resource Management and Accounting Working Group Face-to-Face Meeting October 10-11, 2002.

Module 5 Configuring Authentication. Module Overview Lesson 1: Understanding Classic SharePoint Authentication Providers Lesson 2: Understanding Federated.

National Computational Science National Center for Supercomputing Applications National Computational Science NCSA-IPG Collaboration Projects Overview.

GridShib: Grid/Shibboleth Interoperability September 14, 2006 Washington, DC Tom Barton, Tim Freeman, Kate Keahey, Raj Kettimuthu, Tom Scavo, Frank Siebenlist,

Kuali Days :: Chicago May Kuali Student Presentation on  Person Identity Module  Curriculum Management Module.

Evolution of the Open Science Grid Authentication Model Kevin Hill Fermilab OSG Security Team.

1 The World Bank Internet Services Program Rajan Bhardvaj

Developing & Managing A Large Linux Farm – The Brookhaven Experience CHEP2004 – Interlaken September 27, 2004 Tomasz Wlodek - BNL.

An Overview of Single Sign-On, Federation, Its Benefits, and Basic Procedures for Integrating Applications.

Remote Cluster Connect Factories David Lesny University of Illinois.

All Rights Reserved, Swurv, secure gateway interoperable communication multidomain traffic system APPLICATION LAYER TECHNICAL DISCUSSION.

09/02 ID099-1 September 9, 2002Grid Technology Panel Patrick Dreher Technical Panel Discussion: Progress in Developing a Web Services Data Analysis Grid.

NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.

Information on the Australian Access Federation (AAF) For Service Desk staff February 2013 Visit us online: aaf.edu.au or contact:

Community Sign-On and BEN. Table of Contents  What is community sign-on?  Benefits  How it works (Shibboleth)  Shibboleth components  CSO workflow.

Campus grids: e-Infrastructure within a University Mike Mineter National e-Science Centre 14 February 2006.

Leveraging the InCommon Federation to access the NSF TeraGrid Jim Basney Senior Research Scientist National Center for Supercomputing Applications University.

6/23/2005 R. GARDNER OSG Baseline Services 1 OSG Baseline Services In my talk I’d like to discuss two questions:  What capabilities are we aiming for.

Pilot Factory using Schedd Glidein Barnett Chiu BNL

Authentication and Authorisation for Research and Collaboration Peter Solagna Milano, AARC General meeting Current status and plans.

Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing

Auditing Project Architecture VERY HIGH LEVEL Tanya Levshina.

ATLAS Midwest Tier2 University of Chicago Indiana University Rob Gardner Computation and Enrico Fermi Institutes University of Chicago WLCG Collaboration.

Partnerships in Innovation: Serving a Networked Nation Grid Technologies: Foundations for Preservation Environments Portals for managing user interactions.

WLCG Authentication & Authorisation LHCOPN/LHCONE Rome, 29 April 2014 David Kelsey STFC/RAL.

Accelerating Campus Research with Connective Services for Cyberinfrastructure Rob Gardner Steve Tuecke.

PROGRESS: GEW'2003 Using Resources of Multiple Grids with the Grid Service Provider Michał Kosiedowski.

Integrating the Healthcare Enterprise Improving Clinical Care: Enterprise User Authentication For IT Infrastructure Robert Horn Agfa Healthcare.

Tier 3 Support and the OSG US ATLAS Tier2/Tier3 Workshop at UChicago August 20, 2009 Marco Mambelli –

G. Russo, D. Del Prete, S. Pardi Kick Off Meeting - Isola d'Elba, 2011 May 29th–June 01th A proposal for distributed computing monitoring for SuperB G.

Job submission overview Marco Mambelli – August OSG Summer Workshop TTU - Lubbock, TX THE UNIVERSITY OF CHICAGO.

Efi.uchicago.edu ci.uchicago.edu FAX splinter session Rob Gardner Computation and Enrico Fermi Institutes University of Chicago ATLAS Tier 1 / Tier 2 /

UCTrust Integration for UC Grid David Walker University of California, Davis ucdavis.edu Kejian Jin University of California, Los Angeles kjin.

Grid Colombia Workshop with OSG Week 2 Startup Rob Gardner University of Chicago October 26, 2009.

Community Sign-On and BEN. Table of Contents  What is community sign-on?  Benefits  How it works (Shibboleth)  Shibboleth components  CSO workflow.

Bringing Federated Identity to Grid Computing Dave Dykstra CISRC16 April 6, 2016.

Ways to Connect to OSG Tuesday, Wrap-Up Lauren Michael, CHTC.

Efi.uchicago.edu ci.uchicago.edu FAX splinter session Rob Gardner Computation and Enrico Fermi Institutes University of Chicago ATLAS Tier 1 / Tier 2 /

LIGO Identity and Access Management

Open OnDemand: Open Source General Purpose HPC Portal

Investigation authentication using AAF for the CVL on NeCTAR

Patrick Dreher Research Scientist & Associate Director

Integrating non web-based services with identity federations

Storing and Accessing G-OnRamp’s Assembly Hubs outside of Galaxy

TeraGrid Identity Federation Testbed Update I2MM April 25, 2007

Presentation transcript:

connect.usatlas.org ci.uchicago.edu ATLAS Connect Technicals & Usability David Champion Computation Institute & Enrico Fermi Institute University of Chicago

connect.usatlas.org ci.uchicago.edu 2 ATLAS Connect Overview A combined job submission environment and storage platform Low entry overhead – simple signup – easy sponsorship procedure Ready-to-use tools Growth — straightforward connectivity to: – existing tier2 and tier3 facilities – ready to integrate with future sites

connect.usatlas.org ci.uchicago.edu 3 ATLAS Connect Audience Current tier3 sites with limited resources for cluster management Tier3 sites with capacity or throughput needs – can benefit from direct resource sharing with other sites – can connect short-lived cycle pools – leverage other sites’ bandwith through computational locality Future Tier3 working groups – lower startup cost by leaning upon shared infrastructure

connect.usatlas.org ci.uchicago.edu 4 Architectural Overview Flocked Tier2s Flocked Tier3s Campus Grids connect.usatlas.org portal login FaxBox PanDA Courtesy of Rob Gardner

connect.usatlas.org ci.uchicago.edu 5 Components Web gateway: Identity/Access portal (via web site) FAXbox: storage nexus Login node: ssh://login.usatlas.org

connect.usatlas.org ci.uchicago.edu 6 Web Gateway Provides central access gateway – ATLAS Connect facilities – documentation – user & resource management – analytics New user signup → Identity & Access Portal Hub for future features

connect.usatlas.org ci.uchicago.edu 7 Identity and Access Portal Define identity external to home institutions – ability to co-locate user activities at one site, regardless of origin – no dependency on scoped names o (users may change institutions) – integration with third-party compute and data services (e.g. Globus)

connect.usatlas.org ci.uchicago.edu 8 Identity and Access Portal Access mechanisms that are based on home identity – InCommon authentication via CILogon – existing SSH and x.509 identity, depending on context Role management – Institution – ATLAS working groups

connect.usatlas.org ci.uchicago.edu 9 FAXbox Storage nexus integrating multiple access protocols – Federated ATLAS XRootD (FAX) – HTTP – Filesystem – Parrot/Chirp

connect.usatlas.org ci.uchicago.edu 10 Login Server SSH access – RSA keys provided in advance via user portal – or password Web access through JavaScript vt100 emulation Direct local or xrdcp access to FAXbox data

connect.usatlas.org ci.uchicago.edu 11 Login Server Job management: – Condor submission frontend – Backends o Condor flocking to MWT2, tier3 clusters, other campus grids o Remote submission via BOSCO to Condor or other queuing systems Job metadata insertion to analytics tools – available via web gateway

connect.usatlas.org ci.uchicago.edu 12 High-Level Workflow

connect.usatlas.org ci.uchicago.edu 13 Sequence of Steps User visits ATLAS Connect site User signs up (see attached workflow screenshots) User requests institutional group membership Approver validates group join request (possibly involving contact with site principals) User is joined into group After 3-5 minutes, credentials authorized User may ssh or web connect to login.usatlas.org

connect.usatlas.org ci.uchicago.edu User Management Views

connect.usatlas.org ci.uchicago.edu 15 Views: Web Gateway

connect.usatlas.org ci.uchicago.edu 16 Views: Profile Management ▶ Connect ▶ My Profile

connect.usatlas.org ci.uchicago.edu 17 Views: Key Management ▶ Connect ▶ My Profile ▶ Manage Identities

connect.usatlas.org ci.uchicago.edu 18 Views: User’s Groups ▶ Connect ▶ My Profile ▶ My Groups

connect.usatlas.org ci.uchicago.edu 19 Views: All ATLAS Groups

connect.usatlas.org ci.uchicago.edu Analytics

connect.usatlas.org ci.uchicago.edu 21 Analytics CycleServer – Adobe Flash-based utilization metrics & graphing Accounting Summart (Gratia) – Job breakdown by project, institution, user

connect.usatlas.org ci.uchicago.edu 22 Analytics: CycleServer ▶ Resources ▶ ATLAS Connect User

connect.usatlas.org ci.uchicago.edu 23 Analytics: CycleServer ▶ Resources ▶ ATLAS Connect User

connect.usatlas.org ci.uchicago.edu 24 Analytics: Accounting Summary ▶ Resources ▶ Accounting Summary

connect.usatlas.org ci.uchicago.edu Questions?

connect.usatlas.org ci.uchicago.edu Signup Workflow Appendix

connect.usatlas.org ci.uchicago.edu Signup Workflow InCommon

connect.usatlas.org ci.uchicago.edu Signup Workflow InCommon existing Globus account

connect.usatlas.org ci.uchicago.edu Signup Workflow InCommon no Globus account

connect.usatlas.org ci.uchicago.edu Signup Workflow No InCommon

connect.usatlas.org ci.uchicago.edu Signup Workflow Joining ATLAS Connect