Hillsboro August F2F Summary Paul Grun OFI WG co-chair 01 Sept ‘14.

Slides:



Advertisements
Similar presentations
Upgrading the Oracle Applications: Going Beyond the Technical Upgrade Atlanta OAUG March 19, 1999 Robert Cooney.
Advertisements

Microsoft ® System Center Configuration Manager 2007 R3 and Forefront ® Endpoint Protection Infrastructure Planning and Design Published: October 2008.
Welcome to the 10 th OFA Workshop #OFADevWorkshop.
4/15/2017 5:36 AM 1 © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered.
Identity Management Based on P3P Authors: Oliver Berthold and Marit Kohntopp P3P = Platform for Privacy Preferences Project.
Exploring Improvement to Verbs Tom Stachura, OFA TAC Co-chair #OFADevWorkshop.
1 Introducing Collaboration to Single User Applications A Survey and Analysis of Recent Work by Brian Cornell For Collaborative Systems Fall 2006.
Electronic Customer Portal System. Reducing Risks – Increasing Efficiency – Lowering Costs Secure Internet based Communication Gateway direct to your.
Overview of Eclipse Parallel Tools Platform Adam Leko UPC Group HCS Research Laboratory University of Florida Color encoding key: Blue: Information Red:
Omniran ZigBee SEP2 Smart Grid Use Case Analysis Date: Authors: NameAffiliationPhone Max RiegelNSN
SeaDataNet Ontology Use Case Roy Lowry British Oceanographic Data Centre Coastal Atlas Interoperability Workshop, Corvallis, July (+ Lessons.
New Direction Proposal: An OpenFabrics Framework for high-performance I/O apps OFA TAC, Key drivers: Sean Hefty, Paul Grun.
Open Fabrics Interfaces Architecture Introduction Sean Hefty Intel Corporation.
Discussing an I/O Framework SC13 - Denver. #OFADevWorkshop 2 The OpenFabrics Alliance has recently undertaken an effort to review the dominant paradigm.
Welcome to SasView Code Camp III Getting started: Where we are Some news about changes already before we start Work Packages Schedule of camp Planning.
Cross Vendor Exchange Testing and Certification Plans April 18, 2013.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
1 Session Number Presentation_ID © 2001, Cisco Systems, Inc. All rights reserved. Using the Cisco TAC Website for IP Routing Issues Cisco TAC Web Seminar.
OFED 1.x Roadmap & Release Process November 06 Jeff Squyres, Woodruff, Robert J, Betsy Zeller, Tziporet Koren,
Co-funded by the European Union Semantic CMS Community Presentation and Interaction Components VIE.js Copyright IKS Consortium 1 Tilman Becker DFKI GmbH.
Fabtests – test framework ideas/suggestions Howard Pritchard – LANL LA-UR OFI WG F2F - 8/
Cross Vendor Exchange Testing and Certification Plans April 18, 2013 Meaningful Use Stage 2 Exchange Summit Avinash Shanbhag, ONC.
Sprint 104 Review / Sprint 105 Planning April 8, 2013.
The Open Fabrics Verbs Working Group Pavel Shamis and Liran Liss.
OFED 1.2 Lessons, 1.3 Planning and Field Support May 07 Tziporet Koren.
One Body, Many Heads for Repository-Powered Digital Content Applications Hydra Europe Symposium, Trinity College, Dublin, 7 th April 2014 Chris Awre Head.
OpenFabrics 2.0 or libibverbs 1.0 Sean Hefty Intel Corporation.
ZLOT Prototype Assessment John Carlo Bertot Associate Professor School of Information Studies Florida State University.
SCOPE THE PROJECT. Managing Client Expectations Client always seem to expect more than we are prepared to deliver. The expectations gap between client.
Scalable name and address resolution infrastructure -- Ira Weiny/John Fleck #OFADevWorkshop.
IVOA Interop, SL de El Escorial, Oct IVOA DAL - Madrid DAL WG Summary October 7, 2005.
Sally Waselik Joanne Vara 2005 Search Plan for IEEE Web Sites August 2005.
Assessing the influence on processes when evolving the software architecture By Larsson S, Wall A, Wallin P Parul Patel.
GEO Strategic Plan : Implementing GEOSS IMPLEMENTATION PLAN WORKING GROUP GEO EXECUTIVE COMMITTEE MARCH 2015 GENEVA, SWITZERLAND.
EPA Enterprise Data Architecture Metadata Framework Assessment Kevin J. Kirby, Enterprise Data Architect EPA Enterprise Architecture Team
Project Management All projects need to be “managed” –Cost (people-effort, tools, education, etc.) –schedule –deliverables and “associated” characteristics.
TAC Report Tom Stachura & Diego Crupnicoff OFA TAC chairs #OFADevWorkshop.
Andrew McNabSecurity Middleware, GridPP8, 23 Sept 2003Slide 1 Security Middleware Andrew McNab High Energy Physics University of Manchester.
A new thread support level for hybrid programming with MPI endpoints EASC 2015 Dan Holmes, Mark Bull, Jim Dinan
OFI SW Sean Hefty - Intel Corporation. Target Software 2 Verbs 1.x + extensions 2.0 RDMA CM 1.x + extensions 2.0 Fabric Interfaces.
Compliance and Interoperability Discussion 11/25/2014 Paul Grun.
OpenFabrics Interface WG A brief introduction Paul Grun – co chair OFI WG Cray, Inc.
Sponsored by the National Science Foundation Measurement System Spiral 2 Year-end Project Review University of Wisconsin, Colgate University, Boston University.
1 © 2006 Cisco Systems, Inc. All rights reserved. Session Number Presentation_ID Using the Cisco Technical Support & Documentation Website for IP Routing.
GitHub and the MPI Forum: The Short Version December 9, 2015 San Jose, CA.
Test Plan: Introduction o Primary focus: developer testing –Implementation phase –Release testing –Maintenance and enhancement o Secondary focus: formal.
The Data Sharing Working Group 24 th meeting of the GEO Executive Committee Geneva, Switzerland March 2012 Report of the Data Sharing Working Group.
Sprint 113 Review / Sprint 114 Planning August 12th, 2013.
OpenFabrics 2.0 rsockets+ requirements Sean Hefty - Intel Corporation Bob Russell, Patrick MacArthur - UNH.
SharePoint 2010 Business Intelligence Module 7: Filter Web Parts.
Open Fabrics Interfaces Software Sean Hefty - Intel Corporation.
ISeries Note3. Technology independence Technology independence  change the underlying hardware architecture and add new functionality without disrupting.
Stan Smith Intel SSG/DPD June, 2015 Kernel Fabric Interface Kfabric Framework.
Introduction to Terra Dotta Applications Integration with Campus Data Systems for institutions beginning their software implementation.
0 eCPIC User Training: v6.5 Webinars August 2014 These training materials are owned by the Federal Government. They can be used or modified only by FESCOM.
1 © 2004 Cisco Systems, Inc. All rights reserved. Session Number Presentation_ID Cisco Technical Support Seminar Using the Cisco Technical Support Website.
RETS Working Group August 5, 2004Slide 1 RETS 2.0 – Bridging the Gap Sergio Del Rio Templates 4 Business Inc.
DGAS Distributed Grid Accounting System INFN Workshop /05/1009, Palau Giuseppe Patania Andrea Guarise 6/18/20161.
Advanced Topics in Algorithms SPRING TERM PROJECT Is worth 40% of your final grade Completed project with report is due in week th May,
System Software Laboratory Databases and the Grid by Paul Watson University of Newcastle Grid Computing: Making the Global Infrastructure a Reality June.
SC’13 BoF Discussion Sean Hefty Intel Corporation.
DSS Front End Software Review
A Brief Introduction to OpenFabrics Interfaces - libfabric
ATIS Cybersecurity DOCUMENT #: GSC13-GTSC6-12 FOR: Presentation
GBIF Governing Board 20 12th Global Nodes Meeting
OpenFabrics Alliance An Update for SSSI
A Global Trojan Solution
Metadata The metadata contains
Clause 7 Comment Resolutions
Presentation transcript:

Hillsboro August F2F Summary Paul Grun OFI WG co-chair 01 Sept ‘14

Simple code walkthrough Arun Ilango – Tues, 8/19 Presented a side-by-side comparison between libibverbs and libfabrics of an example application (rc pingpong.c). Slides will be posted to the OFA website – oro%20F2F% / oro%20F2F% / May not be representative of an actual libfabrics implementation, since the objective was to relate it to existing libibverbs. 2

App mapping over libfabrics Charles Archer – tues 8/19 Slides to be posted to OpenFabrics 3

Verbs Extensions Rich Graham, Liran Liss – Mellanox Motivated by investment protection in verbs Focused on –Improvements to critical data paths –Scalability –Enhanced memory management –Improved hardware capability Comprehensive slide deck posted to OFA – oro%20F2F% /ofi_verbs.pdfhttps:// oro%20F2F% /ofi_verbs.pdf

Test framework discussion Howard Pritchard –Need simple mechanisms to exercise the APIs Should have as little in the path as possible, Should not require a full job launcher –tests currently available: Unit/provinfo.c, simple/pingpong.c OFED tarball has –Two soruce RPMs containing perftest , qperf –OFED unit testing is done by vendors –Looked at hydra, ORTE, but ORTE requires a wrapper –Best options today: Hydra, PMI –Establish a fabtest on GitHub 5

Management interfaces Sean Hefty –How does libfabrics interface w/ existing mgmt infrastructures? –Sean showed his assumptions relating libfabrics to RDMACM –See Sean’s slides: – oro%20F2F% /fi-mgmt.pptxhttps:// oro%20F2F% /fi-mgmt.pptx 6

Pseudo-coding exercise Objective: deeper dive into specific application of libfabrics. Desired outcome: identify gaps and areas requiring further investigation/clarification. Process: break into four small groups: –MPI point-to-point operations group –MPI initialization group –SHMEM / one-sided working group –RSOCKETS group See meeting minutes on the OFA site for detailed report outs from the four groups 7

Reqmts for 1st release Conclusions reached: –First rel is a working, developmental release Numbering remains an open question for now No specific performance requirement -Must have a mechanism to allow vendor extensions -E.g. a query facility (what features/APIs are available?) -Must have a unit test suite to validate APIs -Must have at least one ref application for functional testing -Must have a versioning mechanism -Must have a defined release mechanism -Independent and not tied to OFED. -Must have fully documented, google-able man pages -Must have upstream repo location, tarball location for source code releases –Must include at least one provider – librdmacm/libibverbs? 8

Reqmts for 1st release – cont’d Conclusions reached: –API acceptance Must include a ref provider implementation, a test to validate it and a comprehensive man page Man pages must include author, major.minor release number, date of the libfabrics tarball, and the major.minor release number and date at the time of the last semantic change to the man page. Man pages should reflect both the user and provider usage of the API. 9

Reqmts for 1 st release – cont’d –Minimum required functionality constituting a first rel: Code is complete for all defined endpoint types and operations –List of supported endpoint types to be included is TBD There is at least one provider for each endpoint type. 10

Extensible functionality How to add new function calls? Discussed several mechanisms –Extending interface structures using size w/ query methods –Currently using a mask to extend data structures No clear direction 11

GIT Moved to GitHub: – –Suggestion: fork to a new repo … ‘libfabrics See Doug Ledford’s best practices – Two repos: –Ofiwg/libfabric –Ofiwg/fabtests 12