1. Collaborative Expedition Workshop #73 May 20, Potentials and Realities of Certification in Light of Open Technology Development
Susan Turnbull, GSA, Co-chair, Emerging Technology Subcommittee and Co-chair, Social Economic and Workforce Implications of IT, Subcommittee on Networking and IT R&D
The Collaboration Expedition Workshops are a place for individuals and CoPs to explore how to create, as DougEngelbart would say, "Frontier Outposts" to help us to collectively envision possibilities. When our different ways of seeing and being in the world can be attuned, we all experience a longer, clearer horizon for strategic, coordinated action.
The first workshop, in March 2001 was a simple brown bag lunch. GeorgeBrett shared with SusanTurnbull and several colleagues his perspective about tools to help individuals work in community. As of April, 2004, all-day workshops draw people together from multiple perspectives. Participants share a sense of purpose around societal challenges immune to tactics by single groups. The Expedition workshop story is being documented as a technological change process that goes beyond "technology-driven" change. By centering around people and the "whole system" challenges they organize around, IT design and development processes can mature with less risk and greater national yield of breakthrough performance innovations.

2. Collaborative Expedition Workshops
Purpose: Monthly open workshops to transcend insularity, encourage collaboration and demonstrate promising capabilities emerging from IT research and development
Organize around common purpose, larger than any institution, to appreciate potentials and realities
Improve quality of dialogue and collaborative prototyping at intergovernmental crossroads
Participants, representing many forms
of expertise, return to their settings
with a larger perspective of the “whole”
1. Mature open forum process in place - Crossroads for building trusted relationships and alignment among Communities of Practice (CoPs) and other stakeholders in light of shared goals to leverage EA.
a. New Communities of Practice to network with:
Additional Forum Partner: Human Computer Interaction and Information Management Coordinating Group, NITRD – November 8 joint workshop on information integration in light of complex legal and access sensitivities
De Tocqueville “Americans of all ages, all conditions, and all dispositions form associations. …In democratic countries the science of association is the mother of science; the progress of all the rest depends on the progress it has made.”

3. Collaborative Expedition Workshops
Create conducive conditions for “Breakthrough” Innovations
Need to Know -> Need to Share -> Build to Share
To be Informed (not Overwhelmed)
by the Combined Complexity of our multiple forms of Expertise
Communities of Practice
Agile Framework for Building
Intergovernmental Services
Open Collaboration,
Open Standards
To build common understanding of fundamental concepts needed for communities, representing diverse forms of expertise, to work together to leverage EA toward improved public service delivery at lower cost.
Leverages learning and collaborative prototyping around how emerging data sets, tools and services could be deployed within and across communities.
Facilitates socializing around emerging institutional components (open collaboration, governance for DRM evolution) and cyber-infrastructure components, currently under development by all the subcommittees of the AIC.
Creates conducive conditions for co-development of emerging institutional and cyber-infrastructure components in a problem -centered, cross-boundary context with greater potential for re-use and reduced risk (including lock-in, disconnected system costs)
Creates conducive conditions, through Communities of Practice, for agencies using the Performance Reference Model to identify performance improvement opportunities crossing traditional structures and boundaries.

4. VASA – 1628
In design we either hobble or support people’s natural ability to express forms of expertise.

5. Building Sustainable Stewardship Practices Across Communities
Collaborative Expedition Workshops and Collaborative Work Environment ( Co-sponsors:
1. GSA's Intergovernmental Solutions Office
2. Emerging Technology SC (ETSC), Architecture and Infrastructure Committee of the Federal CIO Council –
3. Subcommittee on Networking and Information Technology R & D (NITRD) and Social, Economic and Workforce Implications of IT and IT Workforce Development (SEW) Coordinating Group, NITRD –

6. Emerging Technology Subcommittee (ET SC), CIO Council
Tuning ET Together
From Stovepipes to Wind Chimes
Purpose: “Incubator” organizing process to accelerate shared discovery, maturation, and validation of community-based capabilities. Common understanding of scenarios
Greater foresight and discernment
Improved collaboration
Sustainable life-cycles
Greater foresight and discernment as established and emerging technologies compete and converge
Longer life-cycles through market-based, open standards technologies
Common understanding of scenarios to anticipate performance and mitigate risks.
Improve strategic foresight and collaboration around assets.

7. Emerging Technology Subcommittee - ET SC
Key FY08 Activities
Conduct Collaborative Expedition Workshops with GSA and Subcommittee on Networking for IT Research and Development
Conduct ET Life-cycle process – (StratML)
ET SC Co-chairs
Susan Turnbull
Richard Spivack
Mention StratML

8. ET SC co-chairs SEW CG co-chairs
Key FY08 Activities
1. Conduct Collaborative Expedition Workshops
Purpose: Monthly open workshops to encourage collaboration among government and community implementers of IT and to demonstrate promising capabilities emerging from IT research that aligns with FEA principles
“Facilitate strategic dialogue among communities of interest. Through the Expedition Workshops, sponsored by AIC, interested participants experience and learn about new opportunities to adhere to sound architectural principles and implement shared, service-oriented solutions.” from CIOC Strategic Plan
Leadership in virtual collaboration (i.e. Data Reference Model, Geospatial Profile)
Key FY08 Activities/Deliverables
Organize around business scenarios from ET.gov & IT R&D communities that address CIOC Strategic Plan and Architecture Principles for the US Government.
Organize around CIO requests.
ET SC co-chairs SEW CG co-chairs
Susan Turnbull, ET SC
Susan Turnbull, SEW
Richard Spivack, ET SC
Suzi Iacono, SEW

9. Jim Disbrow, Program Mgr.
Key FY08 Activities
2. Conduct
Purpose: “Continue to develop more efficient and effective methods for sharing information on emerging technologies.” CIOC Strategic Plan
ET.gov stages:
1. Identification: anyone registers ET component using XML schema
2. Subscription: community forms around high potential component
3. Stewardship: community recognized by ET SC (i.e. IPv6, StratML)
4. Graduation: component recognized by Services SC for inclusion in CORE.gov
Key FY08 Actions
Explore partnering with other federal settings involved in technology evaluation and transfer
Conduct Collaborative Expedition workshops to support networking among ET communities
Contact Information
Jim Disbrow, Program Mgr.
Susan Turnbull
Richard Spivack,

10. Lessons Learned Connecting the Cultural DOTs
- Dialogue, Openness, Transparency
1. Create environment to appreciate the
“whole picture” – transcend insularity
2. Practice plausible scenarios “on Purpose”
Monthly public workshops, no fee, supports
remote participants (shared screen,
chat room) and public archive, including audio files, discussion forum
Assume strategic leadership roles while “thinking out loud together”
3. Shared Purpose is the organizing force in public workshops
Purpose that is larger than any organization – including government; influences structure and participation more than lines of control

11. Lessons Learned – Summary of Purpose
Improved Ability to Appreciate the Whole Picture
overcome cultural differences in order to increase returns and decrease risk
Improved Ability to Engage in Sustained Dialogue
low-cost, low risk opportunities to dialogue and exchange views on emerging issues, enabling trust and mutual sense of purpose to meet future challenges together
Improved Resource Allocation Process for Achieving Results
find common ground and shared understanding across funding, implementation, and accountability processes, to eliminate delays, disincentives, and indecisiveness from non-aligned processes

12. Lessons Learned – Organizing via Communities of Practice
Collaborative Space Augments 
Solid
Past contributions and conversations always available
Content never lost, wiki changes visible/ accountable by name
High confidence level in 24/7 availability
Hosted on high performance infrastructure
Platform independent
Any file format in shared repository
fine-grained access – “virtual pointer on infinite whiteboard“
(persistent identifiers)
People’s Natural Ability for Dialogue and Sharing
Fluid
Augments flow of purposeful conversations
Sharing is paramount
Context advances understanding
Supports quality of dialogue, openness and transparency needed to build trust
Supports CoP planning and development of events and documents
Uses only everyday tools: phone and browser
Open or closed communities
Community sets the pace

13. Key Findings
Building Sustainable Stewardship Practices Across Communities
FY03 - Agile business components not easily discovered by e-government managers resulting in lost opportunities
FY04 - Emerging Technologies (web services, grid computing, and semantic web) to tune up Innovation Pipeline with better linkages.
FY05 - Collaborative Work Environment (including wiki) expands effective networking across intergovernmental communities
FY06-07 – Diverse Communities co-organizing the workshops
FY08- Practicing alignment with “real” national scenarios and joint workshops with NITRD Subcommittee Coordinating Groups (Networking for Multiplicative Returns)
Building shared understanding of fundamental concepts needed for communities representing diverse forms of expertise, to work together to leverage toward improved citizen service delivery at lower cost.
Emerging Components Conference Series established in FY04 from FY03 findings
Five national dialogue conferences have been held: two at the White House Conference Center, one at the Washington DC Convention Center and two at MITRE
Conference #6, on June 13, held in conjunction with the First Data Reference Model (DRM) Public Forum.
FY04 findings
Business incubators (state economic development programs)
Innovation diffusion networks (SBIR, angel investors, etc.) and
Business intelligence centers with quality information about e-government and e-commerce gaps.
Semantic Interoperability CoP, Best Practices Committee
XML CoP, Architecture & Infrastructure Committee – http//:et.gov
IT R& D Communities
FY05 Joint OMB/AIC Data Reference Model initiative established – led by Mike Daconta, DHS, Susan Turnbull, Architecture and Infrastructure Committee Representative and Mary McCaffery, Federal Enterprise Architecture Program Management Office Representative
FY05 Collaborative Work Environment
June 13 – Quarterly DRM Public Forum and Emerging Components Conference
June 28 – Collaborative Expedition Workshop #41
July 19 – Collaborative Expedition Workshop #42
August 16 - Collaborative Expedition Workshop #43
September 23 - Collaborative Expedition Workshop #44
November 8 – Collaborative Expedition Workshop #45

14. Going Forward: From Stovepipes to Wind-Chimes
"Frontier Outpost" to open up quality
conversations, augmented by “light-weight”
tools, to leverage collaborative capacity of united,
but diverse sectors of society, seeking to discover,
frame, and act on national potentials.
71 workshops since March, 2001
60-80 participants per workshop, many Communities
of Practice
Wiki, shared files, discussion forum, chat room, shared screen display
FY06: 1.1 million visits to site, 3.88 million file downloads, FY07: 1.7 million visits to site, 5.62 million file downloads
FY08 Alignment: Networking for Multiplicative Returns
Building shared understanding of fundamental concepts needed for communities representing diverse forms of expertise, to work together to leverage toward improved citizen service delivery at lower cost.
II. Open Forums and Quarterly Conferences to Socialize Emerging Institutional and Cyberinfrastructure Components
–        see
March 15 – Toward a National Unified Geospatial Enterprise Architecture: Seeing the Way Forward Together – 74 participants
May 17 - Building Discernment Across Communities: Seeing Through Complexity Together: Review of research findings on drivers of high performance collaborations and Community of Practice Use Cases – 50 participants
June 13 – Joint Meeting: First Quarterly DRM Public Forum and Sixth Quarterly Emerging Components Conference: Toward a Unified Data Reference Model: Seeing the Way Forward Together– 270 participants
June 28 –Open Standards for Government Information Sharing: Exploring DRM and Section 207d Congruence - 55 participants
July 19 –Designing the DRM for Data Visibility: Building Sustainable Stewardship Practices Together, Part 1 – 75 participants
August 16 –Designing the DRM for Data Accessibility: Building Sustainable Stewardship Practices Together, Part 2 – 93 participants
September 14 – Second Quarterly DRM Public Forum and Seventh Quarterly Emerging Components Conference
September 23 –Governance and Procurement Readiness Challenges in Future Service Oriented Architecture: Leveraging the Data Reference Model
Building shared understanding of fundamental concepts needed for communities representing diverse forms of expertise, to work together to leverage toward improved citizen service delivery at lower cost.

15. Common Workshop Questions
How can multiple Communities of Practice (CoP) organize around common mission needs to build shared understanding in a manner that encourages creativity, trust, agility, and greater value from assets?
How can shared understanding around urgent cross-boundary scenarios be accelerated and what is the role of collaborative prototyping?
How can maturing, light-weight (Web 2.0) tools support governance and transformational potential of inter-organizational communities and their host institutions? Workshop Questions 2008
c. New Processes:
i. practicing collaborative prototyping with real-world scenario as multiple CoPs/CoIs might do in the future (July 19, August 16 workshops with hands-on exercises)
ii. open virtual collaboration with open comment process
d. New Technology role
Lightweight tools that emphasize augmenting the capacities of communities to develop shared understanding around joint mission-related actions
e. New Questions
III. Building Collaboration Readiness / Discernment Questions:
1. How can multiple communities work together using relevant scenarios to build stewardship practices that support readiness and realization of a mission-driven, data-sharing network and architecture in light of the Data Reference Model?
2. How is the emerging maturity of notation systems generally, enabling multiple notation systems to reinforce and map to one another, while contributing to current demands for real-time readiness and visibility of the "whole picture"?
3. How can the capacities of trust, agility, and accountability be achieved through federated stewardship among communities still building common ground and understanding?
4. How can Communities of Interest define their identities, roles, and relationships in a manner that reinforces their individual and collective capacities?

16. Today’s Workshop Questions
1. How are technical advances, sources of supply, and interdependencies measuring up or falling short of national demands for high confidence in critical cyberinfrastructures?
2. Have certification programs to mitigate risk kept pace with technology advances? If not, what needs to be done?
3. Given the continuum of open systems architecture, what does the landscape for dependable software approaches look like today? What's missing?

17. Today’s Workshop Questions
A. People: Appreciation of Potentials / Expanding the Possibilities Through Decentralized, Transparent Structure / Setting the Tone for Open Inquiry, Experimentation and Social Exchange
1. What are the conducive conditions for needed creativity and governance among networked scientific and scholarly communities?
2. How can effective roles and responsibilities be established for professionals to respond to "overlapping" uncertainties with collaboration needed in an ever-expanding, data and information-rich world?
3. How do we create problem representations and simulations to build capacity for joint action that addresses our need for agile, safe, and comprehensive societal innovations?

18. Today’s Workshop Questions
B. Process: Transcending Insularity - Toward Transparency in Acquisition with Open Technology Deployment and Trusted Community Sharing and Exchange Networks
1. What frameworks, representations, metrics, and procedures are needed for evaluating the trustworthiness of systems?
2. How can the right information and information structures support effective technology evaluation, including assurance cases?
3. How might we expand the systems view of certification?
4. What are the similarities and differences associated with certifications of people (professional training), objects (i.e. medical devices), processes and scenarios that involve certified people, objects, and processes?

19. Today’s Workshop Questions
C. Higher Performance, Greater Returns: Revisiting Total Cost of Ownership (TCO) in Contracting for High Confidence Assurance/ Amplifying Capacity through Sharing and Exchange across Communities of Practice and Communities of Interest
1. What properties are required of a certification methodology, tools, and results? (e.g., repeatability, comparability, assurance,...)
2. What is the state of current certification practices in various sectors?
3. Are some approaches more cost-effective than others?

20. Invitation to Upcoming Expedition Workshops
June 10 – Overcoming I/O Processing Ultra-Large Data Collections (NSF, NARA)
July 15 - Peer Review and Peer Production
August 19 - Broad Public Participation
Sept. 16– Science of Science and Innovation Policy (NSF, DoE)
(being developed with NITRD CGs)
Contact Susan.Turnbull at gsa.gov
Questions??
Discussion