National Center for Supercomputing Applications Barbara S. Minsker, Ph.D. Associate Professor National Center for Supercomputing Applications and Department of Civil and Environmental Engineering University of Illinois at Urbana-Champaign Collaborative Environments Observatory CI Challenge 4: Collaborative Environments October 25, 2004

National Center for Supercomputing Applications Introduction to Collaborative Environments Proposed environmental observatory systems are “collaboratories” –Infrastructure shared by interdisciplinary groups of researchers nationwide, linked via cyber- infrastructure (CI) –Collaboratories have been developed in other fields (BIRN, NEES, Earth System Grid, etc.) These collaboratories have created web-based collaborative environments for accessing data and community resources

National Center for Supercomputing Applications The BIRN Portal* Application environment that provides transparent and pervasive access to the BIRN infrastructure (i.e. tools, applications, resources) with a Single Login from any Internet capable location Provides simple, intuitive access to distributed resources for data storage, distributed computation, and visualization Provides a scalable interface for users of all backgrounds and level of expertise *From Mark James presentation at SC2004.

National Center for Supercomputing Applications Potential Features of Collaborative Environments Communication tools –Discussion boards/ forums –Instant messaging / audio or videoconferencing (inc. Access Grid) –Q&A for experts or peers –Peer review systems –Tools for innovation at a distance (posting ideas, voting) Tools for remote control of observatory equipment

National Center for Supercomputing Applications Potential Features of Collaborative Environments (Cont’d.) Access to data and information –Library of data, documents, collaboration transcripts, web sites, educational materials, etc. on relevant topics –Electronic notebooks –Search capabilities for finding information or people Access to analytical tools and computational resources –Data fusion, data mining and analysis, modeling, visualization, etc. –Access to high performance computing resources –Tools linked through web services

National Center for Supercomputing Applications Researchers, Decision Makers, and Citizens Engaging in discovery, analysis, discussion, deliberation, decisions, and communication Collaboration Framework facilitates idea and knowledge sharing, synthesis, and learning Analysis Framework facilitates knowledge discovery, exploration, and analysis via the collaboration framework Data Management Framework creates a digital library of information resources (data, documents, models, tools, etc.) and facilitates their use via the analysis and collaboration frameworks Physical Infrastructure NCSA Cybercollaboratory Vision

National Center for Supercomputing Applications Lessons Learned from Previous Collaboratories CI development efforts must involve: –Prototypes created –To solve real problems in collaboration with community researchers, then generalized –Using a structured user-centered design methodology, led by experts in this approach –Rigorous testing of prototypes prior to widespread adoption –Early adopters must be supported by IT developers with good communication skills –Systems must be scalable to many users & highly reliable –Careful scheduling, project management, & interpersonal skills to coordinate with other infrastructure development efforts (e.g., field sites) Source: Speakers at the Community Cyberinfrastructure Workshop at Supercomputing 2004, Pittsburgh, PA, 11/2004.

National Center for Supercomputing Applications Lessons Learned from Previous Collaboratories (Contd.) Success or failure hinges on social issues: –Resources to develop the collaboratory may shrink individual investigator funding, creating resentment among community members –Rewards are needed to encourage participation (e.g., citation of contributed information, recognition of top contributors, peer review of contributions, research funding for contributors) –Collaboration readiness: Collaboratory implementers must be community-minded leaders Source: Speakers at the Community Cyberinfrastructure Workshop at Supercomputing 2004, Pittsburgh, PA, 11/2004.

National Center for Supercomputing Applications Recommendations from CI Discussions at Environmental Sensors Workshop in Seattle Environmental observatory communities should form a group, with joint sponsorship from professional organizations, to: –Sponsor meetings, annual conference, an e- journal, and an online clearinghouse –Discuss CI needs and issues, share lessons learned, and set common policies –Include members of other communities who have substantial experience with CI, as well as collaboratory development in general

National Center for Supercomputing Applications Recommendations from CI Discussions at Environmental Sensors Workshop in Seattle Environmental observatory communities should form a group to: –Create policies for access to data and other resources –When data will be accessible and to whom –How and when control of observatories will be given to other groups for experiments –Create layers of abstraction, potentially leading to standards, for different levels of data and knowledge. E.g., –Common sensor output specifications –Consistent vocabulary for metadata –Common network specifications –Common approaches to data storage, data distribution, data QA/QC, data archiving, model archiving, and model metadata –Interoperability of analytical or collaboration tools

National Center for Supercomputing Applications Recommendations from CI Discussions at Environmental Sensors Workshop in Seattle Environmental observatory communities should form a group to: –Organize training workshops or courses to –Initiate cultural changes needed within these communities to adapt to the new paradigm of sharing data, models, and other knowledge –Extend collaboratory foundations globally to address global processes (e.g., climate change)