R e D R e S S Case Study in e-Social Science Building Collaborative e-Research Environments JISC Consultation Workshops, 23/2/04 and 5/3/04 Rob Allan (CCLRC.

Slides:



Advertisements
Similar presentations
Supporting further and higher education Supporting Research JISC Committee for the Support of Research Alison Allden, JCSR.
Advertisements

The e-Framework Bill Olivier Director Development, Systems and Technology JISC.
The Economic and Social Data Service (ESDS) Kevin Schürer ESDS/UKDA ESDS Awareness Day 5 December 2003.
Open Grid Service Architecture - Data Access & Integration (OGSA-DAI) Dr Martin Westhead Principal Consultant, EPCC Telephone: Fax:+44.
Supporting Further and Higher Education Joint Information Systems Committee JISC Strategies & Support of e-Science for Research Dr Malcolm Read JISC Executive.
Current status of grids: the need for standards Mike Mineter TOE-NeSC, Edinburgh.
R e D R e S S Resource Discovery for Researchers in e-Social Science ReDReSS A Joint Application from Lancaster and Daresbury (7 social scientists, 6 computer/computational.
E-Science Update Steve Gough, ITS 19 Feb e-Science large scale science increasingly carried out through distributed global collaborations enabled.
INTERNATIONAL INSTITUTE FOR GEO-INFORMATION SCIENCE AND EARTH OBSERVATION Towards quality-aware Infrastructures for Geographic Information Services Richard.
2 July, Sakai VRE Portal Demonstrator Mark Baker School of Systems Engineering, University of Reading Tel:
E-Research Infrastructure Development and Community Engagement UK e-Science All Hands Meeting Nottingham, Alex Voss,
Supporting education and research E-learning tools, standards and systems Sarah Porter Head of Development, JISC.
R.J. Allan Portals and User Interfaces for Data Management and Grid Computing Rob Allan Leader of the Grid Technology Group 9 th.
Asa MacWilliams Lehrstuhl für Angewandte Softwaretechnik Institut für Informatik Technische Universität München Dec Software.
Technical Review Group (TRG)Agenda 27/04/06 TRG Remit Membership Operation ICT Strategy ICT Roadmap.
GEODE Workshop 16 th January 2007 Issues in e-Science Richard Sinnott University of Glasgow Ken Turner University of Stirling.
1 Software & Grid Middleware for Tier 2 Centers Rob Gardner Indiana University DOE/NSF Review of U.S. ATLAS and CMS Computing Projects Brookhaven National.
The e-Social Science Research Agenda Peter Halfpenny and Rob Procter School of Social Sciences - University of Manchester UK e-Science All Hands Meeting.
Modelling and Simulation for e-Social Science Mark Birkin School of Geography University of Leeds.
John Kewley e-Science Centre GIS and Grid Computing Workshop 13 th September 2005, Leeds Grid Middleware and GROWL John Kewley
Thee-Framework for Education & Research The e-Framework for Education & Research an Overview TEN Competence, Jan 2007 Bill Olivier,
Joint Information Systems Committee Supporting Higher and Further Education Development of an Information Environment for UK Learning and Teaching NOF-Digitise.
UK e-Science and the White Rose Grid Paul Townend Distributed Systems and Services Group Informatics Research Institute University of Leeds.
A Data Curation Application Using DDI: The DAMES Data Curation Tool for Organising Specialist Social Science Data Resources Simon Jones*, Guy Warner*,
The OMII Position At the University of Southampton.
15th January, NGS for e-Social Science Stephen Pickles Technical Director, NGS Workshop on Missing e-Infrastructure Manchester, 15 th January, 2007.
Web-based Portal for Discovery, Retrieval and Visualization of Earth Science Datasets in Grid Environment Zhenping (Jane) Liu.
TeraGrid Gateway User Concept – Supporting Users V. E. Lynch, M. L. Chen, J. W. Cobb, J. A. Kohl, S. D. Miller, S. S. Vazhkudai Oak Ridge National Laboratory.
GridPP Tuesday, 23 September 2003 Tim Phillips. 2 Bristol e-Science Vision National scene Bristol e-Science Centre Issues & Challenges.
E-Social Science What is e-Science? E-Science and e-Social Science E-Social Science and Longitudinal Data Examples of the Computational Problems we Currently.
Web-based Virtual Research Environments (VRE): Supporting Collaboration in e-Science Xiaobo Yang, Rob Allan CCLRC e-Science Centre Daresbury Laboratory,
User requirements for and concerns about a European e-Infrastructure Steven Newhouse, Director.
L C o E e S S. The Main e-Social Science Issues Applications: Many large-scale research questions in the social sciences may only be answered fully using.
DISTRIBUTED COMPUTING
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
Grid Execution Management for Legacy Code Applications Grid Enabling Legacy Code Applications Tamas Kiss Centre for Parallel.
Rob Allan Daresbury Laboratory NW-GRID Training Event 25 th January 2007 North West Grid Overview R.J. Allan CCLRC Daresbury Laboratory A world-class Grid.
E-Science: The view from the social sciences Jenny Fry and Ralph Schroeder Oxford Internet Institute Oxford e-Social Science Project.
Grids - the near future Mark Hayes NIEeS Summer School 2003.
Rob Allan Daresbury Laboratory A Web Portal for the National Grid Service Xiaobo Yang, Dharmesh Chohan, Xiao Dong Wang and Rob Allan CCLRC e-Science Centre,
NA-MIC National Alliance for Medical Image Computing UCSD: Engineering Core 2 Portal and Grid Infrastructure.
ICCS WSES BOF Discussion. Possible Topics Scientific workflows and Grid infrastructure Utilization of computing resources in scientific workflows; Virtual.
GEON2 and OpenEarth Framework (OEF) Bradley Wallet School of Geology and Geophysics, University of Oklahoma
GRID Overview Internet2 Member Meeting Spring 2003 Sandra Redman Information Technology and Systems Center and Information Technology Research Center National.
Ruth Pordes November 2004TeraGrid GIG Site Review1 TeraGrid and Open Science Grid Ruth Pordes, Fermilab representing the Open Science.
NeSC Workshop - February /14 Study of User Priorities for e-Infrastructure for e-Research (SUPER) Steven Newhouse Jennifer Schopf Andrew Richards.
Enabling e-Research in Combustion Research Community T.V Pham 1, P.M. Dew 1, L.M.S. Lau 1 and M.J. Pilling 2 1 School of Computing 2 School of Chemistry.
Development of e-Science Application Portal on GAP WeiLong Ueng Academia Sinica Grid Computing
2005 GRIDS Community Workshop1 Learning From Cyberinfrastructure Initiatives Grid Research Integration Development & Support
John Kewley e-Science Centre All Hands Meeting st September, Nottingham GROWL: A Lightweight Grid Services Toolkit and Applications John Kewley.
AHM04: Sep 2004 Nottingham CCLRC e-Science Centre eMinerals: Environment from the Molecular Level Managing simulation data Lisa Blanshard e- Science Data.
1 e-Arts and Humanities Scoping an e-Science Agenda Sheila Anderson Arts and Humanities Data Service Arts and Humanities e-Science Support Centre King’s.
1 Porting applications to the NGS, using the P-GRADE portal and GEMLCA Peter Kacsuk MTA SZTAKI Hungarian Academy of Sciences Centre for.
R e D R e S S Portals, Desktop Applications and Distributed Services for e-Research - Updated vision - Rob Crouchley and Rob Allan With thanks to Chuck.
Welcome Grids and Applied Language Theory Dave Berry Research Manager 16 th October 2003.
UKOLN is supported by: Library futures in the new research landscape. Dr Liz Lyon, UKOLN, University of Bath, UK CURL Members Meeting October 2004, London.
Collaborative Tools for the Grid V.N Alexandrov S. Mehmood Hasan.
RC ICT Conference 17 May 2004 Research Councils ICT Conference The UK e-Science Programme David Wallace, Chair, e-Science Steering Committee.
Development and evaluation of a Behavioural Intervention Grid: LifeGuide The LifeGuide team Social scientists: Lucy Yardley, Susan Michie, Judith Joseph,
Joint Information Systems Committee Repositories Support Project Summer School 2008 Amber Thomas, JISC.
ACGT Architecture and Grid Infrastructure Juliusz Pukacki ‏ EGEE Conference Budapest, 4 October 2007.
OGSA-DAI.
Grid Services for Digital Archive Tao-Sheng Chen Academia Sinica Computing Centre
Chapter 1- Introduction
Grid Computing.
What contribution can automated reasoning make to e-Science?
Grid Portal Services IeSE (the Integrated e-Science Environment)
Introduction to Cloud Computing
Status of Grids for HEP and HENP
Presentation transcript:

R e D R e S S Case Study in e-Social Science Building Collaborative e-Research Environments JISC Consultation Workshops, 23/2/04 and 5/3/04 Rob Allan (CCLRC Daresbury Laboratory) Rob Crouchley (University of Lancaster)

R e D R e S S Specific Social Scientists Problems 1.They have much less experience and expertise in the use of the Grid than those typically from other research council areas; 2.There is a significant intellectual gap between such disciplines and computer science; 3.Distributed systems are also inherently complex and associated middleware products are not easy to use; 4.The Open Middleware Infrastructure Institute (OMII) is likely to provide generic (open-source) middleware and associated services. E-Science middleware currently not specifically targeted for the social science community.

R e D R e S S Social Scientists Need 1.Help to develop a more computer-literate collaborative culture; 2.Help to develop component-based software, visual composition tools and scripting languages which are easy to use; 3.To exploit state-of-the-art software development technologies such as aspect-oriented programming to enhance flexibility. Middleware could be the catalyst for re-use and sharing in the e-Social Sciences. Some examples and ideas follow.

R e D R e S S Some Features of Social Science Research Research motivated by a desire to determine causality Involves 1.identifying the various factors which influence the behaviour or outcome of interest and quantifying their effects; 2.controlling for all the different confounding factors which would otherwise result in spurious relationships and misleading results. Randomised experiments not feasible, we cannot randomly allocate individuals to different levels of training in order to evaluate programs. We rely on observational data, i.e. data that have been obtained from surveys and censuses. This is different to “exact sciences” like physics and chemistry where repeatable experiments can be performed.

R e D R e S S 3 related Aspects of Soc. Sci. Research

R e D R e S S Soc. Sci. needs Comprehensive Models Interdependent sub models, we need joint models for the data complexities and the core processes we want to understand Models are not linear in the parameters, require special procedures and are highly computationally intensive due to the high dimensionality and the interdependent sub models. Simple analyses are usually very misleading about the role of the controls, eth, sex etc. Soc. Sci. research is complex - large parameter space, many interpretations and models which need to be tested. Cannot be done in isolation… Increasing need to link components and access large computers/ data sets from desktop.

R e D R e S S Data Management A Data Management B Data Management C Analysis AAnalysis BAnalysis C Middleware E-Science Technology can link Components!

R e D R e S S New Tools: The Analysis Cycle Main ESDS Data Sets Select Data Set and Appropriate Variables: TTWA Data, NOMIS Merge Files: Add Variables Working Data Contextual Data Results

R e D R e S S New Tools: Simultaneous Analysis Example: research in educational attainment

R e D R e S S E-Science can enhance Collaboration! Particularly important in qualitative research; Enable comparison of different markup/ interpretation; Direct access to datasets for validation; Direct input of data from fieldwork involving questionnaires, photography etc. Delivery/ input devices (some mobile) may include: portals, Access Grid, PC tablets, PDA, camera, phone etc.

R e D R e S S Video Corpus Researcher A Researcher B Researcher C VIDGRID: Multiple video streams can be delivered into an AG or portlet environment New Tools : Collaboration in Video Markup

R e D R e S S Training and Awareness in e-Social Science! Project ReDReSS: Resource Discovery for Researchers in e- Social Science “ to accelerate the development and awareness of a new kind of computing and data infrastructure for the Social Sciences, and to support the increasingly national and global collaborations emerging in many areas of Social Science” –To help illustrate appropriate methodologies and software that admits the full complexity of substantive problems; –To help articulate the middleware needs of social researchers; –To help nurture and support a community of social researchers; –To help to provide critical mass and improve the efficiency of interactions between the interested researchers, thus reducing the number of lost opportunities for social science.

R e D R e S S

We will use/ contribute to existing technologies Resource discovery Sharing tools Personalised workspaces Flexibly delivery

R e D R e S S Samples showing use of CHEF framework for ReDReSS and delivery of lecture material by video

R e D R e S S E-Science enabling a Virtual Research Environment! “to make the use of e-Science technologies, methodologies and resources easier and more transparent than simply developing bespoke applications on an infrastructure toolkit (such as Globus GT2 or OGSI/ WSRF). ” We need to: Bridge the gap between different types of technology (database management, computational methods, data collection, networks, Condor resources, visualization systems, collaborative working, Access Grid, etc.); Build on pilot projects and take input from other disciplines Link to core JCSR clusters and resources at other e- Science Centres; Provide an environment to enhance the programmability and usability of such a Grid by integrating work from a number of ongoing projects and encourage community input.

R e D R e S S The Grid “Client Problem” Grid Core Consumer clients: PC, TV, video, AG Workplace: desktop clients Portable clients: phones, laptop, pda, data collection Middleware e.g. Globus Grid Core Many clients want to access a few Grid- enabled resources

R e D R e S S Some VRE Functions Authentication, Authorisation and Accounting – use Shibboleth and Permis in line with JISC proposals; Community development of content - Content Management and Editing tools: –Access to middleware resources and documentation, –Access to training materials and resources, –Enable shared development of services/ applications, –Access to a consultancy/ support service, Application Management Services - user access via pre- defined tools and applications to the UK e-Science Grid; Data Management Services – discovery, authorisation, transfer, replication, upload, validation, curation; Access to Broadcasts - on the Access Grid network; Management Functions - for experts to maintain the system and guide non-experts, e.g. via expert systems and workflow.

R e D R e S S Functionality/Content of the VRE

R e D R e S S Sanity Check However a number of areas significant for a production Grid environment have hardly yet been tackled. Issues include: Grid information systems, service registration, discovery and definition of facilities; Security, in particular role-based authorisation; Portable parallel job specifications; Meta-scheduling, resource reservation and ‘on demand’ access; Dynamic linking and interacting with remote data sources; Wide-area computational/ exprtimental steering; Workflow composition and optimisation for complex procedures; Distributed user and application management; Data management and replication services; Grid programming environments, PSEs and user interfaces; Auditing, advertising and billing in a Grid-based resource market; Semantic and autonomic tools; Usability issues, ethics, etc…

R e D R e S S Human Factors Customised delivery may be key to long-term uptake: Use an environment familiar to the researchers, e.g.: –Web portals - training, awareness, search tools (search engines are popular) –Libraries - e.g. C for programmers –Programming environment – e.g. R for statistical analysis with well-known packages –Sound, video for virtual collaboration (TV is a popular medium) Bottom line: There is a lot we can/ need to do, but Social Science is already hard – the scientists need tools that do not make it harder!

R e D R e S S UK E-Social Science Programme There is currently a growing body of work and projects in this area: Pilot projects - ESRC ReDRESS: Resource Discovery for Researchers in e-Social Science – JISC UK National Grid Service + e-Science Grid - JCSR and DTI Core Programme NCeSS: National Centre for e-Social Science - ESRC CQeSSS: Centre for Quantitative e-Social Science Support - ESRC (+ future NCeSS nodes) …