Introduction of CS3 and Research in Workflow Technology Program Xiao Liu CS3, Swinburne University of Technology Melbourne, Australia.

Slides:



Advertisements
Similar presentations
Information Society Technologies programme 1 IST Programme - 8th Call Area IV.2 : Computing Communications and Networks Area.
Advertisements

A Workflow Engine with Multi-Level Parallelism Supports Qifeng Huang and Yan Huang School of Computer Science Cardiff University
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 12 Slide 1 Distributed Systems Design 2.
Virtual Machine Usage in Cloud Computing for Amazon EE126: Computer Engineering Connor Cunningham Tufts University 12/1/14 “Virtual Machine Usage in Cloud.
Data Management in Cloud Workflow Systems Dong Yuan Faculty of Information and Communication Technology Swinburne University of Technology.
A Cost-Effective Strategy for Intermediate Data Storage in Scientific Cloud Workflow Systems Dong Yuan, Yun Yang, Xiao Liu, Jinjun Chen Swinburne University.
MS DB Proposal Scott Canaan B. Thomas Golisano College of Computing & Information Sciences.
CoLaB 22nd December 2005 Secure Access to Service-based Collaborative Workflow for DAME Duncan Russell Informatics Institute University of Leeds, UK.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 12 Slide 1 Distributed Systems Architectures.
PAWN: A Novel Ingestion Workflow Technology for Digital Preservation Mike Smorul, Joseph JaJa, Yang Wang, and Fritz McCall.
How Context-aware Technologies Influence Business Process Management
Community Manager A Dynamic Collaboration Solution on Heterogeneous Environment Hyeonsook Kim  2006 CUS. All rights reserved.
Cloud Computing Architecture Adam Balla Wa Chiu Siu.
 Separating system’s concerns from programmer’s concerns  Language constructs for programming distributed systems  Transparency to various system dependent.
X. Liu, J. Chen, Z. Wu, Z. Ni, D. Yuan, Y. Yang, CCGrid10, , Melbourne, Australia Handling Recoverable Temporal Violations in Scientific Workflow.
Dr. Xiao Liu Sessional Lecturer, Research Fellow Centre of SUCCESS Swinburne University of Technology Melbourne, Australia Overview: Cloud Computing and.
Fine Grain MPI Earl J. Dodd Humaira Kamal, Alan University of British Columbia 1.
June Amsterdam A Workflow Bus for e-Science Applications Dr Zhiming Zhao Faculty of Science, University of Amsterdam VL-e SP 2.5.
©Ian Sommerville 2004Software Engineering, 7th edition. Chapter 18 Slide 1 Software Reuse.
©Ian Sommerville 2006Software Engineering, 8th edition. Chapter 12 Slide 1 Distributed Systems Architectures.
INFSO-SSA International Collaboration to Extend and Advance Grid Education ICEAGE Forum Meeting at EGEE Conference, Geneva Malcolm Atkinson & David.
revised CmpE 583 Fall 2006Discussion: OWL- 1 CmpE 583- Web Semantics: Theory and Practice DISCUSSION: OWL Atilla ELÇİ Computer Engineering.
GESIS Dr. Maximilian Stempfhuber Head of Research and Development Social Science Information Centre, Bonn, Germany How to deal with heterogeneity when.
DISTRIBUTED COMPUTING
Appraisal and Data Mining of Large Size Complex Documents Rob Kooper, William McFadden and Peter Bajcsy National Center for Supercomputing Applications.
An Autonomic Framework in Cloud Environment Jiedan Zhu Advisor: Prof. Gagan Agrawal.
Young Suk Moon Chair: Dr. Hans-Peter Bischof Reader: Dr. Gregor von Laszewski Observer: Dr. Minseok Kwon 1.
Evaluation of a Publish/Subscribe System for Collaboration and Mobile Working Collaborative Advertising over Internet with Agents Independent Study: Wireless.
Xiao Liu CITR - Centre for Information Technology Research Swinburne University of Technology, Australia Temporal Verification in Grid/
Xiao Liu CS3 -- Centre for Complex Software Systems and Services Swinburne University of Technology, Australia Key Research Issues in.
1 Making Sense of Models Research and teaching experience Yan Liu Presentation over skype September 19, 2008.
DOMENICO TALIA (joint work with M. Cannataro, A. Congiusta, P. Trunfio) DEIS University of Calabria ITALY Grid-Based Data Mining and.
My Research and e-Business Virendrakumar C. Bhavsar Professor and Director, Advanced Computational Research Laboratory Faculty of Computer Science University.
Xiao Liu, Jinjun Chen, Ke Liu, Yun Yang CS3: Centre for Complex Software Systems and Services Swinburne University of Technology, Melbourne, Australia.
The Grid System Design Liu Xiangrui Beijing Institute of Technology.
Middleware for FIs Apeego House 4B, Tardeo Rd. Mumbai Tel: Fax:
The Anatomy of the Grid Mahdi Hamzeh Fall 2005 Class Presentation for the Parallel Processing Course. All figures and data are copyrights of their respective.
Performance Evaluation of Image Conversion Module Based on MapReduce for Transcoding and Transmoding in SMCCSE Speaker : 吳靖緯 MA0G IEEE.
Service - Oriented Middleware for Distributed Data Mining on the Grid ,劉妘鑏 Antonio C., Domenico T., and Paolo T. Journal of Parallel and Distributed.
DAME: A Distributed Diagnostics Environment for Maintenance Duncan Russell University of Leeds.
 Apache Airavata Architecture Overview Shameera Rathnayaka Graduate Assistant Science Gateways Group Indiana University 07/27/2015.
SEEK Welcome Malcolm Atkinson Director 12 th May 2004.
George Goulas, Christos Gogos, Panayiotis Alefragis, Efthymios Housos Computer Systems Laboratory, Electrical & Computer Engineering Dept., University.
CSC480 Software Engineering Lecture 10 September 25, 2002.
Xiao Liu 1, Yun Yang 1, Jinjun Chen 1, Qing Wang 2, and Mingshu Li 2 1 Centre for Complex Software Systems and Services Swinburne University of Technology.
Time-Space Trust in Networks Shunan Ma, Jingsha He and Yuqiang Zhang 1 College of Computer Science and Technology 2 School of Software Engineering.
Web Log Data Analytics with Hadoop
Toward Efficient and Simplified Distributed Data Intensive Computing IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS, VOL. 22, NO. 6, JUNE 2011PPT.
X. Liu, Z. Ni, Z. Wu, D. Yuan, J. Chen, Y. Yang, ICPADS10, , Shanghai, China An Effective Framework for Handling Recoverable Temporal Violations.
IEEE CLOUD’2012 Topology-Aware Deployment of Scientific Applications in Cloud Computing Pei Fan 1, Zhenbang Chen 1, Ji Wang 1, Zibin Zheng 2, Michael R.
Toward a common data and command representation for quantum chemistry Malcolm Atkinson Director 5 th April 2004.
Text Information Management ChengXiang Zhai, Tao Tao, Xuehua Shen, Hui Fang, Azadeh Shakery, Jing Jiang.
Xiao Liu, Jinjun Chen, Yun Yang CS3: Centre for Complex Software Systems and Services Swinburne University of Technology, Melbourne, Australia {xliu, jchen,
Distributed Geospatial Information Processing (DGIP) Prof. Wenwen Li School of Geographical Sciences and Urban Planning 5644 Coor Hall
1 Ji Wang and Dongsheng Li National Lab for Parallel and Distributed Processing Introduction of iVCE ( Internet-based V irtual C omputing E nvironment.
National Aeronautics and Space Administration Jet Propulsion Laboratory March 17, 2009 Workflow Orchestration: Conducting Science Efficiently on the Grid.
Item 4 - Intrusion Detection and Prevention Yuh-Jye Lee Dept. of Computer Science and Information Engineering National Taiwan University of Science and.
Fedora Commons Overview and Background Sandy Payette, Executive Director UK Fedora Training London January 22-23, 2009.
INFSO-RI Enabling Grids for E-sciencE Grid & Cloud Computing Introduction
Jérémie Sublime Sonia Yassa Development of meta-heuristics for workflow scheduling based on quality of service requirements 1.
Distributed Systems Architectures Chapter 12. Objectives  To explain the advantages and disadvantages of different distributed systems architectures.
Distributed Systems Architectures. Topics covered l Client-server architectures l Distributed object architectures l Inter-organisational computing.
MINING DEEP KNOWLEDGE FROM SCIENTIFIC NETWORKS
Services Computing Taxonomy
Astronomical Data Processing & Workflow Scheduling in cloud
Amity University, Noida, India
Unistore: Project Updates
Proposal for Term Project Operating Systems, Fall 2018
Cloud Futures Panel Panel Chair: Geoffrey Fox, July 9, 2019
Presentation transcript:

Introduction of CS3 and Research in Workflow Technology Program Xiao Liu CS3, Swinburne University of Technology Melbourne, Australia

Outline >Introduction of CS3 –About Us –Research –Projects –Collaborations >Research in Workflow Technology Program –Program Overview –R&D Projects Overview –SwinDeW Workflow Series –Recent Publications >Questions and Discussions 2

Introduction of CS3 (Centre for Complex Software Systems and Services) >About Us: The Centre for Complex Software Systems and Services (CS3) is a Swinburne University research centre located in the Faculty of Information and Communication Technologies at Swinburne University of Technology in Melbourne, Australia. It is established as a Tier-1 university research centre in July 2008, but has its roots in the former Centre for Information Technology Research (CITR) established in December >CS3 is one of the leading research centres in Australia and has an international reputation in its research areas with internationally leading researchers. It carries out research in close collaboration with industry and research partners nationally and internationally, supported by a wide range of research grants, strategic partnerships and industrial R&D projects. 3

Research in CS3 >The Centre carries out research across the following research programs: –Component Software Technology – lead by Prof. Jun Han –Intelligent Agent Technology – lead by Director, Prof. R. Kowalczyk. –Web and Data Technology – lead by Prof. Chengfei Liu –Workflow Technology – lead by Prof. Yun Yang >targeting the following application areas: –Service Oriented Systems –Enterprise Software Systems –Social Software Systems –Cloud Computing Systems. 4

Research in CS3 5

6

Projects in CS3 >Research Project Highlights ( –Novel cloud computing based on workflow technology for managing large numbers of process instances –Managing Conflicts in Requirements Engineering with Argumentation Framework –Rationalised Software Architecture Design –Service Workflow for eScience and eBusiness –Agent-Enabled Social Networks –Reconfigurable Vehicle Software Systems –An Organisation Oriented Framework for Collaborative Business Processes –XML Views of Relational Databases, Constraints in XML Schema Integration 7

Research in Workflow Technology Program >Program Overview >R&D Projects Overview >SwinDeW Workflow Series >Recent Publications 8

Program Overview >The Program conducts research into workflow technologies for complex software systems and services including peer-to-peer, grid, and cloud computing based e-science, e-business, transactional and inter- organisational workflows. >Members: 9 Leader: Prof Yun Yang Visitors (7-8/09): Prof Lee Osterweil Prof. Lori Clarke Researchers: Dr Jinjun Chen Nauman Saeed (PhD) Qiang He (PhD - submitted ) Ke Liu (PhD - submitted ) Xiao Liu (PhD) Dong Yuan (PhD) Viv Farrell (PhD - submitted ) Mr Bryce Gibson (IBL) Others: Prof Ryszard Kowalczyk Prof Chengfei Liu Dr Jun Yan (Wollongong) Prof Hai Jin (HUST) Prof Mingshu Li (ISCAS) Prof Qing Wang (ISCAS) Prof Zhiwei Ni (HFUT) Prof Jinpeng Huai (BUAA)

R&D Projects Overview >Primary projects: – Novel cloud computing based on workflow technology for managing large numbers of process instances - ARC Linkage Project (LP) grant – SwinDeW workflow family - partly funded by ARC DP Architectures / Models Scheduling / Data and service management Verification / Exception handling SLA (Security / trust) 10

Research in Workflow Technology Program >Program Overview >R&D Projects Overview >SwinDeW Workflow Series >Recent Publications 11

SwinDeW Workflow Series SwinDeW – Swin burne De centralised W orkflow - foundation prototype based on p2p >SwinDeW – past >SwinDeW-A (for Agents) – ARC DP06 >SwinDeW-G (for Grid) – past >SwinDeW-V (for Verification) – current (pending ARC DP) >SwinDeW-E (for eScience) – current (pending ARC DP) >SwinDeW-C (for cloud) – current (ARC LP) >Others: SwinDeW-B / -S / -P / -G – past 12

SwinDeW-G 13

SwinDeW-C: Overview 14

SwinDeW-C: Simulation Environment SwinDeW-C is developed based on SwinDeW and SwinDeW-G. It is currently running at Swinburne University of Technology, which is composed of 10 servers and 10 high- end PCs. To simulate the cloud computing environment, we set up VMware software on the physical servers and create virtual clusters as data centres. Every data centre created is composed of 8 virtual computing nodes with storages, and we deploy an independent Hadoop file system on each data centre. SwinDeW-C runs on these virtual data centres that can send and retrieve data to and from each other. Through a user interface at the applications layer, which is a Web based portal, we can deploy workflows and upload application data. 15

Research Topics >Workflow Temporal Verification in Scientific Workflow Systems –Constraint Setting (BPM, CCPE), Checkpoint Selection (ICSE, TOSEM), Temporal Verification (TASE, CCPE), Exception Handling (ACOWR, JSS, TSE) >Data Management in Cloud Workflow Systems –Intermediate Data Storage Strategy, Data Replacement, Data Replication (IPDPS, CCPE, FGCS) >Security and Privacy in Cloud Workflow Systems

Research in Workflow Technology Program >Program Overview >R&D Projects Overview >SwinDeW Workflow Series >Recent Publications 17

Selected Recent Publications – Journal Papers > Please visit for a full list of all publications in WT Programhttp:// >D. Yuan, Y. Yang, X. Liu, G. Zhang and J. Chen, A Data Dependency Based Strategy for Intermediate Data Storage in Scientific Cloud Workflow Systems. Concurrency and Computation: Practice and Experience, Wiley, to appear (accepted on June 4, 2010). >D. Yuan, Y. Yang, X. Liu and J. Chen, A Data Placement Strategy in Cloud Scientific Workflows. Future Generation Computer Systems, Elsevier, to appear (accepted on Feb. 1, 2010). >X. Liu, Z. Ni, J. Chen and Y. Yang, A Probabilistic Strategy for Temporal Constraint Management in Scientific Workflow Systems. Concurrency and Computation: Practice and Experience, Wiley, to appear (accepted on Nov. 27, 2009). >J. Chen and Y. Yang, Temporal Dependency based Checkpoint Selection for Dynamic Verification of Temporal Constraints in Scientific Workflow Systems. ACM Transactions on Software Engineering and Methodology, to appear (accepted on June 17, 2009). >Q. He, J. Yan, R. Kowalczyk, H. Jin, Y. Yang, Lifetime Service Level Agreement Management with Autonomous Agents for Services Provision. Information Sciences, Elsevier, >K. Liu, J. Chen, Y. Yang and H. Jin, A Throughput Maximization Strategy for Scheduling Transaction Intensive Workflows on SwinDeW-G. Concurrency and Computation: Practice and Experience, Wiley, >J. Chen and Y. Yang, Adaptive Selection of Necessary and Sufficient Checkpoints for Dynamic Verification of Temporal Constraints in Grid Workflow Systems. ACM Transactions on Autonomous and Adaptive Systems, June

Selected Recent Publications – Conference Papers >X. Liu, J. Chen, Z. Wu, Z. Ni, D. Yuan, Y. Yang, Handling Recoverable Temporal Violations in Scientific Workflow Systems: A Workflow Rescheduling Based Strategy. Proc. of 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid2010), pages , Melbourne, Australia, May >D. Yuan, Y. Yang, X. Liu and J. Chen, A Cost-Effective Strategy for Intermediate Data Storage in Scientific Cloud Workflow Systems. Proc. of 24th IEEE International Parallel & Distributed Processing Symposium (IPDPS2010), Atlanta, USA, Apr >Q. He, J. Yan, H. Jin, Y. Yang, ServiceTrust: Supporting Reputation-Oriented Service Selection. Proc. 7th International Conference on Service Oriented Computing (ICSoC2009), Lecture Notes in Computer Science, Vol. 5900, pages , Stockholm, Sweden, Nov >X. Liu, Y. Yang, J. Chen, Q. Wang and M. Li, Achieving On-Time Delivery: A Two-Stage Probabilistic Scheduling Strategy for Software Projects, Proc. of International Conference on Software Process (ICSP09), Lecture Notes in Computer Science, Vancouver, Canada, May >X. Liu, J. Chen, K. Liu and Y. Yang, Forecasting Duration Intervals of Scientific Workflow Activities based on Time-Series Patterns, Proc. of 4th IEEE International Conference on e-Science (e-Science08), Indianapolis, USA, Dec >X. Liu, J. Chen and Y. Yang, A Probabilistic Strategy for Setting Temporal Constraints in Scientific Workflows, Proc. 6th International Conference on Business Process Management (BPM2008), Lecture Notes in Computer Science, Sept Milan, Italy. >J. Chen and Y. Yang, Temporal Dependency based Checkpoint Selection for Dynamic Verification of Fixed-time Constraints in Grid Workflow Systems, Proc. of 30th International Conference on Software Engineering (ICSE2008), Leipzig, Germany, May

Collaborated Results So Far > Journal (accepted/revising/submitted) –X. Liu, Z. Ni, J. Chen and Y. Yang, A Probabilistic Strategy for Temporal Constraint Management in Scientific Workflow Systems. Concurrency and Computation: Practice and Experience, Wiley, to appear (accepted on Nov. 27, 2009). SCI: –Z. Wu, X. Liu, Z. Ni, D. Yuan, Y. Yang, A Market-Oriented Hierarchical Scheduling Strategy in Cloud Workflow Systems, Journal of Supercomputing, submitted, decision around July SCI: 0.62 –X. Liu, Z. Ni, D. Yuan, Y. Jiang, J. Chen, Y. Yang, A Statistical Time-Series Pattern based Interval Forecasting Strategy for Activity Durations in Cloud Workflow Systems, Journal of Systems and Software, under revision. SCI:1.24 –X. LIU, Z. NI, Z. WU, D. YUAN, J. CHEN, Y. Yang, A Novel General Framework for Automatic and Cost-Effective Handling of Recoverable Temporal Violations in Scientific Workflow Systems, Journal of Systems and Software, submitted. SCI: 1.24 > Conference (accepted/submitted) –X. Liu, J. Chen, Z. Wu, Z. Ni, D. Yuan, Y. Yang, Handling Recoverable Temporal Violations in Scientific Workflow Systems: A Workflow Rescheduling Based Strategy. Proc. of 10th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid2010), pages , Melbourne, Australia, May –X. Liu, Z. Ni, Z. Wu, D. Yuan, J. Chen, Y. Yang, An Effective Framework of Light-Weight Handling for Three-Level Fine-Grained Recoverable Temporal Violations in Scientific Workflows, 16th IEEE International Conference on Parallel and Distributed Systems (ICPADS2010), Shanghai, China, Dec.7-11, 2010, submitted.

On Going Work >Comparison of Five Representative Metaheuristics based Workflow Scheduling Algorithms in Handling Scientific Workflow Temporal Violations: (aiming for one A* Journal) –GA, ACO, PSO, SA, GRAPS –Min-Min, MCT (Simple Heuristics) >Further improvement on ACO, PSO and other algorithms for workflow scheduling and rescheduling (aiming for 1 to 2 SCI Journals) >Cloud Computing based Stock Exchange System (aiming for 1 SCI Journals) –Instance intensive, Scalability, Security

Future Collaboration Topics – With Cloud Computing >Knowledge Cloud –Distributed Data Mining in Cloud Environment >Map Reduce for Machine Learning –Parallel and Distributed Computing for Implementing Machine Learning Algorithms for such as Clustering, Classification and Association Rule Mining (Google, Baidu) >Cloud Privacy –Privacy Preserving

CORE Ranking >Conference RankingConference Ranking –A+ 6% (ICSE) –A 27% (FSE, ASE, ICSP, eScience, BPM, ICPP, IPDPS) –B 31% >Journal RankingJournal Ranking –A* 5% (TSE, TOSEM, TPDS, JPDC) –A 15% (CCPE, FGCS) >For more information about call-for-papers, conference ranking and statistics, you may visit my webpage:

Questions and Discussions >Apply for PhD in Australia >PhD Study in Australia >Writing Academic Papers in English >Any other things you want to know? 24

Structure of a Paper >Title > Abstract >Key words > Introduction > Related Work > System Model & Problem Statement >Methods / Solutions >Simulations / Experiments >Conclusion >Acknowledgement > References 25

Tips: >Read the latest papers previously published in the conference or journals you want to submit: get to know the template, the style and etc. >Cite the papers previously published in the conference or journals: get to know the PC Chair ’ s and PC member ’ s recent work. >Structure is most important! >Related work is really important! Not only introduce them, but also point out their pros and cons. >Evaluation is really important! >Do not use unfamiliar words! See what other people used >Do not use complex sentences if not necessary! Short and simple is the best. 26

Some Photos 27

Some Useful Links >CS3: >Prof. Yun Yang: >Dr. Jinjun Chen : >CORE Ranking: >Workflow System: >Grid/Cloud Computing: 28

The End, Thanks! 29