Verifying Self-adaptive Applications Suffering Uncertainty

Slides:



Advertisements
Similar presentations
16.4 Estimating the Cost of Operations Project GuidePrepared By Dr. T. Y. LinVinayan Verenkar Computer Science Dept San Jose State University.
Advertisements

CS4432: Database Systems II
Ymer: A Statistical Model Checker Håkan L. S. Younes Carnegie Mellon University.
Geometric Algorithms for Conformational Analysis of Long Protein Loops J. Cortess, T. Simeon, M. Remaud- Simeon, V. Tran.
Chapter 8 Estimating Single Population Parameters
Elementary hypothesis testing
Point estimation, interval estimation
Elementary hypothesis testing Purpose of hypothesis testing Type of hypotheses Type of errors Critical regions Significant levels Hypothesis vs intervals.
1 Simulation Modeling and Analysis Verification and Validation.
1 Validation and Verification of Simulation Models.
Lecture 10 Comparison and Evaluation of Alternative System Designs.
WELCOME TO THE WORLD OF FUZZY SYSTEMS. DEFINITION Fuzzy logic is a superset of conventional (Boolean) logic that has been extended to handle the concept.
©2003/04 Alessandro Bogliolo Background Information theory Probability theory Algorithms.
Constraints-based Motion Planning for an Automatic, Flexible Laser Scanning Robotized Platform Th. Borangiu, A. Dogar, A. Dumitrache University Politehnica.
Geo479/579: Geostatistics Ch12. Ordinary Kriging (1)
MS 305 Recitation 11 Output Analysis I
1 Automatic Refinement and Vacuity Detection for Symbolic Trajectory Evaluation Orna Grumberg Technion Haifa, Israel Joint work with Rachel Tzoref.
Maximum Likelihood Estimator of Proportion Let {s 1,s 2,…,s n } be a set of independent outcomes from a Bernoulli experiment with unknown probability.
Sullivan – Fundamentals of Statistics – 2 nd Edition – Chapter 3 Section 2 – Slide 1 of 27 Chapter 3 Section 2 Measures of Dispersion.
1 Chapter 7 Sampling Distributions. 2 Chapter Outline  Selecting A Sample  Point Estimation  Introduction to Sampling Distributions  Sampling Distribution.
Chapter 5 Parameter estimation. What is sample inference? Distinguish between managerial & financial accounting. Understand how managers can use accounting.
A Passive Approach to Sensor Network Localization Rahul Biswas and Sebastian Thrun International Conference on Intelligent Robots and Systems 2004 Presented.
1 Utilizing Shared Vehicle Trajectories for Data Forwarding in Vehicular Networks IEEE INFOCOM MINI-CONFERENCE Fulong Xu, Shuo Gu, Jaehoon Jeong, Yu Gu,
Introduction to Real Analysis Dr. Weihu Hong Clayton State University 8/19/2008.
P. 403 – 404 #71 – 73, 75 – 78, 80, 82, 84 #72B: Binary? Yes – Success is a person is left-handed. I: Independent? Yes, since students are selected randomly,
Xiao Liu 1, Yun Yang 1, Jinjun Chen 1, Qing Wang 2, and Mingshu Li 2 1 Centre for Complex Software Systems and Services Swinburne University of Technology.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 8-1 Statistics for Managers Using Microsoft® Excel 5th Edition.
Quality Assurance in the Presence of Variability Kim Lauenroth, Andreas Metzger, Klaus Pohl Institute for Computer Science and Business Information Systems.
1.4 Properties of Real Numbers ( )
Chance Constrained Robust Energy Efficiency in Cognitive Radio Networks with Channel Uncertainty Yongjun Xu and Xiaohui Zhao College of Communication Engineering,
Application of the GA-PSO with the Fuzzy controller to the robot soccer Department of Electrical Engineering, Southern Taiwan University, Tainan, R.O.C.
 Simulation enables the study of complex system.  Simulation is a good approach when analytic study of a system is not possible or very complex.  Informational,
Computer Performance Modeling Dirk Grunwald Prelude to Jain, Chapter 12 Laws of Large Numbers and The normal distribution.
Chapter 8 Estimation ©. Estimator and Estimate estimator estimate An estimator of a population parameter is a random variable that depends on the sample.
Xiao Liu, Jinjun Chen, Yun Yang CS3: Centre for Complex Software Systems and Services Swinburne University of Technology, Melbourne, Australia {xliu, jchen,
SENG521 (Fall SENG 521 Software Reliability & Testing Preparing for Test (Part 6a) Department of Electrical & Computer Engineering,
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Confidence intervals for µ
Virtual University of Pakistan
Random Testing: Theoretical Results and Practical Implications IEEE TRANSACTIONS ON SOFTWARE ENGINEERING 2012 Andrea Arcuri, Member, IEEE, Muhammad.
Comparing Three or More Means
CHAPTER 9 Testing a Claim
Sec. 5-4: Multiplication Rule & Conditional P(x)
Analyzing Redistribution Matrix with Wavelet
Arithmetic Constraints and Automata
Spatial Online Sampling and Aggregation
Propositional Calculus: Boolean Algebra and Simplification
A Modified Naïve Possibilistic Classifier for Numerical Data
Confidence Interval Estimation
Statistical Model-Checking of “Black-Box” Probabilistic Systems VESTA
Probabilistic Map Based Localization
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 7 Functions of Several Variables
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
MATH 175: Numerical Analysis II
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Chapter 8: Estimating with Confidence
Reducing Forks in the Blockchain via Probabilistic Verification
Chapter 8: Estimating with Confidence
Objectives 6.1 Estimating with confidence Statistical confidence
Simulation Berlin Chen
Chapter 7 Estimation: Single Population
Presentation transcript:

Verifying Self-adaptive Applications Suffering Uncertainty Wenhua Yang, Chang Xu , Yepang Liu , Chun Cao, Xiaoxing Ma, Jian Lu presented by Hongyi Ling 27. May. 2017

Outline Background Interactive state machine Verifying self-adaptive applications Overview Modeling environmental constraints Dealing with uncertainty Prioritizing counterexamples Experiments Conclusion

Background Self-adaptive applications: applications continually sense their environments and make adaptation according to their predefined logics.

Background Existing works verifying self –adaptive applications under real-world environments has two major limitations: Lack of modeling environmental constraints The constraints related each environmental sensing to its previous sensing and adaptations Lack of modeling uncertainty (environmental sensing and flawed physical actions) The last distance should be equal to the summation of the new sensed distance and how far the car has walked since its last sensing.

Interactive state machine

Interactive state machine

Interactive state machine When a state s is set as M’s current state, rules having this state as source state are enabled, while other rules are disabled. When an enabled rule r’s condition r.condition is satisfied, the rule is triggered for execution. If multiple rules are triggered, only one of them is selected to execute.

Interactive state machine An ISM execution can be conceptually modeled by a path which is a sequence of states and rules: path condition of execution :

Verifying self-adaptive applications Overview Modeling environmental constraints Dealing with uncertainty Prioritizing counterexamples

Overview of verification

Modeling environmental constraints

Modeling environmental constraints

Modeling environmental constraints After concatenating the environmental constraints to the path condition, we get a new formula of constraints for the path , which is called the ideal condition.

Dealing with uncertainty Given an ISM, to model uncertainty, we first need to identify the variables in an ideal condition that would be affected by uncertainty. Then for each of these variables, we give an error range and a distribution for its potential value, i.e., for a variable v affected by uncertainty, let [a , b] (a < b) be the error range of v. Then the lower bound and upper bound of variable v are v+a and v+b respectively. Meanwhile, we set a distribution p of the variable’s value between its lower and upper bounds. In an ideal condition, for all its variables, there is no uncertainty considered. Therefore, for each variable v, which is affected by uncertainty in the ideal condition, since v does not include uncertainty, we use a new variable v′ to represent v with uncertainty. v′ satisfies the constraint v+a < v′ < v+b, where [a,b] is the error range of v. Then we replace v with v′ in the ideal condition, and join the constraint v+a < v′ < v+b with the ideal condition. This form a new condition named the actual condition.

Prioritizing counterexamples

Prioritizing counterexamples Estimate the probability of satisfaction of r.condition Use an approximated solution by treating each variable independently

Experiments

Experiments for RQ1 conducted two experiments: environmental constraints and uncertainty The first experiment applied both our approach and the naive approach to the 12 robot-car applications, and checked the reported counterexamples to see how many of them are false counterexamples. The second experiment applied both our approach and the ideal approach to the 12 robot-car applications, and recorded their reported counterexamples

Experiments for RQ1

Experiments for RQ1

we let the concerned application to run in the environment constructed from this counter-example in field study for 100 times, and also in simulation for 1,000 times

Conclusion

Thanks !