Multiplicative Cascade Modeling of Computer Network Traffic Patricia H. Carter B10, NSWCCDD Interface 2002 April 19,2002.

Slides:



Advertisements
Similar presentations
The Normal Distribution
Advertisements

Computational Statistics. Basic ideas  Predict values that are hard to measure irl, by using co-variables (other properties from the same measurement.
E(X 2 ) = Var (X) = E(X 2 ) – [E(X)] 2 E(X) = The Mean and Variance of a Continuous Random Variable In order to calculate the mean or expected value of.
Inference for Linear Regression (C27 BVD). * If we believe two variables may have a linear relationship, we may find a linear regression line to model.
The General Linear Model. The Simple Linear Model Linear Regression.
Probability theory 2010 Order statistics  Distribution of order variables (and extremes)  Joint distribution of order variables (and extremes)
Random-Variate Generation. Need for Random-Variates We, usually, model uncertainty and unpredictability with statistical distributions Thereby, in order.
Continuous Random Variables and Probability Distributions
Modeling and Estimation of Dependent Subspaces J. A. Palmer 1, K. Kreutz-Delgado 2, B. D. Rao 2, Scott Makeig 1 1 Swartz Center for Computational Neuroscience.
Continuous Random Variables Chap. 12. COMP 5340/6340 Continuous Random Variables2 Preamble Continuous probability distribution are not related to specific.
Chapter 6 The Normal Distribution and Other Continuous Distributions
Copyright (c) 2004 Brooks/Cole, a division of Thomson Learning, Inc. Chapter 4 Continuous Random Variables and Probability Distributions.
Lecture II-2: Probability Review
Business Statistics: A First Course, 5e © 2009 Prentice-Hall, Inc. Chap 6-1 Chapter 6 The Normal Distribution Business Statistics: A First Course 5 th.
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
Data Selection In Ad-Hoc Wireless Sensor Networks Olawoye Oyeyele 11/24/2003.
1 Ch5. Probability Densities Dr. Deshi Ye
Chap 6-1 Copyright ©2013 Pearson Education, Inc. publishing as Prentice Hall Chapter 6 The Normal Distribution Business Statistics: A First Course 6 th.
Random variables Petter Mostad Repetition Sample space, set theory, events, probability Conditional probability, Bayes theorem, independence,
HAWKES LEARNING SYSTEMS math courseware specialists Copyright © 2010 by Hawkes Learning Systems/Quant Systems, Inc. All rights reserved. Chapter 8 Continuous.
Topic 4 - Continuous distributions
Probability theory 2 Tron Anders Moger September 13th 2006.
Chapter 3 Basic Concepts in Statistics and Probability
Continuous Probability Distributions  Continuous Random Variable  A random variable whose space (set of possible values) is an entire interval of numbers.
Traffic Modeling.
Statistical Decision Making. Almost all problems in statistics can be formulated as a problem of making a decision. That is given some data observed from.
Lecture 15: Statistics and Their Distributions, Central Limit Theorem
Ch5. Probability Densities II Dr. Deshi Ye
McGraw-Hill/Irwin Copyright © 2010 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 6 Continuous Random Variables.
IT College Introduction to Computer Statistical Packages Eng. Heba Hamad 2009.
1 Lecture 13: Other Distributions: Weibull, Lognormal, Beta; Probability Plots Devore, Ch. 4.5 – 4.6.
Chapter 5.6 From DeGroot & Schervish. Uniform Distribution.
Regression Analysis Week 8 DIAGNOSTIC AND REMEDIAL MEASURES Residuals The main purpose examining residuals Diagnostic for Residuals Test involving residuals.
1 Chapter 10: Introduction to Inference. 2 Inference Inference is the statistical process by which we use information collected from a sample to infer.
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
ELEC 303 – Random Signals Lecture 18 – Classical Statistical Inference, Dr. Farinaz Koushanfar ECE Dept., Rice University Nov 4, 2010.
Lecture 4: Statistics Review II Date: 9/5/02  Hypothesis tests: power  Estimation: likelihood, moment estimation, least square  Statistical properties.
Chapter 12 Continuous Random Variables and their Probability Distributions.
Basic Business Statistics
1 Chapter 2: The Normal Distribution 2.1Density Curves and the Normal Distributions 2.2Standard Normal Calculations.
© 2010 Pearson Prentice Hall. All rights reserved 7-1.
Copyright © 2013, 2010 and 2007 Pearson Education, Inc. Chapter The Normal Probability Distribution 7.
Statistical Data Analysis 2011/2012 M. de Gunst Lecture 2.
Risk Analysis Workshop April 14, 2004 HT, LRD and MF in teletraffic1 Heavy tails, long memory and multifractals in teletraffic modelling István Maricza.
Chapter 7 The Normal Probability Distribution 7.1 Properties of the Normal Distribution.
Statistics for Managers Using Microsoft Excel, 5e © 2008 Pearson Prentice-Hall, Inc.Chap 6-1 Statistics for Managers Using Microsoft® Excel 5th Edition.
Basic Business Statistics, 10e © 2006 Prentice-Hall, Inc.. Chap 6-1 Chapter 6 The Normal Distribution and Other Continuous Distributions Basic Business.
Chapter 3: Uncertainty "variation arises in data generated by a model" "how to transform knowledge of this variation into statements about the uncertainty.
Statistics and probability Dr. Khaled Ismael Almghari Phone No:
Chapter 15: Exploratory data analysis: graphical summaries CIS 3033.
4.3 Probability Distributions of Continuous Random Variables: For any continuous r. v. X, there exists a function f(x), called the density function of.
Modeling and Simulation CS 313
Statistics in Applied Science and Technology
4-1 Continuous Random Variables 4-2 Probability Distributions and Probability Density Functions Figure 4-1 Density function of a loading on a long,
Continuous Probability Distributions
Chapter 6 Continuous Probability Distribution
Engineering Probability and Statistics - SE-205 -Chap 4
Inference for Regression (Chapter 14) A.P. Stats Review Topic #3
Modeling and Simulation CS 313
4.3 Probability Distributions of Continuous Random Variables:
Chapter 7: Sampling Distributions
Statistical Methods For Engineers
The Empirical FT. What is the large sample distribution of the EFT?
4.3 Probability Distributions of Continuous Random Variables:
Quantitative Methods PSY302 Quiz Normal Curve Review February 6, 2017
Ch11 Curve Fitting II.
Statistics for Managers Using Microsoft® Excel 5th Edition
Chapter 5 Continuous Random Variables and Probability Distributions
The Normal Distribution
Presentation transcript:

Multiplicative Cascade Modeling of Computer Network Traffic Patricia H. Carter B10, NSWCCDD Interface 2002 April 19,2002

outline network traffic data the multiplicative cascade visualizing the cascade measuring burstiness the structure function the multifractal spectrum conclusions

Wide Area Network traffic collection at enclave boundary Internet data collector Firewall Enclave traffic

Packet Rate Process TCP packets entering/leaving protected network raw data is arrival times packet rate process is # of packets/unit time

Three Resolutions of Packet Rate Data

Packet Rate Process “approximately” Log Normal – hour 12

Multiplicative Cascade: synthesis m p1-p pm (1-p)m P is a random variable from a distribution supported on [0,1] with mean ½ and variance v – conservative cascade

Multiplicative Cascade: analysis a+b 1-p=b/(a+b) a b If (a+b)=0 then choose p uniformly from {0,1}. p=a/(a+b)

Random Multiplicative Cascade 1 If the distributions are all the same, one example, chosen from the beta distribution whose density is p1-p p p 0 p (1-p 0 ) p 1 (1-p) (1-p 1 ) (1-p) p p 0,p 1 p 00,p 01,p 10,p 11 W0W0 W1W1 W2W2 distributions

Synthetic data – three realizations Random Multiplicative Cascade

the vector P of multipliers smallest scale p’s in time order Suppose packet rate process R has 2 L samples next smallest scale p’s Finally So the P and R are a “transform pair”.

Multipliers calculated via inverse cascade procedure

Multipliers Plotted as a Function of Scale – hour 0

Multipliers Plotted as a Function of Scale – hour 12

Log Variances of Multipliers versus Log Scale - Hour 12

Time-Scale Visualization Histogram-equalized

Histograms of Multipliers at Each Scale – Hour 0

Histograms of Multipliers at Each Scale – Hour 12

The Structure Function This assumes the multiplier distributions are the same at every scale, but they aren’t.

Multiple Scale Structure Function Where are the multipliers calculated at level M.

Multiple Scale Structure Functions

Histograms of Variance- Normalized Multipliers

Multiple Scale Structure Functions From Variance-Normalized p’s

Multifractal Spectrum define “the Legendre transform”

Empirical Approximation to the Multifractal Spectrum - hour 12 F(alpha) v alpha

Multiplicative Cascade Spectrum Abs fbm

Multiple Scale Structure Functions – abs FBM

Empirical Approximation to the Multifractal Spectrum – abs fbm

Multiplicative Cascade Spectrum Abs fBm with smoothing

Multifractal Spectrum – Smoothed fBm

Empirical Approximation to the Multifractal Spectrum – Weibull

Observations/Conclusions I The packet rate and the multiplicative cascade are a transform pair. The multiplicative cascade is an appropriate model: packet rate is positive, so can be interpreted as a measure over many scales of resolution it is approximately log normal The multiplicative cascade is an useful model if it can be implemented in with a small number of parameters determined by the data of interest: if the log of the variance is linear in log scale then the variance is determined by two parameters at each scale the multipliers can be modeled via a one parameter family, e.g., the symmetric beta distribution - the one parameter is a function of the variance

Observations/Conclusions II The multiple scale structure function was useful; the multifractal spectrum was not so useful. The visualization of the multipliers in time and scale does not convey a lot – the time domain visualization conveys more information