20090608.ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 1 / 45 A General Neural Network Model for Estimating Telecommunications Network Reliability Instructor.

Slides:

Advertisements

Similar presentations

© Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems Introduction.

Advertisements

Artificial Intelligence 13. Multi-Layer ANNs Course V231 Department of Computing Imperial College © Simon Colton.

Fast Algorithms For Hierarchical Range Histogram Constructions

Introduction to Training and Learning in Neural Networks n CS/PY 399 Lab Presentation # 4 n February 1, 2001 n Mount Union College.

Artificial Spiking Neural Networks

Service Discrimination and Audit File Reduction for Effective Intrusion Detection by Fernando Godínez (ITESM) In collaboration with Dieter Hutter (DFKI)

Data Mining Techniques Outline

L i a b l eh kC o m p u t i n gL a b o r a t o r y Performance Yield-Driven Task Allocation and Scheduling for MPSoCs under Process Variation Presenter:

Data Mining CS 341, Spring 2007 Lecture 4: Data Mining Techniques (I)

Experimental Evaluation

On Fairness, Optimizing Replica Selection in Data Grids Husni Hamad E. AL-Mistarihi and Chan Huah Yong IEEE TRANSACTIONS ON PARALLEL AND DISTRIBUTED SYSTEMS,

Information Fusion Yu Cai. Research Article “Comparative Analysis of Some Neural Network Architectures for Data Fusion”, Authors: Juan Cires, PA Romo,

1 Neural plug-in motor coil thermal modeling Mo-Yuen Chow; Tipsuwan Y Industrial Electronics Society, IECON 26th Annual Conference of the IEEE, Volume:

1 Prediction of Software Reliability Using Neural Network and Fuzzy Logic Professor David Rine Seminar Notes.

Determining the Significance of Item Order In Randomized Problem Sets Zachary A. Pardos, Neil T. Heffernan Worcester Polytechnic Institute Department of.

1 SOUTHERN TAIWAN UNIVERSITY ELECTRICAL ENGINEERING DEPARTMENT Gain Scheduler Middleware: A Methodology to Enable Existing Controllers for Networked Control.

1 PSO-based Motion Fuzzy Controller Design for Mobile Robots Master : Juing-Shian Chiou Student : Yu-Chia Hu( 胡育嘉 ) PPT : 100% 製作 International Journal.

Attention Deficit Hyperactivity Disorder (ADHD) Student Classification Using Genetic Algorithm and Artificial Neural Network S. Yenaeng 1, S. Saelee 2.

Predicting Income from Census Data using Multiple Classifiers Presented By: Arghya Kusum Das Arnab Ganguly Manohar Karki Saikat Basu Subhajit Sidhanta.

Efficient Model Selection for Support Vector Machines

Particle Competition and Cooperation to Prevent Error Propagation from Mislabeled Data in Semi- Supervised Learning Fabricio Breve 1,2

Sensor Positioning in Wireless Ad-hoc Sensor Networks Using Multidimensional Scaling Xiang Ji and Hongyuan Zha Dept. of Computer Science and Engineering,

A Shaft Sensorless Control for PMSM Using Direct Neural Network Adaptive Observer Authors: Guo Qingding Luo Ruifu Wang Limei IEEE IECON 22 nd International.

Clustering in Mobile Ad hoc Networks. Why Clustering? –Cluster-based control structures provides more efficient use of resources for large dynamic networks.

Slides are based on Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems.

Data Mining Techniques in Stock Market Prediction

Outline What Neural Networks are and why they are desirable Historical background Applications Strengths neural networks and advantages Status N.N and.

NEURAL NETWORKS FOR DATA MINING

1 RECENT DEVELOPMENTS IN MULTILAYER PERCEPTRON NEURAL NETWORKS Walter H. Delashmit Lockheed Martin Missiles and Fire Control Dallas, TX 75265

Well Log Data Inversion Using Radial Basis Function Network Kou-Yuan Huang, Li-Sheng Weng Department of Computer Science National Chiao Tung University.

Ch 6-1 © 2004 Pearson Education, Inc. Pearson Prentice Hall, Pearson Education, Upper Saddle River, NJ Ostwald and McLaren / Cost Analysis and Estimating.

A comparison of the ability of artificial neural network and polynomial fitting was carried out in order to model the horizontal deformation field. It.

A.N.N.C.R.I.P.S The Artificial Neural Networks for Cancer Research in Prediction & Survival A CSI – VESIT PRESENTATION Presented By Karan Kamdar Amit.

Map-Reduce for Machine Learning on Multicore C. Chu, S.K. Kim, Y. Lin, Y.Y. Yu, G. Bradski, A.Y. Ng, K. Olukotun (NIPS 2006) Shimin Chen Big Data Reading.

Design a personalized e-learning system based on item response theory and artificial neural network approach Ahmad Baylari, Gh.A. Montazer IT Engineering.

Protein motif extraction with neuro-fuzzy optimization Bill C. H. Chang and Author : Bill C. H. Chang and Saman K. Halgamuge Saman K. Halgamuge Adviser.

CSE 5331/7331 F'07© Prentice Hall1 CSE 5331/7331 Fall 2007 Machine Learning Margaret H. Dunham Department of Computer Science and Engineering Southern.

Back-Propagation Algorithm AN INTRODUCTION TO LEARNING INTERNAL REPRESENTATIONS BY ERROR PROPAGATION Presented by: Kunal Parmar UHID:

An Artificial Neural Network Approach to Surface Waviness Prediction in Surface Finishing Process by Chi Ngo ECE/ME 539 Class Project.

PARALLELIZATION OF ARTIFICIAL NEURAL NETWORKS Joe Bradish CS5802 Fall 2015.

1 Lecture 6 Neural Network Training. 2 Neural Network Training Network training is basic to establishing the functional relationship between the inputs.

Reservoir Uncertainty Assessment Using Machine Learning Techniques Authors: Jincong He Department of Energy Resources Engineering AbstractIntroduction.

Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology O( ㏒ 2 M) Self-Organizing Map Algorithm Without Learning.

Bayesian networks and their application in circuit reliability estimation Erin Taylor.

Face Image-Based Gender Recognition Using Complex-Valued Neural Network Instructor :Dr. Dong-Chul Kim Indrani Gorripati.

פרקים נבחרים בפיסיקת החלקיקים אבנר סופר אביב

1 1 Slide Simulation Professor Ahmadi. 2 2 Slide Simulation Chapter Outline n Computer Simulation n Simulation Modeling n Random Variables and Pseudo-Random.

Alice E. Smith and Mehmet Gulsen Department of Industrial Engineering

1 Planning Base Station and Relay Station Locations in IEEE j Multi-hop Relay Networks Yang Yu, Seán Murphy, Liam Murphy Department of Computer Science.

Optimal Reverse Prediction: Linli Xu, Martha White and Dale Schuurmans ICML 2009, Best Overall Paper Honorable Mention A Unified Perspective on Supervised,

CS623: Introduction to Computing with Neural Nets (lecture-12) Pushpak Bhattacharyya Computer Science and Engineering Department IIT Bombay.

Optimal Relay Placement for Indoor Sensor Networks Cuiyao Xue †, Yanmin Zhu †, Lei Ni †, Minglu Li †, Bo Li ‡ † Shanghai Jiao Tong University ‡ HK University.

Operation and Control Strategy of PV/WTG/EU Hybrid Electric Power System Using Neural Networks Faculty of Engineering, Elminia University, Elminia, Egypt.

Performance Comparison of Ad Hoc Network Routing Protocols Presented by Venkata Suresh Tamminiedi Computer Science Department Georgia State University.

Canadian Weather Analysis Using Connectionist Learning Paradigms Imran Maqsood*, Muhammad Riaz Khan , Ajith Abraham  * Environmental Systems Engineering.

An Evolutionary Algorithm for Neural Network Learning using Direct Encoding Paul Batchis Department of Computer Science Rutgers University.

A Presentation on Adaptive Neuro-Fuzzy Inference System using Particle Swarm Optimization and it’s Application By Sumanta Kundu (En.R.No.

 Negnevitsky, Pearson Education, Lecture 12 Hybrid intelligent systems: Evolutionary neural networks and fuzzy evolutionary systems n Introduction.

Introduction to the TLearn Simulator n CS/PY 231 Lab Presentation # 5 n February 16, 2005 n Mount Union College.

Neural network based hybrid computing model for wind speed prediction K. Gnana Sheela, S.N. Deepa Neurocomputing Volume 122, 25 December 2013, Pages 425–429.

CS 9633 Machine Learning Support Vector Machines

Artificial Neural Networks

SOUTHERN TAIWAN UNIVERSITY ELECTRICAL ENGINEERING DEPARTMENT

Luís Filipe Martinsª, Fernando Netoª,b.

Optimization of PHEV/EV Battery Charging

Machine Learning Today: Reading: Maria Florina Balcan

Capabilities of Threshold Neurons

A Dynamic System Analysis of Simultaneous Recurrent Neural Network

Computer Vision Lecture 19: Object Recognition III

Artificial Intelligence Chapter 3 Neural Networks

Presentation transcript:

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 1 / 45 A General Neural Network Model for Estimating Telecommunications Network Reliability Instructor : Frank Yeong-Sung Lin, Ph.D. Students: D 陳君銘, D 黃健誠 Journal: IEEE Transactions on Reliability, Vol. 58, No. 1, March Authors: Fulya Altiparmak, Berna Dengiz, and Alice E. Smith, Senior Member of IEEE.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 2 / 45 Author Home page for Professor Smith: Alice E. Smith is Professor and Chair of the Industrial and Systems Engineering Department at Auburn University.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 3 / 45 References D. W. Coit and A. E. Smith, “Solving the redundancy allocation problem using a combined neural network/genetic algorithm approach,” Computers and Operations Research, vol. 23, no. 6, pp.515–526, B. Dengiz, F. Altiparmak, and A. E. Smith, “Efficient optimization of all-terminal reliable networks, using an evolutionary approach,” IEEE Trans. on Reliability, vol. 46, pp.18–26, C. Srivaree-ratana, and A. E. Smith, “Estimating All-Terminal Network Reliability Using a Neural Network,” Proceedings of the 1998 IEEE International Conference on Systems, Man, and Cerbernetics, San Diego, CA, 1998, vol. 5, pp C. Srivaree-ratana, A. Konak, and A. E. Smith, “Estimation of All-terminal network reliability using an artificial neural network,” Computers and Operations Research, vol. 29, pp. 849–868, F. Altiparmak, B. Dengiz, and A. E. Smith, “Reliability estimation of computer communication networks: ANN models,” Proceedings Eighth IEEE International Symposium on Computers and Communication (IEEE ISCC’03), Antalya-Kemer, Turkey, 2003, vol. 2, pp.1353–1358.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 4 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 5 / 45 Reliability( 可靠度 ) The Advisory Group on Reliability of Electronic Equipment (AGREE), established on August 21, AGREE, “Reliability of Military Electronic Equipment,” Advisory Group on the Reliability of Electronic Equipment (AGREE), U.S. Government Printing Office, Washington, DC. Foundation work on reliability theory, June 4, Reliability is defined as the ability of a system or component to perform its required functions under stated conditions for a specified period of time. 「產品於既定的時間內，在特定的使用環境條件下，執行特定的功能，成功完成工作目標的機率」。

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 6 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 7 / 45 Abstract This paper proposes a new encoding method for using neural network models to estimate the reliability of telecommunications networks with identical link reliabilities. Drawback of previous approaches: Long vector length of the inputs required to represent the network link architecture. The specificity of the neural network model to a certain system size. This study demonstrates both the precision of the neural network estimate of reliability, and the ability of the neural network model to generalize to a variety of network sizes (small to large scale communications networks).

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 8 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 9 / 45 Introduction The exact calculation of all-terminal network reliability is an NP-hard problem, with computational effort growing exponentially with the number of nodes and links in the network. There exists no algorithm with a polynomial time to compute all-terminal network reliability. Because of the impracticality of calculating all-terminal network reliability for networks of moderate to large size, Monte Carlo simulation methods to estimate network reliability and upper and lower bounds to bound reliability have been used as alternatives. Valiant, L.G., “The Complexity of Enumeration and Reliability Problems,” SIAM Journal on Computing, Vol. 8, Issue 3, pp , Provan, J. S. and M. O. Ball, “The complexity of counting cuts and of computing the probability that a graph is connected,” SIAM Journals on Computing, Vol. 12, Issue 4, pp. 777–788, 1983.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 10 / 45 Introduction (cont’d) In this study, a generalized artificial neural network (General ANN) is proposed to estimate all-terminal network reliability for networks. This study use an input encoding that, unlike previous approaches, does NOT rely on a vector of all possible links between nodes. Advantages: The first is that a single ANN model can be used for multiple network sizes and topologies. The second advantage is that the input information to the ANN is compact, which makes the method tractable, even for large sized networks.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 11 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 12 / 45 Artificial Neural Network An ANN has the ability to learn relationships between given sets of input and output data by changing the weights. This process is called: training the ANN (Back Propagation).

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 13 / 45 Artificial Neural Network (cont’d) The performance of the ANN model is a function of several design parameters such as the number of hidden layers, the number of hidden neurons in each hidden layer, the size of the training set, and the training parameters. The technique of k-fold cross validation is particularly useful because it makes the most of a limited size data set. The data set is divided (randomly) into multiple sets (cross validation would include sets, where is the data set size, while grouped cross validation would include sets).

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 14 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 15 / 45 The General ANN Method This study identified compact, easily calculated measures of network connectivity and reliability as the candidate set of inputs: ND: of each node, 0 if the node is not present ND min : minimum node degree of the network ND med : median node degree of the network ND max : maximum node degree of the network LR: link reliability NL: number of links C: link connectivity UB: network reliability upper bound

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 16 / 45 The General ANN Method 5 input configurations were studied: 1) ND, LR, UB 2) ND, NL, LR, UB 3) ND, C, LR, UB 4) ND, NL, C, LR, UB 5) ND min, ND med, ND max, NL, C, LR, UB.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 17 / 45 The General ANN Method (cont’d) 5 input configurations: Input neurons

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 18 / 45 The General ANN Method (cont’d) The output of the ANN is the estimation of all-terminal network reliability (one real valued neuron). The target network reliability of each network is estimated using a Monte Carlo simulation method. This study used randomly generated data sets for training and validation considering five different link reliabilities (0.80, 0.85, 0.90, 0.95, and 0.99), and five different link connectivity values (1 to 5), so that there are 25 design points. RMSE: root mean squared error. MAD: mean absolute deviation

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 19 / 45 The General ANN Method (cont’d) A preliminary experimental study, the number of hidden neurons, and training data size were set to 15, and 2400, respectively. The model was validated using 5-fold cross validation, where each validation network was trained and tested using 2400, and 600 observations, respectively. A final application network was trained using all members of the data set, i.e observations, and its validation was inferred using the average of the prediction error of the five validation networks.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 20 / 45 Comparison of Input Data Groupings This study give the results of 5-fold cross validation for the neural networks considering the 5 different configurations. The ERROR used to calculate RMSE is the difference between the Monte Carlo simulation, and the Neural Network estimation of the all-terminal network reliability. RMSE: root mean squared error

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 21 / 45 Comparison of the General ANN (GNN), and Specific ANN (SNN) Models All RMSE values of the General ANN are smaller than the specific ANN, and the UB. RMSE: root mean squared error MAD: mean absolute deviation

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 22 / 45 The Performance of the General Model on New Network Sizes This table shows no systematic error patterns in terms of network size. It appears that the General ANN can be used to estimate all- terminal network reliability for any network size from 10 to 20 nodes with similar estimation error.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 23 / 45 Scaling Up to Large Networks This table gives 5-fold cross validation results for large networks (30, 35, 40 nodes). While the average RMSE value is for the General ANN, it is for the upper bound.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 24 / 45 Scaling Up to Large Networks (cont’d) This table gives the RMSE, and MAD values. See that there are no systematic error patterns in terms of network size. These results show that the scale up of the General ANN approach is good, and that this approach is viable for networks of realistic size.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 25 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 26 / 45 Application to Real Communications Systems This study considered three real networks to better investigate the effectiveness of the General ANN approach. These are Authorized licensed Arpanet, the European Optical Network, and the communications network of Gazi University.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 27 / 45 Application to Real Communications Systems (cont’d) The General ANN estimates of system reliability were compared with the actual system reliability (using Monte Carlo simulation), the upper bound of system reliability, and the estimate of system reliability using a specific ANN developed for that network architecture. The General ANN developed expressly for performed very well, better than both the UB, and the Specific ANN.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 28 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 29 / 45 Conclusions This study presented a novel method of encoding communications networks for ANN that accommodates networks of varying node and link sizes. Single ANN model can be used for multiple network sizes and topologies. In design optimization, one might use the General ANN for screening many designs to gauge the trade off between system reliability and cost. An exact method or computationally laborious Monte Carlo simulation should be used on the final few candidate network designs to ascertain the precise system reliability.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 30 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 31 / 45 Appendix This study must note that there are different network topologies which yield the same values of the inputs to the General ANN. Authors studied this aspect by generating some differing networks with the same number of nodes, links, node degrees, link reliabilities, etc.; but which have different all terminal network reliability.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 32 / 45 Appendix The General ANN approach CANNOT discriminate among networks with the same topological inputs.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 33 / 45 Appendix The reliabilities estimated by the UB, Monte Carlo simulation (MC), the General ANN (GNN) approach, and a specific ANN (SNN) trained for that topology.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 34 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 35 / 45 Demo ANN – Using Qnet

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 36 / 45 Qnet Training Mode Network Design ：決定隱藏層數及輸入、輸出層單元數，且可決定轉換函數。

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 37 / 45 Qnet (cont’d) Training Data ：「 Input Data File 」選取文字檔案位置，並選取輸入層起始欄位，如果資料非經過正規化處理，則不勾選「 Normalize Input 」。

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 38 / 45 Qnet (cont’d) Input Data File

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 39 / 45 Qnet (cont’d) Training Parameters

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 40 / 45 Qnet (cont’d) Training

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 41 / 45 Qnet (cont’d) Result ：前為目標值；後為預測值

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 42 / 45 Qnet (cont’d) Recall Mode

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 43 / 45 Outline Abstract Introduction Artificial Neural Networks The General ANN Method Application to Real Communications Systems Conclusions Appendix Demo Comments

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 44 / 45 Comments This paper presented a novel method of encoding communications networks for ANN. Experimental results shows that the General ANN is equivalent or superior in estimation accuracy to ANN models developed for a specific sized network. The study elaborated more detail about the experimental results of the proposed method and the compared methods. The experiment is fair to use k-fold cross validation. The authors considered three real networks to better investigate the effectiveness of the General ANN approach.

ppt © NTU-IM-OPLab. (Chien-Cheng Huang) 45 / 45 Thank you !