Montek Singh COMP790-084 Oct 11, 2011.  Today’s topics: ◦ more on error metrics ◦ more applications ◦ architectures and design tools ◦ challenges and.

Slides:



Advertisements
Similar presentations
Green Network Project Contract
Advertisements

Modeling and Simulation By Lecturer: Nada Ahmed. Introduction to simulation and Modeling.
ETHEM ALPAYDIN © The MIT Press, Lecture Slides for 1 Lecture Notes for E Alpaydın 2010.
Probabilistic models Jouni Tuomisto THL. Outline Deterministic models with probabilistic parameters Hierarchical Bayesian models Bayesian belief nets.
Learning in Neural and Belief Networks - Feed Forward Neural Network 2001 년 3 월 28 일 안순길.
Deep Learning Bing-Chen Tsai 1/21.
Asynchronous comparator design
IMPORTANCE SAMPLING ALGORITHM FOR BAYESIAN NETWORKS
Montek Singh COMP Oct 6,  Today’s topics: ◦ approximate arithmetic ◦ simple applications  Next time: ◦ more applications ◦ architectures.
Montek Singh COMP Oct 4,  Basics of probabilistic design ◦ energy-correctness tradeoff ◦ probabilistic Boolean logic ◦ approximate arithmetic.
Montek Singh COMP Nov 29,  What is Brownian motion?  Brownian Cellular Automata ◦ Asynchronous Cellular Automata  Mapping Circuits to.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Rutgers CS440, Fall 2003 Neural networks Reading: Ch. 20, Sec. 5, AIMA 2 nd Ed.
Prénom Nom Document Analysis: Artificial Neural Networks Prof. Rolf Ingold, University of Fribourg Master course, spring semester 2008.
Presenting: Itai Avron Supervisor: Chen Koren Final Presentation Spring 2005 Implementation of Artificial Intelligence System on FPGA.
Fitting models to data. Step 5) Express the relationships mathematically in equations Step 6)Get values of parameters Determine what type of model you.
Introduction to Simulation. What is simulation? A simulation is the imitation of the operation of a real-world system over time. It involves the generation.
A Fault-tolerant Architecture for Quantum Hamiltonian Simulation Guoming Wang Oleg Khainovski.
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Statistical inference.
Neural Networks. Background - Neural Networks can be : Biological - Biological models Artificial - Artificial models - Desire to produce artificial systems.
Integrated Social and Quality of Service Trust Management of Mobile Groups in Ad Hoc Networks Ing-Ray Chen, Jia Guo, Fenye Bao, Jin-Hee Cho Communications.
CHAPTER 12 ADVANCED INTELLIGENT SYSTEMS © 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang.
Chapter 8 Prediction Algorithms for Smart Environments
1 Performance Evaluation of Computer Networks: Part II Objectives r Simulation Modeling r Classification of Simulation Modeling r Discrete-Event Simulation.
VLSI Arithmetic Adders & Multipliers Prof. Vojin G. Oklobdzija University of California
Neural Networks Ellen Walker Hiram College. Connectionist Architectures Characterized by (Rich & Knight) –Large number of very simple neuron-like processing.
Data Mining Techniques in Stock Market Prediction
What is Probability?  Hit probabilities  Damage probabilities  Personality (e.g. chance of attack, run, etc.)  ???  Probabilities are used to add.
Artificial Neural Networks. The Brain How do brains work? How do human brains differ from that of other animals? Can we base models of artificial intelligence.
High Performance Embedded Computing © 2007 Elsevier Lecture 3: Design Methodologies Embedded Computing Systems Mikko Lipasti, adapted from M. Schulte Based.
High Performance Embedded Computing © 2007 Elsevier Chapter 1, part 2: Embedded Computing High Performance Embedded Computing Wayne Wolf.
Bayesian Macromodeling for Circuit Level QCA Design Saket Srivastava and Sanjukta Bhanja Department of Electrical Engineering University of South Florida,
Artificial Neural Networks An Introduction. What is a Neural Network? A human Brain A porpoise brain The brain in a living creature A computer program.
GPU Architectural Considerations for Cellular Automata Programming A comparison of performance between a x86 CPU and nVidia Graphics Card Stephen Orchowski,
Intelligent vs Classical Control Bax Smith EN9940.
RANSim: Simulating a DS-CDMA Fading Channel with Traffic that Arrives in Bursts Colette Consani Heidi Proske.
Simulation is the process of studying the behavior of a real system by using a model that replicates the behavior of the system under different scenarios.
Jeffrey Zheng School of Software, Yunnan University August 4, nd International Summit on Integrative Biology August 4-5, 2014 Chicago, USA.
Selected Topics in Graphical Models Petr Šimeček.
1 CMSC 671 Fall 2001 Class #25-26 – Tuesday, November 27 / Thursday, November 29.
Estimating Component Availability by Dempster-Shafer Belief Networks Estimating Component Availability by Dempster-Shafer Belief Networks Lan Guo Lane.
Randomized Algorithms for Bayesian Hierarchical Clustering
© 2005 Prentice Hall, Decision Support Systems and Intelligent Systems, 7th Edition, Turban, Aronson, and Liang 12-1 Chapter 12 Advanced Intelligent Systems.
Random Graph Generator University of CS 8910 – Final Research Project Presentation Professor: Dr. Zhu Presented: December 8, 2010 By: Hanh Tran.
Monte Carlo Process Risk Analysis for Water Resources Planning and Management Institute for Water Resources 2008.
Schreiber, Yevgeny. Value-Ordering Heuristics: Search Performance vs. Solution Diversity. In: D. Cohen (Ed.) CP 2010, LNCS 6308, pp Springer-
BCS547 Neural Decoding.
CPSC 422, Lecture 11Slide 1 Intelligent Systems (AI-2) Computer Science cpsc422, Lecture 11 Oct, 2, 2015.
Introduction to Neural Networks Introduction to Neural Networks Applied to OCR and Speech Recognition An actual neuron A crude model of a neuron Computational.
WERST – Methodology Group
Probabilistic models Jouni Tuomisto THL. Outline Deterministic models with probabilistic parameters Hierarchical Bayesian models Bayesian belief nets.
Bayesian networks and their application in circuit reliability estimation Erin Taylor.
Introduction to Models Lecture 8 February 22, 2005.
Tolerating Communication and Processor Failures in Distributed Real-Time Systems Hamoudi Kalla, Alain Girault and Yves Sorel Grenoble, November 13, 2003.
CHAPTER 6 SPECIAL NETWORKS “Principles of Soft Computing, 2nd Edition”
Why use landscape models?  Models allow us to generate and test hypotheses on systems Collect data, construct model based on assumptions, observe behavior.
Artificial Intelligence CIS 342 The College of Saint Rose David Goldschmidt, Ph.D.
Observation vs. Inferences The Local Environment.
Bayesian Modeling of Quantum-Dot-Cellular-Automata Circuits Sanjukta Bhanja and Saket Srivastava Electrical Engineering, University of South Florida, Tampa,
G. Cowan Lectures on Statistical Data Analysis Lecture 5 page 1 Statistical Data Analysis: Lecture 5 1Probability, Bayes’ theorem 2Random variables and.
CHAPTER 3: BAYESIAN DECISION THEORY. Making Decision Under Uncertainty Based on E Alpaydın 2004 Introduction to Machine Learning © The MIT Press (V1.1)
Biological and cognitive plausibility in connectionist networks for language modelling Maja Anđel Department for German Studies University of Zagreb.
EE141 Arithmetic Circuits 1 Chapter 14 Arithmetic Circuits Rev /12/2003 Rev /05/2003.
Accurate WiFi Packet Delivery Rate Estimation and Applications Owais Khan and Lili Qiu. The University of Texas at Austin 1 Infocom 2016, San Francisco.
Bayesian Decision Theory Introduction to Machine Learning (Chap 3), E. Alpaydin.
Bayesian Brain - Chapter 11 Neural Models of Bayesian Belief Propagation Rajesh P.N. Rao Summary by B.-H. Kim Biointelligence Lab School of.
Other Classification Models: Neural Network
Tarek Elderini & Dr. Naima Kaabouch
OVERVIEW OF BIOLOGICAL NEURONS
Neuro-RAM Unit in Spiking Neural Networks with Applications
Presentation transcript:

Montek Singh COMP Oct 11, 2011

 Today’s topics: ◦ more on error metrics ◦ more applications ◦ architectures and design tools ◦ challenges and benefits ◦ open questions

 For arithmetic units, error metric based upon an error threshold, δ ◦ errors < δ are tolerable ◦ p δ = prob (err < δ)

 Applications which harness probabilistic behavior ◦ algorithms with repeated execution with the same inputs resulting in distinct outcomes (with some prob. distribution)  Separate algorithm into deterministic and probabilistic parts

 Bayesian Inference ◦ statistical inference technique mimicking human decision-making process ◦ set of hypotheses and probability weights ◦ each observation leads to a revision of prob weights ◦ Example:

 Example ◦ Given  prob of rain  prob of sprinkler being on given rain ◦ Find: prob of rain given that the grass is wet  Implemented using PCMOS

 Random Neural Networks ◦ Poisson process models the “firing” of a neuron  Probabilistic Cellular Automata ◦ Each cell’s next state is a function of its neighbors ◦ Next state could be 0 or 1 with certain prob  Hyper Encryption ◦ Random seed generated using PCMOS

 Applications that tolerate probabilistic behavior ◦ multimedia mostly ◦ signal processing ◦ others?

 Different partitioning of deterministic vs. probabilistic parts of an algorithm

 Host (deterministic) vs. coprocessor (probabilistic) partitioning

 Comparison ◦ Host = deterministic ◦ without coprocessor: software only ◦ with coprocessor:  using PCMOS  using CMOS

 Quality of randomness  using PCMOS vs. pseudo RNG

 Benefits ◦ …?  Challenges ◦ …?

 Architectural questions ◦ Which design is better in terms of E-p tradeoff? ◦ Example:  Which adder is better: carry-skip or ripple-carry?  carry-skip adder has faster propagation time  ripple-carry adder consumes less energy  But: carry-skip adder may be better when there are delay-induced errors!  Design tools ◦ What type of tool support is needed? ◦ Simulation and validation?