NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy NEURAL NETWORKS FOR SENSORS AND MEASUREMENT SYSTEMS Part II Vincenzo Piuri University of Milan, Italy

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy OUTLINE Neural networks: what are they? Implementation of intelligent sensors and measuring systems System design: a comprehensive approach

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy NEURAL NETWORKS Paradigm often suited to describe non-linear computation when the algorithmic definition cannot be easily identified or is too complex but the solutions can be easily shown by examples

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy NEURAL NETWORKS (2) When they are NOT useful or suited ? to compute linear functions to compute non-linear functions which can be satisfactorily linearized with respect to envisioned application when there are known and efficient algorithms to solve the problem when too few examples of the desired behavior are available

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy BIOLOGICAL NEURAL NETWORKS Artificial Neural Networks are biologically inspired computational models

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy ARTIFICIAL NEURAL NETWORKS Computation is defined by configuring the parameters of the uncommitted neural model by means of a configuration procedure (learning) y x w synaptic weights neuron i output links

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy ARTIFICIAL NEURAL NETWORKS (2) To define the neural computation we must specify the neural model –neuron model –network topology the model dimensions the configuration procedure –configuration algorithm –training data set –validation data set

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy NEURON MODELS

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy NETWORK TOPOLOGIES feedforward Kohonen feedback and memory Hopfield

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy CONFIGURATION PROCEDURES supervised learning unsupervised learning x y ANN E y real world xy ANN auto-organization

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy OPERATING LIFE generalization evolving adaptation domainco-domain (learning) good generalization poor generalization (poor learning)

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy COMPOSITE SYSTEMS Systems composed by: –algorithmic components –neural networks to exploit the best features of each paradigm SOFT COMPUTING ALGORITHM SOFT COMPUTING ALGORITHM

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy IMPLEMENTATION Analog hardware Digital dedicated hardware Digital configurable hardware DSP processor + software General-purpose processor + dedicated software General-purpose processor + configurable software

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy ANALOG HARDWARE excellent performance configuration fixed at production time difficult control of parameter accuracy synaptic circuit neuron circuit neural network integrated analog circuit

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy ANALOG HARDWARE WITH DIGITAL WEIGHTS very high performance good discretized control of weights configuration fixed at production time difficult control of some parameter accuracy synaptic circuit integrated mixed circuit mixed-mode multiplier

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy DIGITAL DEDICATED ARCHITECTURES configurable weights very good discretized control of parameters good performance digital architecture digital integrated circuit

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy DIGITAL DEDICATED ARCHITECTURES

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy DIGITAL CONFIGURABLE HARDWARE (FPGA) configurable computation very good discretized control of parameters good performance

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy DSP PROCESSOR + DEDICATED SOFTWARE dynamically highly-configurable computation very good discretized control of parameters reasonable performance neural network custom software

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy GENERAL PURPOSE PROCESSOR + DEDICATED SOFTWARE dynamically highly-configurable computation very good discretized control of parameters sufficient performance neural network custom software C C++ VisualC Assembler

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy GENERAL PURPOSE PROCESSOR + CONFIGURABLE SOFTWARE high system flexibility dynamically highly-configurable computation very good discretized control of parameters limited performance neural network configurable software

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy SYSTEM DESIGN SPECIFICATIONS IMPLEMENTATION ACCURACY PERFORMANCE COST

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy SYSTEM DESIGN (2) Latency Accuracy Hardware cost SM CM SM

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy SYSTEM DESIGN (3) Fully Hardware Implementation

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy SYSTEM DESIGN (4) x 10 4 Number of instructions Sum of Squared Error (L b +N b )+L (L b +N b )+L with Input (L b +N b )+N with Input L b +N N b N b +L L b (L b +N b )+N Fully Software Implementation

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy HIGH-LEVEL DESIGN

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy HIGH-LEVEL DESIGN (2)

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy HIGH-LEVEL DESIGN (3)

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy HIGH-LEVEL DESIGN (4)

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy HIGH-LEVEL DESIGN (5)

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy HIGH-LEVEL DESIGN (6)

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy HIGH-LEVEL DESIGN (7)

NIMIA October 2001, Crema, Italy - Vincenzo Piuri, University of Milan, Italy HIGH-LEVEL DESIGN (8)