Machine Learning for dotNET Developer Bahrudin Hrnjica, MVP

Slides:



Advertisements
Similar presentations
Pat Langley Computational Learning Laboratory Center for the Study of Language and Information Stanford University, Stanford, California
Advertisements

Godfather to the Singularity
Intelligent Environments1 Computer Science and Engineering University of Texas at Arlington.
An Overview of Machine Learning
Supervised Learning Recap
Machine Learning: Connectionist McCulloch-Pitts Neuron Perceptrons Multilayer Networks Support Vector Machines Feedback Networks Hopfield Networks.
Visual Recognition Tutorial
Lecture 17: Supervised Learning Recap Machine Learning April 6, 2010.
Lecture 14 – Neural Networks
An Introduction to Machine Learning In the area of AI (earlier) machine learning took a back seat to Expert Systems Expert system development usually consists.
EECS 349 Machine Learning Instructor: Doug Downey Note: slides adapted from Pedro Domingos, University of Washington, CSE
Machine Learning: Foundations Yishay Mansour Tel-Aviv University.
Learning From Data Chichang Jou Tamkang University.
CSE 546 Data Mining Machine Learning Instructor: Pedro Domingos.
Data Mining with Decision Trees Lutz Hamel Dept. of Computer Science and Statistics University of Rhode Island.
Visual Recognition Tutorial
Sparse vs. Ensemble Approaches to Supervised Learning
Review Rong Jin. Comparison of Different Classification Models  The goal of all classifiers Predicating class label y for an input x Estimate p(y|x)
Part I: Classification and Bayesian Learning
Seven Lectures on Statistical Parsing Christopher Manning LSA Linguistic Institute 2007 LSA 354 Lecture 7.
CS Bayesian Learning1 Bayesian Learning. CS Bayesian Learning2 States, causes, hypotheses. Observations, effect, data. We need to reconcile.
机器学习 陈昱 北京大学计算机科学技术研究所 信息安全工程研究中心. Concept Learning Reference : Ch2 in Mitchell’s book 1. Concepts: Inductive learning hypothesis General-to-specific.
COMP3503 Intro to Inductive Modeling
Machine Learning1 Machine Learning: Summary Greg Grudic CSCI-4830.
1 Artificial Neural Networks Sanun Srisuk EECP0720 Expert Systems – Artificial Neural Networks.
 The most intelligent device - “Human Brain”.  The machine that revolutionized the whole world – “computer”.  Inefficiencies of the computer has lead.
Lecture 10: 8/6/1435 Machine Learning Lecturer/ Kawther Abas 363CS – Artificial Intelligence.
Machine Learning.
Overview of Machine Learning RPI Robotics Lab Spring 2011 Kane Hadley.
Slides for “Data Mining” by I. H. Witten and E. Frank.
WEEK INTRODUCTION IT440 ARTIFICIAL INTELLIGENCE.
Instructor: Pedro Domingos
Data Mining and Decision Support
Machine Learning Lecture 1: Intro + Decision Trees Moshe Koppel Slides adapted from Tom Mitchell and from Dan Roth.
SUPERVISED AND UNSUPERVISED LEARNING Presentation by Ege Saygıner CENG 784.
CMPS 142/242 Review Section Fall 2011 Adapted from Lecture Slides.
PATTERN RECOGNITION AND MACHINE LEARNING CHAPTER 1: INTRODUCTION.
Brief Intro to Machine Learning CS539
Combining Models Foundations of Algorithms and Machine Learning (CS60020), IIT KGP, 2017: Indrajit Bhattacharya.
Experience Report: System Log Analysis for Anomaly Detection
Big data classification using neural network
Machine Learning with Spark MLlib
Who am I? Work in Probabilistic Machine Learning Like to teach 
Machine Learning for Computer Security
Machine Learning – Classification David Fenyő
CEE 6410 Water Resources Systems Analysis
Instructor: Pedro Domingos
Deep Learning Amin Sobhani.
CS 9633 Machine Learning Inductive-Analytical Methods
CSEP 546 Data Mining Machine Learning
Machine Learning Basics
Data Mining Lecture 11.
CSEP 546 Data Mining Machine Learning
CSE 473 Introduction to Artificial Intelligence Neural Networks
Basic Intro Tutorial on Machine Learning and Data Mining
Predictive Learning from Data
CSEP 546 Data Mining Machine Learning
Overview of Machine Learning
Overfitting and Underfitting
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
Pattern Classification All materials in these slides were taken from Pattern Classification (2nd ed) by R. O. Duda, P. E. Hart and D. G. Stork, John.
MACHINE LEARNING TECHNIQUES IN IMAGE PROCESSING
Machine learning overview
CS639: Data Management for Data Science
Linear Discrimination
Introduction to Neural Networks
Memory-Based Learning Instance-Based Learning K-Nearest Neighbor
Introduction to Machine learning
CSC 578 Neural Networks and Deep Learning
What is Artificial Intelligence?
Presentation transcript:

Machine Learning for dotNET Developer Bahrudin Hrnjica, MVP

Agenda Intro to ML Types of ML dotNET and ML-tools and libraries Demo01: ANN with C# Demo02: GP with C# .NET Tools – Acord.NET, GPdotNET Summary

Machine Learning? method of teaching computers to make predictions based on data. branch of Artificial intelligence semi-automated extraction of knowledge from data always starts from data, and the goal is knowledge extraction, involves some amount of automation in form of algorithm and computer to do the job, not fully automated, it requires many smart decisions by a human.

Data Computer Output Program Data Computer Program Output Traditional Programming Machine Learning Computer Data Output Program Computer Data Program Output

Magic? No, more like gardening Seeds = Algorithms Nutrients = Data Gardener = You Plants = Programs

Sample Applications Web search Engineering Finance E-commerce Space exploration Robotics Information extraction Social networks Debugging [Your favorite area]

ML in a Nutshell Tens of thousands of machine learning algorithms Hundreds new every year Every machine learning algorithm has three components: Representation Evaluation Optimization

Representation Chromosomes in genetics (GA/GP) Neural networks Decision trees Sets of rules / Logic programs Instances Graphical models (Bayes/Markov nets) Support vector machines Etc.

Evaluation Accuracy Precision and recall Squared error Likelihood Posterior probability Cost / Utility Margin Entropy K-L divergence Etc.

Optimization/Learners Combinatorial optimization E.g.: Greedy search Convex optimization E.g.: Gradient descent Constrained optimization E.g.: Linear programming General optimization E.g.: Genetic Algorithm E.g.: Particle Swarm Optimization

Types of Learning Supervised (inductive) learning Training data includes desired outputs Unsupervised learning Training data does not include desired outputs Semi-supervised learning Training data includes a few desired outputs

Machine learning structure Supervised learning

Machine learning structure Unsupervised learning

Training and testing Data acquisition Practical usage Universal set (unobserved) Training set (observed) Testing set (unobserved)

Training and testing Training is the process of making the system able to learn. No free lunch rule: Training set and testing set come from the same distribution Need to make some assumptions or bias

What are we seeking? Supervised: Low E-out or maximize probabilistic terms Unsupervised: Minimum quantization error, Minimum distance, MAP, MLE(maximum likelihood estimation) E-in: for training set E-out: for testing set

What are we seeking? Under-fitting VS. Over-fitting (fixed N) error (model = hypothesis + loss functions)

dotNET and ML Learning API - https://github.com/UniversityOfAppliedSciencesFrankfurt/LearningApi Accord .NET - https://github.com/accord-net/framework GPdotNET- https://github.com/bhrnjica/gpdotnet

DEMO- Simple ANN and GP C# Program IRIS DATA DEMO

Accord .NET

DEMO ACCORD .NET

LearningAPI

GPdotNET GP and ANN

Existing ML tools are difficult or impossible to integrate into a software system. Commercial and Open Source API libraries work well for some machine learning tasks but are extremely limited for neural networks. To develop neural networks using Visual Studio you must understand seven core concepts: feed- forward, activation, data encoding, error, training, free parameters, and over-fitting. Once the concepts are mastered, implementation with Visual Studio is not difficult (but not easy either).

Reference http://bhrnjica.net/gpdotnet http://accord-framework.net/ https://github.com/UniversityOfAppliedSciencesFrankfurt/LearningA pi http://www.quaetrix.com/Build2013.html C# ANN sample https://msdn.microsoft.com/en- us/magazine/mt149362?author=james+mccaffrey

HVALA NA PAŽNJI!