Ninja Trader: Introduction to data mining in financial applications

Slides:



Advertisements
Similar presentations
The Software Infrastructure for Electronic Commerce Databases and Data Mining Lecture 4: An Introduction To Data Mining (II) Johannes Gehrke
Advertisements

Random Forest Predrag Radenković 3237/10
Ch2 Data Preprocessing part3 Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2009.
Combining Classification and Model Trees for Handling Ordinal Problems D. Anyfantis, M. Karagiannopoulos S. B. Kotsiantis, P. E. Pintelas Educational Software.
1 Statistical Modeling  To develop predictive Models by using sophisticated statistical techniques on large databases.
Chapter 7 – Classification and Regression Trees
Chapter 7 – Classification and Regression Trees
1. Abstract 2 Introduction Related Work Conclusion References.
Introduction to WEKA Aaron 2/13/2009. Contents Introduction to weka Download and install weka Basic use of weka Weka API Survey.
Data Mining – Intro.
CS157A Spring 05 Data Mining Professor Sin-Min Lee.
Forecasting with Twitter data Presented by : Thusitha Chandrapala MARTA ARIAS, ARGIMIRO ARRATIA, and RAMON XURIGUERA.
Data Mining By Andrie Suherman. Agenda Introduction Major Elements Steps/ Processes Tools used for data mining Advantages and Disadvantages.
Data Mining BS/MS Project Decision Trees for Stock Market Forecasting Presentation by Mike Calder.
1 © Goharian & Grossman 2003 Introduction to Data Mining (CS 422) Fall 2010.
Data Mining. 2 Models Created by Data Mining Linear Equations Rules Clusters Graphs Tree Structures Recurrent Patterns.
Kansas State University Department of Computing and Information Sciences CIS 830: Advanced Topics in Artificial Intelligence From Data Mining To Knowledge.
3 Objects (Views Synonyms Sequences) 4 PL/SQL blocks 5 Procedures Triggers 6 Enhanced SQL programming 7 SQL &.NET applications 8 OEM DB structure 9 DB.
Appendix: The WEKA Data Mining Software
Chapter 9 – Classification and Regression Trees
Data Mining Chapter 1 Introduction -- Basic Data Mining Tasks -- Related Concepts -- Data Mining Techniques.
Introduction to machine learning and data mining 1 iCSC2014, Juan López González, University of Oviedo Introduction to machine learning Juan López González.
Intelligent Database Systems Lab 國立雲林科技大學 National Yunlin University of Science and Technology A data mining approach to the prediction of corporate failure.
1 SUPPORT VECTOR MACHINES İsmail GÜNEŞ. 2 What is SVM? A new generation learning system. A new generation learning system. Based on recent advances in.
Jeff Howbert Introduction to Machine Learning Winter Regression Linear Regression.
A hybrid SOFM-SVR with a filter-based feature selection for stock market forecasting Huang, C. L. & Tsai, C. Y. Expert Systems with Applications 2008.
1. 2 Traditional Income Statement LO1: Prepare a contribution margin income statement.
CS157B Fall 04 Introduction to Data Mining Chapter 22.3 Professor Lee Yu, Jianji (Joseph)
Social Science Inquiry Model. Scientific inquiry has 5 steps Identify a problem Develop a hypothesis Gather data Analyze the data Draw conclusions.
Data Mining BY JEMINI ISLAM. Data Mining Outline: What is data mining? Why use data mining? How does data mining work The process of data mining Tools.
Neural Networks Demystified by Louise Francis Francis Analytics and Actuarial Data Mining, Inc.
An Introduction Student Name: Riaz Ahmad Program: MSIT( ) Subject: Data warehouse & Data Mining.
Data Mining and Decision Support
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
DECISION TREES Asher Moody, CS 157B. Overview  Definition  Motivation  Algorithms  ID3  Example  Entropy  Information Gain  Applications  Conclusion.
Financial Data mining and Tools CSCI 4333 Presentation Group 6 Date10th November 2003.
WHAT IS DATA MINING?  The process of automatically extracting useful information from large amounts of data.  Uses traditional data analysis techniques.
Data Mining Techniques Applied in Advanced Manufacturing PRESENT BY WEI SUN.
Inna Levitskaya.  Productiveness of successful people  The rule of “6 P”  The decision tree  The most important - identify the main  The word "no“
Decision Trees Jennifer Tsay CS 157B February 4, 2010.
 Analysis of statistics generated by market activity such as past price and volume to come up with reasonable outcome in future using charts as a primary.
Data Mining.
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Data Mining – Intro.
MIS2502: Data Analytics Advanced Analytics - Introduction
DATA MINING © Prentice Hall.
Machine Learning Logistic Regression
Prepared by: Mahmoud Rafeek Al-Farra
Chapter 6 Classification and Prediction
Predict House Sales Price
NBA Draft Prediction BIT 5534 May 2nd 2018
Data Mining: Concepts and Techniques Course Outline
Vincent Granville, Ph.D. Co-Founder, DSC
CS548 Fall 2017 Decision Trees / Random Forest Showcase by Yimin Lin, Youqiao Ma, Ran Lin, Shaoju Wu, Bhon Bunnag Showcasing work by Cano,
Teaching with Instructional Software
Machine Learning Logistic Regression
Sangeeta Devadiga CS 157B, Spring 2007
Machine Learning with Weka
Data Science introduction.
Supporting End-User Access
Opening Weka Select Weka from Start Menu Select Explorer Fall 2003
Classification and Prediction
Chapter 8 Models and Decision Support
Course Introduction CSC 576: Data Mining.
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Data Mining, Machine Learning, Data Analysis, etc. scikit-learn
Big DATA.
Lecture 4. Niching and Speciation (1)
Regression Methods.
MIS2502: Data Analytics Introduction to Advanced Analytics and R
Presentation transcript:

Ninja Trader: Introduction to data mining in financial applications Artem Gritsenko CS 548 Showcase Feb 7, 2014

Resources Ninja Trader: Homepage: http://www.ninjatrader.com Download: http://www.ninjatrader.com/download-registration.php Tutorial: http://www.ninjatrader.com/support/helpGuides/nt7/index.html Learning videos: http://www.youtube.com/user/NinjaTraderLLC References on data mining in financial applications: http://www.nag.com/IndustryArticles/DMinFinancialApps.pdf http://link.springer.com/chapter/10.1007%2F0-387-25465-X_57 http://suraj.lums.edu.pk/~cs631s05/Papers/financial.pdf

Motivation Why financial applications? Real-world problem that can be solved with data mining and that is still subject to research. FA use all variety of different KDD and data mining techniques: data aggregation, visualization, feature selection, prediction,etc. Why Ninja Trader? Free to download and use Has a setting of simulated trading (to learn and play)

Nature of financial data Financial dataset: Usually consists of 5 attributes: index value at open, index value at close, highest index value, lowest index value, trading volume (daily). Data integration: Mediation Approach: allows information to be retrieved directly from original databases (Yahoo finance, Google finance, etc.)

Dataset analysis Data exploration Summary statistics - standard deviation, moving average, simple prediction based on linear regression Visualization ... Data Preprocessing Data aggregation (day, month, year) Feature construction (moving average) Sampling - in Monte Carlo Simulation

Trading rules Trading rules can be determined from data with a categorical outcome, e.g., buy or sell, rise or fall. This leads to a classification task: at each time step data is classified into one of the categories: Buy stock Sell stock If we consider rules in the form of conditional statements IF CONDITION1 AND CONDITION2 THEN ACTION the model can be fitted with a decision tree. Langdel(2009)

Decision Tree Tree construction: Nodes: tests (X1 >= VALUE or {(X2 = i)}, for i=1, 2,..) Leaves: decisions (sell, buy) Ex. "When the 10-day moving average crosses above the 30-day moving average and both moving averages are increasing it is time to buy"

Other approaches Statistical Autoregressive models Moving average models Advantage: easy to interpret Disadvantage: need parameters to be set properly Neural networks: Advantage: ability to model very complex data Disadvantage: hard to interpret

Conclusion Only main features and capabilities of the software discussed There is an advanced and more powerful version of Ninja Trader exist (not free!) You can add your own functionality(strategies, indicators, etc.) to Ninja Trader with NinjaScript (basically C#) http://www.ninjatrader.com/support/helpGuides/nt7/index.html?distribution. htm