1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 3b, February 7, 2014 Lab exercises: datasets and data infrastructure.

Slides:



Advertisements
Similar presentations
1 CS 4396 Computer Networks Lab General Info. 2 Goal: This course aims at helping students get more insight into how the Internet works and gain hands.
Advertisements

1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 6a, February 25, 2014, SAGE 3101 kNN, K-Means, Clustering and Bayesian Inference.
1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 4a, February 11, 2014, SAGE 3101 Introduction to Analytic Methods, Types of Data Mining for Analytics.
CIS101 Introduction to Computing Week 02. Agenda Your questions CIS101 Blackboard Site online.pace.edu and the online orientation Excel Project One Next.
IT 240 Intro to Desktop Databases Introduction. About this course Design a database: Entity Relation (ER) modeling and normalization techniques Create.
Welcome to Introduction to Java Programming At J.D.O’Bryant Science & Mathematics Chonho Lee Department of Computer Science University of Massachusetts.
CIS101 Introduction to Computing Week 02. Agenda Your questions CIS101 Blackboard Site Excel Project One Next Week.
1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 1a, January 27, 2015, Lally 102 Introduction to Data Analytics, Current Challenges. Course Outline.
1. 2 Type your ID # and press the ENTER key to continue YOU MUST LOG IN FOR PROPER CREDIT.
EECS 110: Introduction to Programming for Non-Majors
Please CLOSE YOUR LAPTOPS, and turn off and put away your cell phones, and get out your note-taking materials. Today’s daily quiz will be given at the.
 MyJU ◦ WebAdvisor: useful links such as classes, schedule, grades ◦ My Files: H Drive mapped in the whole campus.  This is Cloud storage!  You can.
Introduction to Managerial Accounting Richard E. McDermott, Ph.D. Spring 2013.
Lecture 1 Page 1 CS 111 Summer 2015 Introduction CS 111 Operating System Principles.
Creating a Web Site to Gather Data and Conduct Research.
1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 1b, January 30, 2015 Introductory Statistics/ Refresher and Relevant software installation.
1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 4b, February 14, 2014 Lab exercises: regression, kNN and K-means.
INFO 173 INSTRUCTOR: PROF. WILLIAM COLUCCI GRADUATE ASSISTANTS: SHINGIE AND SONALI INTRODUCTION TO COMPUTERS IN BUSINESS.
STATA Mini Course Fall 2015 Jane Leber Herr Littauer 113 1Stata Mini Course – Spring 2015.
1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 1a, January 21, 2014, SAGE 3101 Introduction to Data Analytics, Current Challenges. Course Outline.
CS151 Windows Applications Spring 2008 Instructor: Yvonne C. Flores
Object Oriented Programming Lecture 1: Introduction.
1 Peter Fox Data Science – ITEC/CSCI/ERTH Week 3, September 16, 2009 Class exercise - collecting data - individual.
1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 10a, April 1, 2014 Support Vector Machines.
1 Intro 1a CIS 748 Software Management Dr. David A Gustafson
GDP 113 Typography Orientation Will record for those who cannot attend Spring 2009.
1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 1b, January 24, 2014 Relevant software and getting it installed.
COP3502: Introduction to Computer Science Yashas Shankar.
CSE 1340 Introduction to Computing Concepts Class 1 ~ Intro.
Programming In Perl CSCI-2230 Thursday, 2pm-3:50pm Paul Lalli - Instructor.
1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 10b, April 4, 2014 Lab: More on Support Vector Machines, Trees, and your projects.
Lecture Section 001 Spring 2008 Mike O’Dell CSE 1301 Computer Literacy.
Lecture 1 Page 1 CS 111 Summer 2013 Introduction CS 111 Operating System Principles Peter Reiher.
HOW I SURVIVED A AIST3410 AND LEARNED TO LOVE DATABASES Fall 2015 Edition.
Today’s Agenda Chapter 7 Review for Midterm. Data Transfer Tools DTS (Data Transformation Services) BCP (Bulk Copy Program) BULK INSERT command Other.
CS122 Instructor Assignments Winter, 2010 Term. Overview Some changes in assignments due to schedule considerations Some new initiatives / revised strategies.
EECS 110: Introduction to Programming for Non-Majors Aleksandar Kuzmanovic Northwestern University
SAMI EEE – the next generation. IEEE SAMIEEE Training AGENDA l Slide presentation l Overview of new system l Hands-on training l Ask questions as we go.
Welcome to Academic Strategies CS Janine Przybyl "When there is a start to be made, don't step over! Start where you are." ~Edgar Cayce.
How to Have a Paperless Classroom SOME PRACTICAL IDEAS from Allison Smith, English.
Monitoring duties for TA’s Computer lab ES 2.104: open 9am-11pm daily Monitored by a TA when open Monitoring duty split into slots: 2 hour slots from 11am-9pm.
HOW I SURVIVED AIST2330 AND LEARNED TO LOVE SERVER ADMIN Fall 2015 Edition.
CPSC 203 Introduction to Computers T43, T46 & T68 TA: Jie (Jeff) Gao.
Please CLOSE YOUR LAPTOPS, and turn off and put away your cell phones, and get out your note- taking materials.
1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 5b, February 21, 2014 Interpreting regression, kNN and K-means results, evaluating models.
MGS 351 Introduction to Management Information Systems Lecture #1.
Digital Library Syllabus Uploader Will Cameron CSC 8530 Fall 2006 Presentation 1.
MGS 351 Introduction to Management Information Systems
Upon entering the application, the Faculty of Record will select his/her course from the My Courses list.
1 Peter Fox Data Analytics – ITWS-4600/ITWS-6600 Week 2b, February 5, 2016 Lab exercises: beginning to work with data: filtering, distributions, populations,
CSE3330/5330 DATABASE SYSTEMS AND FILE STRUCTURES (DB I) CSE3330/5330 DB I, Summer2012 Department of Computer Science and Engineering, University of Texas.
1 CS 4396 Computer Networks Lab General Info. 2 Goal: This course aims at helping students get more insight into how the Internet works and gain hands.
Computer Networks CNT5106C
Course Information CSE 2031 Fall Instructor U. T. Nguyen /new-yen/ Office: CSEB Office hours:  Tuesday,
Programming In Perl CSCI-2230 Wednesday, 4pm-5:50pm Paul Lalli - Instructor.
1 Peter Fox Data Analytics – ITWS-4600/ITWS-6600 Week 3b, February 12, 2016 Lab exercises /assignment 2.
March 21,  All Transportation information will be housed in eStar  No more spreadsheet, faxing, ing forms  Transportation will pull information.
Problem of the Week! Delvin exercised 3 days each week. He ran 2 miles on his treadmill, rode his bike for 30 minutes and lifted weights for 15 minutes.
Teachers: If you hand back Test 4 today, tell your class you will review it with them in class on Thursday when you do the review lecture on Chapters 6,
1 1.Log in to the computer in front of you –Temp account: 210class / 2.Update your in Cascadia's system –If I need to you I'll use.
Instructor: Alexander Stoytchev CprE 281: Digital Logic.
Data Analytics – ITWS-4963/ITWS-6965
ITIS 2110 Lab #6 Team Project.
Week 1 Gates Introduction to Information Technology cosc 010 Week 1 Gates
Data Science – ITEC/CSCI/ERTH-4350/6350
Data Analytics – ITWS-4600/ITWS-6600/MATP-4450
Peter Fox Data Science – ITWS/CSCI/ERTH 4350/6350 Module 2, Fall 2017
These slides are for reference only. They are not "lecture notes"
Presentation transcript:

1 Peter Fox Data Analytics – ITWS-4963/ITWS-6965 Week 3b, February 7, 2014 Lab exercises: datasets and data infrastructure

Assignment 2 – graded in lab. General assignment – read EPI_data, specify a new data subset, create data frames in R and save them into a database In R Studio –Install package – “rmongodb” (activate it) – MongoDB - – couchdb-vs-redishttp://kkovacs.eu/cassandra-vs-mongodb-vs- couchdb-vs-redis 2

Install Start the MongoDB server (with privileges) Use the Mongo command line: mongo or mongodb > help > db > use local #(or test) At this point you could insert new items in the db but we’ll leave that for later > for (var i = 1; i <= 25; i++) db.local.insert( { x : i } ) > db.local.find() 3

Then switch to R or Rstudio Read EPI_data in (again!) Using the slide from the tab in the Excel spreadsheet (reminder in next slide) Create two data frames with: 1.The key indicators from EPI_data (and one independent variable) – I call this dfEPI 2.The weights assigned to each indicator in the EPI “model” and “sub-models” (you can choose the data structures) 4

The model and sub-models 5

Then switch to R or Rstudio Connect to the running DB (MacOS): > mongo = mongo.create(host=" ",db="local") > mongo.is.connected(mongo) > bEPI <- mongo.bson.from.list(as.list(dfEPI)) > mongo.insert(mongo,'dfEPI.EPI',bEPI) #same for the second data frame (weights) > mongo.get.databases(mongo) # similar cmds in mongo > mongo.get.database.collections(mongo,"dfEPI") > cdf=mongo.find.all(mongo,"dfEPI.EPI") > cdf > mongo.destroy(mongo) #when done only 6

Back to MongoDB $ mongodb# command line show dbs use show collections 7

For Assignment Show creation of data frames (in R) Export into MongoDB (in R) Verify that it is there (in mongo) Future – query/read it back, use it. 8

Admin info (keep/ print this slide) Class: ITWS-4963/ITWS 6965 Hours: 12:00pm-1:50pm Tuesday/ Friday Location: SAGE 3101 Instructor: Peter Fox Instructor contact: (do not leave a Contact hours: Monday** 3:00-4:00pm (or by appt) Contact location: Winslow 2120 (sometimes Lally 207A announced by ) TA: Lakshmi Chenicheri Web site: –Schedule, lectures, syllabus, reading, assignments, etc. 9