Midterm Review CSE4/587 B.Ramamurthy 4/8/2019 4/8/2019 B.Ramamurthy

Exam Date March 5, 2013 Please bring This is a closed book exam. Pencils, pens and erasers. This is a closed book exam. You are allowed on 8X11 size page of information written or prepared by you. No calculators/phones. Arrive on time, no extra time will be given if you arrive late 4/8/2019 4/8/2019 B.Ramamurthy B.Ramamurthy 2

Topics Defining data intensive computing ( as in Fourth Paradigm: up to p.19) Enabling Technologies (ET): ET1: Web service ET2: Special data structures and algorithms MapReduce model: components: Mapper, Reducer, Partitioner, Combiner; Execution framework , shuffle and sort Hadoop (HDFS) : as in yahoo site: Ch1, 2, 4; http://developer.yahoo.com/hadoop/tutorial/index.html Problem solving with MR: Chapter 1-4 in Lin and Dryer’s text Tom White analysis of web log (Don’t ask me for the handout, go find it) 4/8/2019 4/8/2019 B.Ramamurthy B.Ramamurthy 3

Questions Defining data-intensive computing: J. Gray Given a problem solve it using MR Given a MR provide, provide a numerical example trace Best practices and design patterns described in the Lin&Dryer text Hadoop (HDFS) architecture Functions of various MR modules 4/8/2019 B.Ramamurthy

How to study? Make a list of all material to study. Study the material Practice writing pseudo code for the MRs Use block diagrams and numerical examples when necessary 4/8/2019 B.Ramamurthy