D4M for Julia Alex Chen.

Slides:

Advertisements

Similar presentations

Chapter 1: INTRODUCTION TO DATA STRUCTURE

Advertisements

Chansup Byun, William Arcand, David Bestor, Bill Bergeron, Matthew Hubbell, Jeremy Kepner, Andrew McCabe, Peter Michaleas, Julie Mullen, David O’Gwynn,

Data Analytics and Dynamic Languages Lee E. Edlefsen, Ph.D. VP of Engineering 1.

Chapter 7 Matrix Mathematics Matrix Operations Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display.

Chapter 3 Data Structures and Abstract Data Type Dr. Bernard Chen Ph.D. University of Central Arkansas Fall 2008.

D4M – Signal Processing On Databases

Alan Edelman, Jeff Bezanson Viral Shah, Stefan Karpinski Jeremy Kepner and the vibrant open-source community Computer Science & AI Laboratories Novel Algebras.

Introduction to Computational Thinking Vicky Chen.

Copyright © 2006 The McGraw-Hill Companies, Inc. Permission required for reproduction or display. 1 Chapter 2.

__Understands and applies base 10 grouping system __Can compose and decompose numbers up to 100 __Makes reasonable estimates __Is independent with partial.

OBJECT-ORIENTED PROGRAMMING (OOP) WITH C++ Instructor: Dr. Hany H. Ammar Dept. of Electrical and Computer Engineering, WVU.

Multiplication BY:TAJZHAY AND JULIA CLENDANIEL.  First, you have to line your numbers up,  Second you have to multiply in the ones place,  Third you.

J-PARC Trace3D Upgrades Christopher K. Allen Los Alamos National Laboratory.

3 x 3 Determinants A Short Cut Method By Dr. Julia Arnold.

ICC Module 3 Lesson 1 – Computer Architecture 1 / 6 © 2015 Ph. Janson Information, Computing & Communication Computer Architecture Clip 3 – Instruction.

2.5 Properties of Mental Computation. ASSOCIATIVE OF ADDITION DISTRIBUTION COMMUNATIVE OF ADDITION ASSOCIATIVE OF MULTIPLICATION REFLEXIVE.

1 ARTIFICIAL INTELLIGENCE Gilles BÉZARD Version 3.16.

ARRAYS IN C/C++ (1-Dimensional & 2-Dimensional) Introduction 1-D 2-D Applications Operations Limitations Conclusion Bibliography.

1 Post Processing Procedures for Channel Estimation Younglok Kim Dept. of Electrical Engineering Sogang University.

COMPUTER ORGANISATION.. LAB. تنظيم الحاسبات.. عملي

Computer Vision COURSE OBJECTIVES: To introduce the student to computer vision algorithms, methods and concepts. EXPECTED OUTCOME: Get introduced to computer.

Sorting Dr. Yingwu Zhu.

IMPROVEMENT OF NETWORK LIFETIME BY IMPROVING ROUTE DISCOVERY PHASE IN MULTI-PATH DSR USING HYBRID ANT COLONY OPTIMIZATION.

Linear Algebra review (optional)

Course Developer/Writer: A. J. Ikuomola

Programming in R Intro, data and programming structures

Unit 5 Lesson 3: Introduction to Arrays

Chapter 7 Matrix Mathematics

Theme Introduction : Learning from Data

Topics 10: Cache Conscious Indexes

Understanding the Area Model across grade levels

MatLab Programming By Kishan Kathiriya.

EGR 115 Introduction to Computing for Engineers

Lesson 5-15 AP Computer Science Principles

Collaboration Spotting: Visualisation of LHCb process data

Algorithms with numbers (1) CISC4080, Computer Algorithms

Building modular tools for visualizing computation

Algorithm Analysis and Big Oh Notation

Properties of Numbers Use mental math to simplify –2 • 13 • 5.

CS122B: Projects in Databases and Web Applications Winter 2017

Finding a Percent of a Number

Binary Search Binary search. Given value and sorted array a[], find index i such that a[i] = value, or report that no such index exists. Invariant.

Chapter2 Creating Arrays

Section 2.4 Matrices.

PTAS for Bin-Packing.

Merge Sort 1/12/2019 5:31 PM Dynamic Programming Dynamic Programming.

Part I Background and Motivation

Sorting Dr. Yingwu Zhu.

test for not equal. Parallel arrays Two dimensional array.

Merge Sort 1/18/ :45 AM Dynamic Programming Dynamic Programming.

Dynamic Programming Merge Sort 1/18/ :45 AM Spring 2007

CSE 2010: Algorithms and Data Structures Algorithms

Given value and sorted array, find index.

Merge Sort 2/22/ :33 AM Dynamic Programming Dynamic Programming.

Multidimensional array

Project 1 Guidelines.

Project 2 Guidelines.

Algorithm Analysis and Big Oh Notation

Multi-Dimensional Arrays

Introduction to Matlab

Merge Sort 4/28/ :13 AM Dynamic Programming Dynamic Programming.

Linear Algebra review (optional)

Finding a Percent of a Number

Tutorial 6 Array Problem Solving

7.3 Special Products.

Dynamic Programming Merge Sort 5/23/2019 6:18 PM Spring 2008

Arrays and Matrices Prof. Abdul Hameed.

BY:DAMONDRE WILSON AND JAMAL TATE

Presentation transcript:

D4M for Julia Alex Chen

Dynamic Distributed Dimensional Data Model (D4M) A tool for big data analysis designed by Dr Jeremy Kepner (Enabling Composable Analytic Computation on Triple Store data) Computation ex. Logical * ./ + D4M A Associative Array DB table What and Why D4M on Julia?

What is Implemented? ⬤ Assoc() ⬤ CSV Loading/Writing ⬤ Condense ⬤ GetIndex ⬤ Matrix goodies: find, value =, ./ , *, +, sum, transpose … ⬤ Regex Indexing ⬤ Union Assoc ⬤ A few examples from D4M Matlab Implementations What has been done

What is learned? Sorted Algorithms are useful (Case: Matrix Multiply) Identifying and reasoning performance on a developing language is hard. (Case: Addition) Making Module in Julia is easy. Lesson Learned What has been learned

Matrix Multiply sorted_intersect() Implemented

Addition Fix

Difference between sad and fixed? Sad Version … ABA = spzeros(n,n) ABA[Arow,Acol] = At.A ABA[Brow,Bcol] += Bt.A ... Fixed Version … ABA = spzeros(n,n) ABA[Arow,Acol] += At.A ABA[Brow,Bcol] += Bt.A ...