Results (Accuracy of Low Rank Approximation by iSVD)

Slides:



Advertisements
Similar presentations
A Large-Grained Parallel Algorithm for Nonlinear Eigenvalue Problems Using Complex Contour Integration Takeshi Amako, Yusaku Yamamoto and Shao-Liang Zhang.
Advertisements

Zhen Lu CPACT University of Newcastle MDC Technology Reduced Hessian Sequential Quadratic Programming(SQP)
Statistical perturbation theory for spectral clustering Harrachov, 2007 A. Spence and Z. Stoyanov.
Yafeng Yin, Lei Zhou, Hong Man 07/21/2010
Chapter 28 – Part II Matrix Operations. Gaussian elimination Gaussian elimination LU factorization LU factorization Gaussian elimination with partial.
GPU Virtualization Support in Cloud System Ching-Chi Lin Institute of Information Science, Academia Sinica Department of Computer Science and Information.
st International Conference on Parallel Processing (ICPP)
Automatic Resource Scaling for Web Applications in the Cloud Ching-Chi Lin Institute of Information Science, Academia Sinica Department of Computer Science.
" Characterizing the Relationship between ILU-type Preconditioners and the Storage Hierarchy" " Characterizing the Relationship between ILU-type Preconditioners.
1cs542g-term Notes  Assignment 1 will be out later today (look on the web)
1cs542g-term High Dimensional Data  So far we’ve considered scalar data values f i (or interpolated/approximated each component of vector values.
3D Geometry for Computer Graphics
Dimensionality Reduction
Reconfigurable Application Specific Computers RASCs Advanced Architectures with Multiple Processors and Field Programmable Gate Arrays FPGAs Computational.
Network and Grid Computing –Modeling, Algorithms, and Software Mo Mu Joint work with Xiao Hong Zhu, Falcon Siu.
Programming Tools and Environments: Linear Algebra James Demmel Mathematics and EECS UC Berkeley.
Dimensionality Reduction. Multimedia DBs Many multimedia applications require efficient indexing in high-dimensions (time-series, images and videos, etc)
1cs542g-term Notes  Extra class next week (Oct 12, not this Friday)  To submit your assignment: me the URL of a page containing (links to)
On Anomalous Hot Spot Discovery in Graph Streams
Numerical Linear Algebra IKI Course outline Review linear algebra Square linear systems Least Square Problems Eigen Problems Text: Applied Numerical.
© Fujitsu Laboratories of Europe 2009 HPC and Chaste: Towards Real-Time Simulation 24 March
1 Jack Dongarra University of Tennesseehttp://
Algorithms for a large sparse nonlinear eigenvalue problem Yusaku Yamamoto Dept. of Computational Science & Engineering Nagoya University.
Improved pipelining and domain decomposition in QuickPIC Chengkun Huang (UCLA/LANL) and members of FACET collaboration SciDAC COMPASS all hands meeting.
Geometric Mean Decomposition and Generalized Triangular Decomposition Yi JiangWilliam W. HagerJian Li
Fast Low-Frequency Impedance Extraction using a Volumetric 3D Integral Formulation A.MAFFUCCI, A. TAMBURRINO, S. VENTRE, F. VILLONE EURATOM/ENEA/CREATE.
Using Partitioning in the Numerical Treatment of ODE Systems with Applications to Atmospheric Modelling Zahari Zlatev National Environmental Research Institute.
4.2.1 Programming Models Technology drivers – Node count, scale of parallelism within the node – Heterogeneity – Complex memory hierarchies – Failure rates.
Chengjie Sun,Lei Lin, Yuan Chen, Bingquan Liu Harbin Institute of Technology School of Computer Science and Technology 1 19/11/ :09 PM.
Yang Liu Shengyu Zhang The Chinese University of Hong Kong Fast quantum algorithms for Least Squares Regression and Statistic Leverage Scores.
PDCS 2007 November 20, 2007 Accelerating the Complex Hessenberg QR Algorithm with the CSX600 Floating-Point Coprocessor Yusaku Yamamoto 1 Takafumi Miyata.
“DECISION” PROJECT “DECISION” PROJECT INTEGRATION PLATFORM CORBA PROTOTYPE CAST J. BLACHON & NGUYEN G.T. INRIA Rhône-Alpes June 10th, 1999.
PpOpen-HPC Open Source Infrastructure for Development and Execution of Large-Scale Scientific Applications with Automatic Tuning (AT) Kengo Nakajima Information.
Database Systems Carlos Ordonez. What is “Database systems” research? Input? large data sets, large files, relational tables How? Fast external algorithms;
On the Use of Sparse Direct Solver in a Projection Method for Generalized Eigenvalue Problems Using Numerical Integration Takamitsu Watanabe and Yusaku.
Computational Aspects of Multi-scale Modeling Ahmed Sameh, Ananth Grama Computing Research Institute Purdue University.
International Exascale Software Co-Design Workshop: Initial Findings & Future Plans William Tang Princeton University/Princeton Plasma Physics Lab
October 2008 Integrated Predictive Simulation System for Earthquake and Tsunami Disaster CREST/Japan Science and Technology Agency (JST)
Operations Research The OR Process. What is OR? It is a Process It assists Decision Makers It has a set of Tools It is applicable in many Situations.
Web Computing and Scientific Software development Tung-Han Hsieh ( 謝東翰 ) ‏ Assistant Technician Research Center for Applied Sciences, Academia Sinica.
Linear Algebra Libraries: BLAS, LAPACK, ScaLAPACK, PLASMA, MAGMA
23/5/20051 ICCS congres, Atlanta, USA May 23, 2005 The Deflation Accelerated Schwarz Method for CFD C. Vuik Delft University of Technology
Linear Algebra Operators for GPU Implementation of Numerical Algorithms J. Krüger R. Westermann computer graphics & visualization Technical University.
 Multivariate Numerical Integration Rida Assaf Western Michigan University
C OMPUTATIONAL R ESEARCH D IVISION 1 Defining Software Requirements for Scientific Computing Phillip Colella Applied Numerical Algorithms Group Lawrence.
Performance of BLAS-3 Based Tridiagonalization Algorithms on Modern SMP Machines Yusaku Yamamoto Dept. of Computational Science & Engineering Nagoya University.
Linear Algebra Libraries: BLAS, LAPACK, ScaLAPACK, PLASMA, MAGMA Shirley Moore CPS5401 Fall 2013 svmoore.pbworks.com November 12, 2012.
Incremental Reduced Support Vector Machines Yuh-Jye Lee, Hung-Yi Lo and Su-Yun Huang National Taiwan University of Science and Technology and Institute.
Intro to Scientific Libraries Intro to Scientific Libraries Blue Waters Undergraduate Petascale Education Program May 29 – June
National Taiwan University Department of Computer Science and Information Engineering An Approximation Algorithm for Haplotype Inference by Maximum Parsimony.
Hybrid Parallel Implementation of The DG Method Advanced Computing Department/ CAAM 03/03/2016 N. Chaabane, B. Riviere, H. Calandra, M. Sekachev, S. Hamlaoui.
Generalization Performance of Exchange Monte Carlo Method for Normal Mixture Models Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
SketchVisor: Robust Network Measurement for Software Packet Processing
55:148 Digital Image Processing Chapter 11 3D Vision, Geometry
A survey of Exascale Linear Algebra Libraries for Data Assimilation
Xing Cai University of Oslo
Challenges in Electromagnetic Modeling Scalable Solvers
Tohoku University, Japan
A computational loop k k Integration Newton Iteration
Texas Instruments TDA2x and Vision SDK
A Cloud System for Machine Learning Exploiting a Parallel Array DBMS
Innovative Multigrid Methods
CS 179 Project Intro.
Optimizing MapReduce for GPUs with Effective Shared Memory Usage
A Digital Watermarking Scheme Based on Singular Value Decomposition
Numerical Algorithms Quiz questions
A Digital Watermarking Scheme Based on Singular Value Decomposition
Efficient Document Analytics on Compressed Data:
Numerical Computation and Optimization
PHI Research in Digital Science Center
Presentation transcript:

Results (Accuracy of Low Rank Approximation by iSVD) jh170011-DAJ Takahiro Katagiri (Nagoya University) High-performance Randomized Matrix Computations for Big Data Analytics and Applications Background Developing random sketching algorithms with high-performance implementations on supercomputers to compute singular value decomposition (SVD) and linear system (LS) solutions of very large-scale matrices. Few numerical solvers, especially randomized algorithms, are designed to tackle very large-scale matrix computations on the latest supercomputers. . We intend to develop efficient sketching schemes to compute approximate SVD and LS solutions of large-scale matrices. The main idea is to sketch the matrices by randomized algorithms to reduce the computational dimensions and then suitably integrate the sketches to improve the accuracy and to lower the computational costs. We intend to implement the proposed algorithms on supercomputers. One essential component of this project is to develop effective automatic software auto-tuning (AT) technologies, so that the package can fully take advantage of the computational capabilities of the target supercomputers that include CPU homogeneous and CPU-GPU heterogeneous parallel computers. Members Takahiro Katagiri (Nagoya U., Japan) : AT (ppOpen-AT), parallel eigenvalue algorithms, and supercomputer implementations. Weichung Wang (National Taiwan U., Taiwan): Numerical linear algebra, parallel computing, and AT (surrogate-assisted turning). and big data applications. Su-Yun Huang (Institute of Statistical Science, Academia Sinica, Taiwan) : Mathematical statistics and machine learning (random sketching algorithm). Kengo Nakajima (U. Tokyo, Japan) : Parallel algorithms in numerical iterative method (hybrid MPI/OpenMP execution). Osni Marques (LBNL, USA) : Eigenproblem and its implementation (LAPACK, SVD algorithms). Feng-Nan Hwang (National Central U., Taiwan) : Eigenproblem and its parallelization (SLEPc, SVD algorithms) Toshio Endo (TITECH, Japan) : System software (optimizations for hierarchical memory and adaptation of its AT) (Collaborator) Akihiro Ida (U. Tokyo, Japan): Providing matrices by H-Matrix iSVD Algorithm Research Plan Year 1 (FY2016): Algorithm development and testing environments deployment. (A prototyping) Year 2 (FY2017): Large-scale implementation and software integrations. Year 3: Auto-tuning of large-scale codes and tests of applications. Rank-k SVD [By Ting-Li Chen, Su-Yun Huang, Hung Chen, David Chang, Chen-Yao Lin, and Weichung Wang] Test Problem (By Prof. Ida at U. Tokyo) Results (Accuracy of Low Rank Approximation by iSVD) ⇒If you accept accuracy of O(2E-02), computation complexity is reduced to O(1/1003) = O(1/1,000,000)