Data transfer on manycore processors for high throughput applications

Slides:



Advertisements
Similar presentations
The e-Science Institute Dr Anna Kenway, Deputy Director September 2005.
Advertisements

Multi-core and tera- scale computing A short overview of benefits and challenges CSC 2007 Andrzej Nowak, CERN
Introductions to Parallel Programming Using OpenMP
What is PACMAN Training Network? Marie Curie Innovative Doctoral Program hosted by CERN Particle Accelerator Components’ Metrology and Alignment to the.
ESR1: PAVEMENT DESIGN FOR COLD RECYCLED MATERIALS Helena I. Lacalle Jiménez.
Lecture 12 Page 1 CS 111 Online Devices and Device Drivers CS 111 On-Line MS Program Operating Systems Peter Reiher.
ALFA: The new ALICE-FAIR software framework
Scheduling of Tiled Nested Loops onto a Cluster with a Fixed Number of SMP Nodes Maria Athanasaki, Evangelos Koukis, Nectarios Koziris National Technical.
ORIGINAL AUTHOR JAMES REINDERS, INTEL PRESENTED BY ADITYA AMBARDEKAR Overview for Intel Xeon Processors and Intel Xeon Phi coprocessors.
Information Technology Research Areas Alberto Di Meglio – CERN openlab Data acquisition and filteringComputing platforms, data analysis, simulationData.
EIT ICT Labs  ICT innovation is driving transformations in society to improve quality of life  Rapid disruptive ICT innovation is a key driver in the.
New Direction Proposal: An OpenFabrics Framework for high-performance I/O apps OFA TAC, Key drivers: Sean Hefty, Paul Grun.
Core Skills for a Digital Economy
Motivation “Every three minutes a woman is diagnosed with Breast cancer” (American Cancer Society, “Detailed Guide: Breast Cancer,” 2006) Explore the use.
GPU Programming with CUDA – Accelerated Architectures Mike Griffiths
IPlant Collaborative Tools and Services Workshop iPlant Collaborative Tools and Services Workshop Collaborating with iPlant.
ICE-DIP project Parallel processing on Many-Core processors ICE-DIP introduction at Intel › 22/7/2014.
ALICE Electronic Logbook MEST-CT Vasco Barroso PH/AID.
High performance I/O with the ZeroMQ (ØMQ) messaging library thematic CERN School of Computing Aram Santogidis › May 2015.
Computing Labs CL5 / CL6 Multi-/Many-Core Programming with Intel Xeon Phi Coprocessors Rogério Iope São Paulo State University (UNESP)
Boosting Event Building Performance Using Infiniband FDR for CMS Upgrade Andrew Forrest – CERN (PH/CMD) Technology and Instrumentation in Particle Physics.
The WRF Model The Weather Research and Forecasting (WRF) Model is a mesoscale numerical weather prediction system designed for both atmospheric research.
Taking the Complexity out of Cluster Computing Vendor Update HPC User Forum Arend Dittmer Director Product Management HPC April,
Work Package 5 Data Acquisition and High Level Triggering System Jean-Christophe Garnier 3/08/2010.
WP1 WP2 WP3 WP4 WP5 COORDINATOR WORK PACKAGE LDR RESEARCHER ACEOLE End of Project 15 TH SEPTEMBER 2012 This research project has been supported by a Marie.
ICE-DIP Mid-term review Data Transfer WP4a - ESR4: Aram Santogidis › 16/1/2015.
ACEOLE Review Early Stage Researcher, WP5 Dan Octavian SAVU.
Exciting New Technologies Being Researched in CERN openlab V Fons Rademakers CERN openlab CTO.
Automating and Optimizing Data Transfers for Many-core Coprocessors Student: Bin Ren, Advisor: Gagan Agrawal, NEC Intern Mentor: Nishkam Ravi, Yi Yang.
Yang Yu, Tianyang Lei, Haibo Chen, Binyu Zang Fudan University, China Shanghai Jiao Tong University, China Institute of Parallel and Distributed Systems.
A successful public- private partnership Bob Jones head of CERN openlab.
A successful public- private partnership Alberto Di Meglio CERN openlab Head.
Marie Curie Big-DATA Proposal Bob Jones CERN IT Department.
Data Plane Computing System CERN Openlab Technical Workshop 5-6th November 2015 Lazaros Lazaridis › 05/11/2015.
OpenMP Runtime Extensions Many core Massively parallel environment Intel® Xeon Phi co-processor Blue Gene/Q MPI Internal Parallelism Optimizing MPI Implementation.
Martin Kruliš by Martin Kruliš (v1.1)1.
Current activities and short term plans 24/04/2015 P. Hristov.
ICE-DIP Project: Research on data transport for manycore processors for next generation DAQs Aram Santogidis › 5/12/2014.
A successful public- private partnership Alberto Di Meglio CERN openlab Head.
Native Computing & Optimization on Xeon Phi John D. McCalpin, Ph.D. Texas Advanced Computing Center.
CHEP 2010, October 2010, Taipei, Taiwan 1 18 th International Conference on Computing in High Energy and Nuclear Physics This research project has.
A successful public- private partnership Maria Girone CERN openlab CTO.
Martin Kruliš by Martin Kruliš (v1.1)1.
Shared memory and message passing revisited in the many-core era 1 iCSC2016, Aram Santogidis, CERN Shared memory and Message passing revisited in the many-core.
Parallel OpenFOAM CFD Performance Studies Student: Adi Farshteindiker Advisors: Dr. Guy Tel-Zur,Prof. Shlomi Dolev The Department of Computer Science Faculty.
2014 Heterogeneous many cores for medical control: Performance, Scalability, and Accuracy Madhurima Pore, Arizona State University October 10,2014 #GHC14.
Collaboration Board Meeting 11 March 2016 Alberto Di Meglio CERN openlab Head.
A successful public-private partnership
Intel Many Integrated Cores Architecture
NFV Compute Acceleration APIs and Evaluation
2nd GEO Data Providers workshop (20-21 April 2017, Florence, Italy)
Knowledge Sharing and Innovation
FPGAs for next gen DAQ and Computing systems at CERN
Introduction to Parallel Computing: MPI, OpenMP and Hybrid Programming
Modern supercomputers, Georgian supercomputer project and usage areas
R. Rastogi, A. Srivastava , K. Sirasala , H. Chavhan , K. Khonde
A successful public-private partnership
A successful public-private partnership
OCR on Knights Landing (Xeon-Phi)
High-performance tracing of many-core systems with LTTng
Marie Curie Research Training Networks Mid-Term Review Meeting
Mid-term review presentation 3rd August 2010
Update on Spanish Recruitment: Students, Staff, Fellows, Associates
Alessandra Luchetti Deputy Head of Unit
Development and Maintenance of CMS ElogBook
IXPUG Abstract Submission Instructions
Mattan Erez The University of Texas at Austin
IBM Power Systems.
<Title> <presenter name> <presenter title>
Presentation transcript:

Data transfer on manycore processors for high throughput applications 14/09/2016 ICE-DIP WP4a - ESR4 Aram Santogidis Leader slide change the footnotes

The ICE-DIP Project In this talk I will concentrate how the work done these 3 years connects to: Maynooth University CERN Intel

Intel Xeon Phi Coprocessor Up to 61 Cores PCIe gen2 Peripheral Different computation modes Offloading Symmetric I focused my studies on Intel Xeon Phi Coprocessor codenamed: Knights Corner. I find the symmetric mode particularly attractive since it is quite unique compared to say GPUs where you can use them as offloading engines. The fact that the coprocessor runs a

Online processing overview and my focus

Coprocessor-Host communication in the online processing system

Data transfer libraries for the data acquisition system of the ALICE experiment Instant messaging for computers Helps to create distributed systems Provides good performance Easy to program from non-expert programmers

An opportunity for improvement

CHEP’15 poster contest award

The Trans4SCIF library the Intel Xeon Phi Coprocessor Easy-to-use socket-like interface Send/Recv E.g. up to 3 GB/s data throughput (4x imporovementwith the cost of 32 MB of memory space Exploits cache-aligned RDMA transfers over PCIe ZeroMQ extension for SCIF In principle can be re-used by other RDMA based transports (e.g OmniPath)

Outreach and dissemination Publication A. Santogidis, A. Hirstius, and S. Lalis. “Optimizing the transport layer of the ALFA framework for the Intel Xeon Phi Coprocessor” Proceedings of the 21st International Conference on Computing in High Energy and Nuclear Physics, April 2015, Okinawa, Japan, 2015. Many talks were given to diverse audiences and places CHEP’15, Okinawa, Japan Augmented reality lab, Hong Kong inverted CERN School of Computing, Geneva thematic CERN School of Computing, Split Some more are planned for the immediate future Huawei Labs, Paris Undergraduate students of University of Thessaly, Volos, Greece

Acknowledgements Many thanks to ICE-DIP and openlab colleagues for their support. Also thanks and regard to my 6! supervisors. Andrzej Nowak, Andreas Hirstius, Olof Barring, Fons Rademakers, Spyros Lalis, Bryan Hennelly. This research project has been supported by a Marie Curie Early European Industrial Doctorates Fellowship of the European Community's Seventh Framework Programme under contract number (PITN-GA-2012-316596-ICE-DIP).