FP7-People-IAPP-2012 FTK - Project number: Paola Giannetti – INFN & University of Pisa 1 st EU Mid-Term Review meeting Brussels, November 7 th, Report OUTLINE: Our Research Goals Scientific Results Transfer of Knowledge & Networking Impact Management 1

2

Tracking & High quality Real Time Image Reconstruction based on Pattern Matching (PM) We can filter out relevant objects in natural images: fast-precise edge detector Like low level-brain processing of vision We can filter out the Higgs event in ~100  secs Outside HEP In High Energy Physics (HEP) 3

Scientific reason: collect very high statistic samples to study the Higgs properties Technological reason : highly parallelized and pipelined embedded systems in place of general purpose computers; new, computing technologies  hardware built on the algorithm Socio-economic reason: study to apply Real time Pattern Matching to general image processing; possible future applications: medical images, satellite or video camera’s images, monument’s or faces data bases. 4

ATLAS Silicon tracker WP6 ATLAS p The Event p Bunch Crossing The DETECTOR: photos to Bunch Crossings P P WP1,2,3,4

LOW Level: HW dedicated processors Low-resolution & fast decision High event rate HIGH Level: CPU farms High-resolution lower and lower event rate L1 HLT

Very limited space for dedicated HW in ATLAS trigger baseline After 15 years of discussions & studies a new addition, a second generation TRACKER

Higgs  2 b-jets 60% of the whole production Soft jets, hard to be selected in real time FTK allows: to identify soft jets with high efficiency to identify b-quark decay in real time To identify the primary vertex p p 200  m b

The Event... The Pattern Bank We need a Highly Parallelized Comparison Solution: The Associative Memory (AM) The AMchip BUT: Pattern Matching used at LOW Resolution Solution: HIGH resolution Track Fitting executed inside found patterns

Pattern Bus_layer0 Bus_layer1 Bus_layer2 …….. Bus_layer7 layer0 layer1 layer2 layer7 pattern0 pattern1 pattern2 pattern3 layer0 layer1 layer2 layer7 Associative Memory (AM) …. Each pattern: 8x16 bits comparator Each 10 ns: 128 kpat x8 = 1 M comparisons …. Detector Layers L0 L1 L2 ….. L7

FTK IAPP TASKS: CLUSTERING PM BOARD

Detector Front End PU AUX CARD AMBSLP LAMBSLP To DAQ memories GLOSSARY for WP1, WP2, WP3 & WP4 IN OUT AMBSlim AMBFTK AMBSLP 3 generations of AM boards For Test stand Validation For early Integration WP2 For WP1: design of a new prototype Processing Unit Serial Link Processor FTK_IM (IAPP) on Data Formatter SLP2 & SLP1

WP1 - PRIELE Prototype Production WP2 - CAEN Infrastructure & Integration WP3 - CERN Commissioning WP4 - UNIPI Architecture Simulation WP5 - UNIPI Natural image processing WP6 - CNRS Silicon Detector R&D WP7 - AUTH Outreach WP8 -AUTH Workshops & Trainings Spin-off Outside HEP RESEARCH Inside HEP DISSEMINATION – OUTREACH - TRAININGS

2013: WP2 Integration of AMBFTK at CAEN…while…WP1 SLP2 Design at UNIPI-PRIELE-AUTH & LAMBFTK & AMCHIP04 AMBSLP & LAMBSLP & AMchip05 September 2013July 2014 AMchip04 FTK_IM integration Not possible in 2014 because AMchip05 delay Not Muon Trigger WP5 WP6 AUX CARD M20: choose between AMBFTK and AMBSLP

GREEK TEAM CAEN UNIPI CERN PRIELE AUTH ITALIAN TEAM HW, FW, SW all merged in a single test Cooling Setup

First one: 2-D cluster finding with sliding window technique & centroid calculation Spartan6 Award at Tipp 2014 Highly parallelized algorithm

Second one: R&D for phase II, the new FTK Processing Unit for 2020 applications, SLP1 ATCA AMboard DONE Future developments Presented at TIPP 2014 A compact Computing Unit AMSIP Large AMOUNT OF LOGIC with very HIGH PERFORMANCES in a SINGLE FPGA!

1.Setup for pixel detector analysis with CAEN modules: ready (see Calderini talk). Important ToK to CAEN to increase its product competitiveness for Phase II 2.Important ToK for SLP2 and SLP1 past 2020 evolution. 3.Smart detector design: algorithms like our 2-D clustering could be inserted directly in the silicon detectors.

GOAL  transfer of competencies to new teams (PRIELE, CAEN and AUTH)  reinforce the original group (UNIPISA, CNRS and CERN) for: Production – Commissioning - Maintenance New applications and developments (Level 1 applications, spin off). WP1- Design and Test of SLP2- Interest of PRIELE for production assembly Cadence Board design: UNIPI –PRIELE- CERN ToK  Sakellariou from PRIELE at UNIPI Firmware development: UNIPI –PRIELE, PRIELE –AUTH ToK  Dimas from PRIELE at UNIPI & AUTH, Panos from AUTH at PRIELE Test stand installation: UNIPI –PRIELE-AUTH ToK  Piendibene, Donati from UNIPI at PRIELE Software development: UNIPI –PRIELE ToK  Donati at PRIELE & Mermikli from PRIELE at UNIPI WP2-WP4-WP6 - Infrastructures and relative tests at CAEN. CAEN interest for maintenance 2 tests stands activated  ToK of Piendibene(UNIPI)-Crescioli(CNRS) and Calderini(CNRS) at CAEN Integration AMBFTK & AMBSLP  ToK of Kostas(AUTH)-Piendibene(UNIPI)-Crescioli(CNRS) at CAEN Infrastructures: Power Supply design, cooling tests  ToK of Piendibene(UNIPI)-Petrucci at CAEN FTK_IM integration  ToK of Sotiropoulou(AUTH) at CAEN and Kimura(AUTH) at CERN) SLP1 architecture study  ToK of Gentsos(AUTH) – Crescioli(CNRS) at CAEN Simulation for tests  ToK of Volpi(UNIPI) – Sampsonidis(AUTH) at CAEN)

UNIPISA - WP4 Simulation: G. Volpi, the responsible of FTKSIM, the most expert on this field CNRS - WP6 R&D for silicon detectors: R. Beccherle, one of the designer of ATLAS pixel Front End, has participated to the ATLAS pixel commissioning, very expert on this field AUTH – WP1, WP3, WP4: N. Kimura, in FTK since many years, expert of simulation, board design and test, commissioning Recruitment strategy Procedures followed the European Charter for researchers and the Code of Conduct for their Recruitment. Only for AUTH recruitment enough valid applications were available to produce a short list. Short- listed candidates have been invited for an interview made by skype. In the other two cases only one candidate had a pertinent curriculum. See the official report and recruitment detailed documents collected in the web protected area (user: ftk-iapp, pass: ftk-iapp2013)

Petrucci Left CAEN

Iovene

3 times per year management events, General Assemblies and Executive Boards: update about the project advancements. Plan and results were discussed. Skype available Executive Board and General Assembly Meetings Kickoff Meeting, Pisa, March 11, 2013 Agenda and talks, MinutesAgenda and talksMinutes Pisa, November 5, Alexandroupolis Meeting, Alexandroupolis, March 10, 2014 Agenda and talks, MinutesAgenda and talks Executive Board Meetings Pisa, June 27, 2013 Agenda and talks, MinutesAgenda and talksMinutes Pisa, July 21, 2014 Agenda and talks, MinutesAgenda and talksMinutes Once per year we had the FTK Workshop, an opportunity for FTK researchers presentations: (1) ( In 2013 was in Pisa (2) in 2014 was in Alexandroupolis. Skype Technical weekly meetings since the beginning for WP1 and WP2, in 2014 for WP3, WP4.

FTK kick-off Workshop; 11-12/03/2013 – UNIPI; ~ 8 external participants from FTK as teachers, (D8.1_2014). FTK session during the TDAQ week; 04/12/2013- CERN; ~20 participants (actually 2/3 per year of such sessions with TDAQ and Upgrade communities in ATLAS) ISOTDAQ 2013; 01-08/2/2013 – AUTH; ~80 participants; FTK talk in ISOTDAQ 2014; FTK session during HiPEAC Computing Systems Week in Athens; 09/10/2014 – AUTH; ~20 participants; FTK open Workshops IAPP Workshop: FTK session during MOCAST 2013; 14-15/3/2014 – AUTH; ~80 participants; (D7.2_2014). IAPP Workshop, Pisa, July Workshop day “LHC e l’ago nel paglaiio”. ~15 participants; (D7.2_2013).

FTK Schools Bootcamp on Scientific Software, Pisa, June 5-June 6, cooperation with Mozilla Science Lab ( ) for 40 persons; a two days hand-on camp aimed at improving the software scientific skills of students in physics, engineering and computing science majors. A third day included an FTK session with talks visits to the FTK laboratory organized in small groups (D7.3_2014). VHDL Design, Pisa, Italy, July 1 - July 4, Complete by steps a simple project. Lessons during the morning and exercises immediately after, each afternoon (D7.3_2013). FTK Open Days IAPP Open Day in Pisa “Open Day della Ricerca”, April in Piazza Cavalieri. FTK has provided posters, boards and chips to the UNIPI stand, to communicate to students and very generic public, about Trigger importance for difficult discoveries in High Energy Physics, powerful modern electronics importance. Shifts to have at least two present teachers (D7.1_2014). IAPP Open Day “Congressino di Fisica” One day of seminars and poster session, April , Aula Magna Edificio E, Area Pontecorvo, Pisa. ( FTK has provided posters and communicated its research goals and methodology to students (D7.1_2013). The Project WEB Site: for the Public and the Networkhttp://ftk-iapp.physics.auth.gr/

“The AM system”: kick-off at UniPisa, for dissemination inside the. Hands-on activity in Lab. Three days training (see D8.1&8.2_2013_FTK_wUNIPI&TrUNIPI.pdf) "Embedded System Design Using FPGA Technology", "VHDL Verification Techniques" and "Design Exploiting FPGA Resources" with lab sessions, at AUTH. Two days training (see D8.2_2014_AUTH_Training.pdf). “Silicon Photomultiplier read out-SIPM”, “Past experience at LHC”, “Overview of EU projects” at CAEN. One afternoon training (see D8.2_2013_CAEN_Training.pdf), open to external people. “Overview of a successful PRIELE project: Laros” at PRIELE, October 7 Athens. One day training (see D8.2_2014_CAEN_Training.pdf). SOFT TRAININGS via skype to allow the maximum participation. 1.Language Trainings (a) 2 months Italian course for Mermikli and Sakellariou; (b) 4 months Italian course for Gentsos; (c) 10 private lessons for Sampsonidis; 2.Security & Safety at work. Half day training about the employer’s and employee’s responsibility to adhere to the legislation. Health, safety and security procedures. 3.Communication Training. Half day communication skills, dissemination, planning 4.Management training - Half day on Horizon 2020 opportunities. 5.HiPEAC training - 2 hours seminar: Embedded System organizations opportunities.

International conferences and workshops - FTK researchers disseminate achieved results. RD 2013RD 2013, Florence, Italy, July "Variable resolution Associative Memory optimization and simulation for the ATLAS Fast Tracker project", C. Luongo, Slides, Paper.SlidesPaper 2."The Associative Memory for the FTK processor at ATLAS", S. Citraro, Slides, Paper.SlidesPaper ICATPP 2013ICATPP 2013, Como, Italy, September "The Associative Memory system for the FTK processor at ATLAS", D. Magalotti, Slides, Paper.Slides Paper 2."A Multi-Core FPGA-Based 2D-Clustering Algorithm for high-throughput data intensive applications", C.-L. Sotiropoulou, Slides, Paper.SlidesPaper 3."Variable resolution AM for the FTK ATLAS upgrade", A. Annovi Slides.Slides IEEE NSS 2013IEEE NSS 2013, Seoul, Corea, October "A Multi-Core FPGA-Based Clustering Algorithm for Real-Time Image Processing", C.-L. Sotiropoulou Poster, Paper.PosterPaper 2."The AM Boards for the FTK Processor at ATLAS", A. Lanza Poster ppt, Paper.Poster pptPaper 3."Next generation Associative Memory devices for the FTK tracking processor of the ATLAS experiment", F. Crescioli Slides, Paper.SlidesPaper 4."Variable resolution pattern generation for the Associative Memory of the ATLAS FTK project", A. Annovi Poster,Poster TWEPP 2013TWEPP 2013, Perugia, Italy, September "Next generation Associative Memory devices for the FTK tracking processor at ATLAS ", M. Beretta Poster ATL-DAQ-SLIDE ppt, Paper.Poster ATL-DAQ-SLIDE pptPaper 2."Design of a hardware track finder (Fast TracKer) for the ATLAS trigger", G. Volpi Slides ppt, Paper.Slides pptPaper

Papers on peer review Journals 1.C.-L. Sotiropoulou, et al. “A Multi-Core FPGA-based 2D-Clustering Implementation for Real- Time Image Processing”, accepted for publication in IEEE Transactions on Nuclear Science. RT 2014RT 2014, Nara, Japan, May "Associative Memory computing power and its simulation"C. Luongo Poster SlidesPosterSlides 2."A Highly Parallel FPGA Implementation of a 2D-Clustering Algorithm for the ATLAS Fast Tracker (FTK) Processor", N. Kimura Slides PaperSlidesPaper TIPP 2014TIPP 2014, Amsterdam, The Netherlands, June "The Serial Link Processor for the Fast TracKer (FTK) at ATLAS", P. Luciano Slides PaperSlidesPaper 2."Future Evolution of the FTK Processing Unit", C. Gentsos Slides PaperSlidesPaper 3."A High Performance Multi-Core FPGA Implementation for 2D Pixel CLustering for the ATLAS Fast TracKer (FTK) Processor", C.-L. Sotiropoulou Slides Paper –SlidesPaper AWARD Best Presentation WIT 2014WIT 2014, University of Pennsylvania, May "A Parallel FPGA Implementation for Real-Time 2D Pixel Clustering for the ATLAS Fast Tracker (FTK) Processor", S. Gkaitatzis Slides PaperSlidesPaper 2."The Serial Link Processor for the Fast TracKer (FTK) at ATLAS", V. Liberali Slides PaperSlidesPaper WASC 2014WASC 2014, Workshop on the Architecture of Smart Cameras, Pisa, Italy, June 2014 "The FP7-IAPP-FTK project: real-time image reconstruction exported from High Energy Physics to the A.I. field", S. Citraro SlidesSlides HSTD 2013, Hiroshima, Japan. 1-5 September 2013 “Achievements of the ATLAS Upgrade Planar Pixel Sensors R&D Project”, G. Calderini

Each fellow has developed his own plan, discussed and signed by the Supervisor: Personal trainings have been provided to favour the personal desired specialization, complementary skills 1.F. Crescioli: Analyse bioinformatique des sequences nucleiques et proteiques; Paris, September 2014 (22 Hours on Biologie Moleculaire) – 2.M. Piendibene: Accelerate System Performance with ALTERA SoC, presso INFN sez. Pisa (Esterno), May 2014, (32 Hours on Altera FPGA SoC). 3.C. Gentsos: 1.Dvcon Europe, Munich, October Avnet X-Fest workshop in Milan, October 21 4.R. Beccherle: 1.Cadence training, Milan, May 2914 Lasting collaborations: we are preparing the team that, after having built FTK, will have to provide (a) mantainance, (b) data taking, (c) upgrades (d) dissemination of the technology for further applications..... A LONG COMMON STORY In addition we plan to apply again for funds, together Large impact on Real Time technology inside HEP

Steering Committee (Annex I terminology) = General Assembly (our terminology): responsible of financial management and dissemination issues. Consultant in the researchers selection M. Dell'Orso - UNIPI, Italy (Chair) K. Kordas - AUTH, Greece A. Iovene - CAEN, Italy G. Calderini - CNRS, France B. Magnin - CERN, Switzerland P. Soukoulias - PRIELE, Greece S. Donati - UNIPI, Italy (rep of seconded/recruited people) C.L. Sotiropoulou - AUTH, Greece (gender officer) left August 1, 2014). C. Roda - UNIPI, Italy (gender officer since August 1, 2014) Scientific Board (Annex I terminology) = Executive Board (our terminology): 1.to ensure the implementation of the network’s scientific and training program 2.to monitor the progress of the research teams 3.to ensure good communication and exchange of information among the teams 4.to be responsible for the recruitment process in consultation with the SC. M. Dell'Orso - UNIPI, Italy (chair) K. Kordas (WP7 leader)- AUTH, Greece D. Sampsonidis (WP8 leader)- AUTH, Greece P. Garosi(WP2 leader) – CAEN S.p.A., Italy F. Crescioli (WP6 leader)- IN2P3, CNRS, France A. Sakellariou (WP1 leader)- PRIELE, Greece M. Piendibene (WP5 leader)- UNIPI, Italy C. Roda (WP4 leader)- UNIPI, Italy (gender officer since August 1, 2014) B. Magnin (WP3 leader)- CERN, Switzerland C.L. Sotiropoulou - AUTH, Greece, (gender officer), left August 1, 2014

Gender aspects Secondment’s and recruitment’s implementation The consortium requested many changes. The ones believed important were approved by the network and submitted to REA. All the approved ones are motivated by unexpected conditions: 1.FTK schedule inside ATLAS changed a lot with respect 2012, Annex 1 time. We had to adjust secondments to the experiment plans. 2.Many substitutions of researchers were necessary, in particular in Greece, where the economic difficulties constraint people to changes. 3.ERs substitutions by ESR provided some extra money. We asked this extra money for younger researcher’s opportunities, particularly important for FTK that misses manpower. 4.PRIELE company had unexpected requests of deliveries of material,  unexpected difficulties to the company  secondments from PRIELE were moved and split when necessary. 5.Our inexperience caused delays: lot of unexpected administrative difficulties, like the interaction with “Corte dei Conti” in Italy that has to approve contracts, visa problems….. However, all changes where submitted to REA and approved.

The EU funds helped enormously our project, at the level that we think we couldn’t have meet the ATLAS program without them. Our collaboration could learn a lot and we are satisfied of our results. We hope to be in line with REA expectations for these two first years and we hope to be better with REA suggestions in the next two. We thanks very much EU for providing us this great scientific/human opportunity