KAGALI PE code development

Slides:



Advertisements
Similar presentations
Introduction to Monte Carlo Markov chain (MCMC) methods
Advertisements

MCMC estimation in MlwiN
July 13th 2012 Leicester XSPEC, Fitting, and Atomic Data Keith Arnaud.
Bayesian Estimation in MARK
Inspiral Parameter Estimation via Markov Chain Monte Carlo (MCMC) Methods Nelson Christensen Carleton College LIGO-G Z.
Brief Explanation of MCMC implementation in lalsuite
Ch 11. Sampling Models Pattern Recognition and Machine Learning, C. M. Bishop, Summarized by I.-H. Lee Biointelligence Laboratory, Seoul National.
CHAPTER 16 MARKOV CHAIN MONTE CARLO
BAYESIAN INFERENCE Sampling techniques
Computing the Posterior Probability The posterior probability distribution contains the complete information concerning the parameters, but need often.
CSE 221: Probabilistic Analysis of Computer Systems Topics covered: Statistical inference.
End of Chapter 8 Neil Weisenfeld March 28, 2005.
CSI Uncertainty in A.I. Lecture 141 The Bigger Picture (Sic) If you saw this picture, what game would you infer you were watching? How could we get.
Using ranking and DCE data to value health states on the QALY scale using conventional and Bayesian methods Theresa Cain.
Introduction to Monte Carlo Methods D.J.C. Mackay.
Bayes Factor Based on Han and Carlin (2001, JASA).
Systematic effects in gravitational-wave data analysis
Parallel implementation of RAndom SAmple Consensus (RANSAC) Adarsh Kowdle.
Material Model Parameter Identification via Markov Chain Monte Carlo Christian Knipprath 1 Alexandros A. Skordos – ACCIS,
Using car4ams, the Bayesian AMS data-analysis code V. Palonen, P. Tikkanen, and J. Keinonen Department of Physics, Division of Materials Physics.
Priors, Normal Models, Computing Posteriors
Mock Data Production, Characteristics, and Confusion Background WG4 f2f – Nice 09/01/10 Tania Regimbau.
Members ❖ LSC 20 Members 6 senior 3 post doctors 4 graduate students 4 technical staffs ❖ KAGRA: LSC plus 4 Senior members HW Lee (data analysis; parameter.
Korean Group 12 th KAGRA face-to-face Meeting August 28, 2015 on behalf Korean Gravitational Wave Group 1.
Lab3: Bayesian phylogenetic Inference and MCMC Department of Bioinformatics & Biostatistics, SJTU.
Bayesian Reasoning: Tempering & Sampling A/Prof Geraint F. Lewis Rm 560:
Hyung Won Lee(Inje), Chunglee Kim(SNU), and Jeongcho Kim(Inje) Nov. 2013, Seoul National University.
MCMC in practice Start collecting samples after the Markov chain has “mixed”. How do you know if a chain has mixed or not? In general, you can never “proof”
1 Tree Crown Extraction Using Marked Point Processes Guillaume Perrin Xavier Descombes – Josiane Zerubia ARIANA, joint research group CNRS/INRIA/UNSA INRIA.
Direct Use of Phase Information in Refmac Abingdon, University of Leiden P. Skubák.
Application of the MCMC Method for the Calibration of DSMC Parameters James S. Strand and David B. Goldstein The University of Texas at Austin Sponsored.
MCMC reconstruction of the 2 HE cascade events Dmitry Chirkin, UW Madison.
Lecture #9: Introduction to Markov Chain Monte Carlo, part 3
Bayesian Travel Time Reliability
J. Jasche, Bayesian LSS Inference Jens Jasche La Thuile, 11 March 2012 Bayesian Large Scale Structure inference.
Reducing MCMC Computational Cost With a Two Layered Bayesian Approach
15-18 Dec 2004Spinning Black Hole Binaries1 Search for Spinning Black Hole Binaries in LIGO/GEO data: The First Steps Speaker: Gareth Jones LSC Inspiral.
Searching for Binary Black Holes with Spin Aligned with Orbital Angular Momentum 1 Deborah L. Hamm – Northern Arizona University LIGO SURF 2013 Mentors:
The Unscented Particle Filter 2000/09/29 이 시은. Introduction Filtering –estimate the states(parameters or hidden variable) as a set of observations becomes.
Bayesian Modelling Harry R. Erwin, PhD School of Computing and Technology University of Sunderland.
LIGO-G9900XX-00-M DMT Monitor Verification with Simulated Data John Zweizig LIGO/Caltech.
Anders Nielsen Technical University of Denmark, DTU-Aqua Mark Maunder Inter-American Tropical Tuna Commission An Introduction.
LIGO-G v1 Searching for Gravitational Waves from the Coalescence of High Mass Black Hole Binaries 2014 LIGO SURF Summer Seminar August 21 st, 2014.
Distributed parallel processing analysis framework for Belle II and Hyper Suprime-Cam MINEO Sogo (Univ. Tokyo), ITOH Ryosuke, KATAYAMA Nobu (KEK), LEE.
LIGO-G09xxxxx-v1 Form F v1 Numerical Simulations of Superkick Binary Black Holes Lydia Nevin Rensselaer Polytechnic Institute LIGO SURF 2014 Mentor:
SEARCH FOR INSPIRALING BINARIES S. V. Dhurandhar IUCAA Pune, India.
A Study on Speaker Adaptation of Continuous Density HMM Parameters By Chin-Hui Lee, Chih-Heng Lin, and Biing-Hwang Juang Presented by: 陳亮宇 1990 ICASSP/IEEE.
Hierarchical Models. Conceptual: What are we talking about? – What makes a statistical model hierarchical? – How does that fit into population analysis?
An Introduction to AD Model Builder PFRP
Generalization Performance of Exchange Monte Carlo Method for Normal Mixture Models Kenji Nagata, Sumio Watanabe Tokyo Institute of Technology.
Markov Chain Monte Carlo in R
Development of KAGRA Burst Pipeline
MCMC Output & Metropolis-Hastings Algorithm Part I
Analysis of LIGO S2 data for GWs from isolated pulsars
ERGM conditional form Much easier to calculate delta (change statistics)
Igor Yakushin, LIGO Livingston Observatory
Simple Instances of Swendson-Wang & RJMCMC
KAGALI PE code development
How to use generateTemplate
Probabilistic Models for Linear Regression
Remember that our objective is for some density f(y|) for observations where y and  are vectors of data and parameters,  being sampled from a prior.
Multidimensional Integration Part I
LISA Data Analysis & Sources
Ch13 Empirical Methods.
Bayesian inference with MrBayes Molecular Phylogenetics – exercise
Search for gravitational waves from binary black hole mergers:
MCMC Inference over Latent Diffeomorphisms
Opinionated Lessons #39 MCMC and Gibbs Sampling in Statistics
Yuta Michimura Department of Physics, University of Tokyo
Stochastic Methods.
Presentation transcript:

KAGALI PE code development Hyung Won Lee, Inje University, 29 August 2017 coll. With Jeongcho Kim(Inje U.), Chunglee Kim(KASI) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Contents Motivation Parameter Estimation with Bayesian Inference Implementation in LALSuite Strategy for KAGALI Development for KAGALI Preliminary test run Discussions 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Motivation Implement MCMC PE for KAGALI Based on LALSuite Minimum full functionality for MCMC Parallel tempered Improvement as many as possible from LALSuite Modularize as much as possible for easy maintenance and readable Test for iKAGRA data 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Parameter Estimation with Bayesian inference ℘ 𝜃 𝑥 = ℘ 𝜃, 𝑥 ℘ 𝑥 = ℘(𝑥|𝜃)℘ 𝜃 ℘(𝑥|𝜃)℘ 𝜃 𝑑𝜃 ℘ 𝜃,𝑥 =℘ 𝑥 𝜃 ℘ 𝜃 =℘ 𝜃 𝑥 ℘ 𝑥 𝜃 : unobservable model parameters 𝑥 : observable data ℘ 𝜃,𝑥 : Joint probability observing data 𝑥 with model parameter 𝜃 ℘ 𝑥 𝜃 ∝𝐿𝑖𝑘𝑒𝑙𝑖ℎ𝑜𝑜𝑑 𝑓𝑢𝑛𝑐𝑡𝑖𝑜𝑛 Metropolis-Hasting Algorithm, 10 6 ~ 10 7 samples 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Parameter Estimation with Bayesian inference MCMC Samples PTMCMCOutput.#.nn.h5 PTMCMCOutput.#.h5 Post Process cbcBayesPostProc.py 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Waveform Templates There are many waveform templates Concentrate TaylorF2 with Amplitude correction up to 2.5 PN Effect of eccentricity up to 3.0 PN TaylorT2 can deal with CBC inspirals when there is a BH spin that is aligned to the orbital angular momentum. SpinTaylorT4 is one of the most comprehensive inspiral waveform model used by the LIGO-Virgo collaboration. This can deal with precessing CBC inspirals with two spins. 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Likelihood Calculation Excess energy 𝐸= 1 2 𝑑 𝑑 − 1 2 𝑑−ℎ 𝑑−ℎ = 𝑑 ℎ − 1 2 ℎ ℎ ℒ(𝑠|𝜃)∝exp 𝐸 Gaussian noise assumption ℘ 𝑥 𝜃 = ℒ(𝑠|𝜃) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama MCMC Process Parallel Tempering Accept next state with probability 𝑟= ℘(𝑥| 𝜃 2 ) 1/𝑇 ℘ 𝜃 2 ℘(𝑥| 𝜃 1 ) 1/𝑇 ℘ 𝜃 1 Metropolis-Hasting sampling 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Parallel Tempering Use few chains with different temperature Use likelihood ℒ 𝑠 𝜃 1 𝑇 , 𝑇>1 𝑇 𝑚𝑎𝑥 = 𝑁𝑒𝑡𝑤𝑜𝑟𝑘 𝑆𝑁𝑅 2 𝑛 𝑝𝑎𝑟 Improve convergence and mixing The higher temperature, the smoother distribution 𝑇>1 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Implementation in lalsuite LAL MCMC Pipeline Directory structure of lalsuite Basic entities of LALSuite LAL applications Likelihood, proposal and prior functions Simulation related functions and waveforms Post Processing python script 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama LAL MCMC Pipeline Start Initialization MPI synchronize PT MCMC Clearance End 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama main LALInferenceInitRunState() LALInferenceInjectSignal() LALInferenceApplyCalibrationErrors() init_ptmcmc() LALInferenceInitCBCPrior() LALInferenceInitLikelihood() LALInferenceDrawThreads() runState->algorithm 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama InitRunState() Makoto & Takuji, 2 19937 −1≈ 10 6000 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama LALInferenceInjectInspiralSignal() 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama LALInferenceApplyCalibrationErrors() 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama init_ptmcmc() Set Algorithm function pointer Set parallel swapping function pointer Set CBC model Set number of varying parameters Set temperature ladder Set CBCthreads if necessary Set proposal function and proposal arguments for all threads Set adaptation parameters 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama LALInferenceInspiralPrior() Set various prior functions 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama PTMCMCAlgorithm() 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Template LALInferenceTemplateXLALSimInspiralChooseWaveform 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Strategy for KAGALI Base on LALSuite for many functions Modularize if possible Use structures Command parameters(KGLProcessParamsTable) IFO information(KGLInferenceIFOData) Waveform parameters(KGLWaveformModelParams) MCMC status(KGLInferenceRunState) Simulation parameters Use simple text file for injections Implement lalinference 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Development for KAGALI Use a new branch “mcmc” for development Library and application directory are separated (version 4) root/kagali/inference/src root/kagali/kglcommon/clock/src root/kagali/kglcommon/detector/src root/kagali/kglcommon/std/src root/kagali/waveform/src root/kagaliapps/cbc/mpisrc Cloned on KISTI and local Ubuntu server Build and run on both systems 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Main features Use a unique union structure for waveform parameters (KGLWaveformModelParams) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Structures KGLInferenceIFOData KGLDetector KGLWaveformModelParamsValue KGLWaveformModelParamsType KGLProcessParamsTable KGLProcessParamsPair KGLWaveformModelParamsItem KGLInferenceAlgorithm KGLWaveformModelParamsIndex KGLInferenceRunState KGLWaveformModelParams KGLWaveformModelParamsValue KGLInferenceAlgorithmOneStep 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Development for KAGALI kagali/inference/src 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Development for KAGALI kagali/kglcommon/clock/src 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Development for KAGALI kagali/kglcommon/detector/src 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Development for KAGALI kagali/kglcommon/std/src 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Development for KAGALI kagali/waveform/src 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

Development for KAGALI kagaliapps/cbc/mpisrc 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama KGLProcessParamsTable.h.in 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama KGLProcessParamsTable.h.in KGLProcessParamsPair KGLProcessParamsTable 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama KGLCommandUtils.c 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama KGLInferenceMCMC.c 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama inferenceMCMC.c 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama inferenceMCMC.c 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Makefile.am 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama build KAGALI 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama build script 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama build script(cont’d) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Build results nohup ./build-branch.sh & 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Sample Run(condor) /data/kagra/home/hwlee/projects/LAL/scratch/kagali/mcmc.sub condor_submit mcmc.sub 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Sample Run(condor) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Sample Run(condor) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Sample Run(condor) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Sample Run(condor) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Sample run(mpirun) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Sample run(con’d) 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Progress from the last Defines some structures Waveform Parameters, Datetime, etc. Implement basic placeholder functions Implement few more placeholder for functions Fixing some nil point errors 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Discussions Basic data structures are ready Basic program architecture fixed Need to write source codes and hurry up Hanyang, SNU Seoul Toyama KISTI, NIMS Daejeon Pusan U. Osaka Gimhae 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama

KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama Thanks 2017-08-29 KAGALI PE code development, The 17th KAGRA F2F meeting, Toyama