Tiles Method Divide variable plane into n x n tiles with (n-1) tile boundaries per variable n 2 observables: N ij (number of observed events in each tile) expected number of events in tile (ij) given by: assume variable independence for signal: 2(n-1) unknown signal fractions f S i, f S j and 2 unknown normalizations N SM, N S n = 2: analytically solvable (4 observables + 4 unknowns) n > 2: problem is overconstrained (more observables than unknowns) minimize negative log-likelihood estimator: Background corr. taken into account Signal contamination no problem Signal shape unconstrained Assumes bkg fractions well described by MC Signal correlation not taken into account Nov 19, 20091

Tiles Method Use 2 (or more) discriminating variables to split data sample into bins (tiles). Observed numbers of events in each tile are described by one binned signal model, and one (or more) binned background model(s). Nov 19, 20092

Tiles Method Use 2 (or more) discriminating variables to split data sample into bins (tiles). Observed numbers of events in each tile are described by one binned signal model, and one (or more) binned background model(s). Simulated data are used to derive the fractions of background events in each tile, while the overall background abundance is determined by the fit. Assumptions about the signal events are kept to a minimum: In the case of 2 discriminating variables, it is sufficient to assume that these variables are uncorrelated for signal events. No other assumption about the shape of the signal events in the two variables is made. In particular, no regions with signal or background dominance are assumed in the Tiles Method. The expected background and signal event yields, as well as the binned signal shape are obtained by the fit. Nov 19, 20093

Tiles Method: Systematics The Tiles method has systematic errors due to 1.Uncertainties in the Monte Carlo shape of individual background processes. Some examples – Uncertainties due to detector effects: (jet, lepton, E T miss ) energy scale, resolution – Theoretical uncertainties (PDFs, generator uncertainties in ttbar+Jets, W+Jets etc...) 2.Uncertainties in the Monte Carlo cross-sections for the individual background components. This leads to an uncertainty in the inclusive background shape. In the Tiles Method with separate background shapes, this systematic uncertainty is (partly) absorbed in the statistical error. – Theoretical uncertainties in the production cross-sections – Any efficiency uncertainty (e.g. in the lepton trigger and PID efficiencies) 3.The Tiles Method has a bias if signal events are correlated between the two discriminating variables. We estimated and minimized this effect using various SUSY benchmark models. Nov 19, 20094

Example from SUSY toy studies Left plot : (Fitted – MC) signal yield, depending on number of tiles used. Right plot: Fit error (signal yield), depending on number of tiles used. 1.Slight bias (left plot) due to neglect of signal correlations (open circles) test fits where signal corr. are switched off by means of event mixing return the true value on average. 2.Statistical error decreases with higher number of tiles due to additional (bkg) information. Nov 19, 20095

Tiles Method: References 1.Tiles Method talks: i.Sep 3, 2009, SUSY WG mtg : ii.Jan 23, 2009, SUSY WG mtg : iii.Dec 4, 2008, SUSY WG mtg : iv.Aug 28, 2008, SUSY WG mtg : Tiles Method notes: i.Atlas Int note: ATL-PHYS-INT ii.Atlas Pub note: ATL-PHYS-PUB iii.We are about to submit a new INT note: "Improving the Tiles Method Nov 19, 20096

4-Tiles Method B A D C Expected number of event in each tile: N A = f SM A N SM + (1-f S 1 )(1-f S 2 )N S N B = f SM B N SM + f S 1 (1-f S 2 )N S N C = f SM C N SM + (1-f S 1 ) f S 2 N S N D = f SM D N SM + f S 1 f S 2 N S Take SM fractions ( f SM ) for each tile (A,B,C,D) from MC: f SM A + f SM B + f SM C + f SM D = 1 Measure N A,N B,N C,N D from data: N A + N B + N C + N D = N obs Signal fractions for 2 variables: f S 1,f S 2 solve equations for N S SM correlation is taken into account Signal contamination no problem No assumption on signal Assumes SM eff. well described by MC Signal correlation not taken into account System of 4 independent linear equations Nov 19,

Nov 19, Splitting background contributions For tiles configurations with n 3: extend number of fitted event yields to fit bkg. contributions Example (3 x 3 tiles): 9 – 6 = 3 degrees of freedom -> up to 4 bkg. contributions expected number of events in tile (ij) with K bkg. Contributions: Tiles Setup4 x 48 x 8 N S (SU3)713 ± ± 53 N SM (tt->bblnln)341 ± ± 56 N SM (SM w/o tt->bblnln)1582 ± ± 54 Corr. (N S :N SM (tt>bblnln)) bias in N S is larger (sig. corr.) N SM (tt->bblnln) overestimated due to shape similarity to signal (highly anticorrelated!) stat. error is higher compared to std. Tiles Method Method requires distinct signal and background shapes otherwise signal migrates to background could add penalties on relative background fractions MC sample: 768 SU3 events 256 tt->bblnln events 1612 SM w/o tt->bblnln events Example: tt->bblnln + SM w/o tt->bblnln on MC sample