1. Handling Large Datasets by Using Cross Tables “When Turning 11 million rows into 1 billion can be a good thing”

2. Requirements... Query, filter rows and display them in the table view (straight table) from 550 columns and 11 million rows Customise the table views by selecting specific columns Search specific unique id(s) by pasting the id(s) within the application

3. What’s the challenge? Users wanted to query very wide data sets and there’re no aggregation expressions – we just need to expose the individual cell values in a table form (All Transactional Level). Having hundreds of conditional expressions on the straight table will degrade the performance and user experience, even though expressions are not aggregations. Each chart expression has three possible expressions – conditional expression, label and actual expression. This adds to the calculation overhead, plus managing potentially hundreds of expressions is painful or boring! QlikView shows better performance when calculating across rows rather than across columns This app needs to be intuitive even though it contains only table view(s)

4. With dummy row...Without dummy row... Name Value Pair or CrossTable Approach Extract data from the database and store the QVD(s) Add dummy row to tackle the NULL issue (Using Autogenerate 1) Transpose the data by keeping the Unique ID & Key Fields (To join the dimension tables) Unique ID TypeOwnerColourHome 34785CatNULLBlackLondon 34786CatNULLWhiteNULL Unique ID Field Name Field Value 34785TypeCat 34785ColourBlack 34785HomeLondon 34786TypeCat 34786ColourWhite Unique ID Field Name Field Value 34785TypeCat 34785ColourBlack 34785HomeLondon 34786TypeCat 34786ColourWhite 99999Type- 99999Owner- 99999Colour- 99999Home- Unique ID TypeOwnerColourHome 34785CatNULLBlackLondon 34786CatNULLWhiteNULL 99999---- Dummy row

5. Name Value Pair or CrossTable Approach (Contd...) Once the data transformation is completed (i.e. after transposing the data) – we would see the following number of rows: ((Actual Rows x Transposed Columns) – (Total Number of Null Values)) (3 x 4) – (3) = 9 Rows Create the pivot table with two dimensions – [Unique ID] & [Field Name] and use the expression as [Field Value] Pivot/Drag the [Field Name] column and you will see the table While users think they are making column selections they are actually making row selections

6. Demo