1. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam WFM 6311: Climate Change Risk Management Akm Saiful Islam Lecture-5b: Quality Controlling Observational Data December, 2009 Institute of Water and Flood Management (IWFM) Bangladesh University of Engineering and Technology (BUET)

2. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Quality Controlling Observational Data

3. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Task 1 After selecting climate station, download daily CSV files for past 30 years to folder titled with climate station name

4. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Quality Controlling Observational Data 1. organizing and viewing data 2. data checks (range, visual, missing data) 3. data summaries (monthly, annual)

5. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam 1. Organizing and Viewing Data Check folder for 30 years of data available (remember 2009 is not complete and cannot be included)

6. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Opening data file in MS Excel Double click on file in folder and file will open in MS Excel

7. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Save as Station Name 1979 to 2008

8. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Highlight Rows 1 to 23, then delete

9. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Scroll to bottom of dataset

10. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Open next year of data (1980) Select rows 25 to 390 Copy rows

11. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Paste at end of Climate station dataset Then repeat for all years * remember start with earliest year

12. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Delete unnecessary columns Select columns B, C, D, E, G, I, K, L, M, N, O Then delete

13. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Delete unnecessary columns 2 Select columns E, F,G,H, J, K, L, M, N, O, P, Q Then delete

14. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam This leaves Dataset with Tmax, Tmin, Tmean and Ptotal

15. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Format Column A for Date Select Column A Right click Select Format Cells Select date Select 14- Mar-01 style

16. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Eliminate all rows dated February 29 (Leap years) In this case, 1980, 1984, 1988, 1992, 1996, 2000, 2004, 2008

17. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Insert Worksheet to separate data into 20-year intervals Name Worksheets In this case 1979 to 1998 1999 to 2008

18. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Cut and paste between worksheets to separate into 20-year datasets Full 20-year dataset should contain 7301 rows

19. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam 2. Data Checks (range, visual, missing) Calculate maximum value in column

20. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Calculate minimum value in column

21. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Calculate Mean

22. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Calculate Standard Deviation

23. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Max/Min/Mean Check Max/ Min/Mean values for consistency i.e. Tmean falls between Tmax and Tmin

24. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam View Data Select column Select Chart Wizard Icon Select Line Chart Select Chart sub-type

25. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam View Data for Tmax, Tmin, Tmean

26. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Missing Data Count empty cells 3 and 5 rule If 3 consecutive days data missing, then cannot use that month’s data If 5 days of data missing, then cannot use that month’s data

27. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam 3. Data Summaries Go to CCCSN website ( www.cccsn.ca/training/) www.cccsn.ca Click on “monthly, seasonal, annual” template

28. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Copy columns G to W

29. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam Paste into 20-year climate worksheet at cell G1

30. WFM 6311: Climate Risk Management © Dr. Akm Saiful Islam

31. View summaries Select columns to view and chart