1. GIS 1 GIS Lecture 4 Geodatabases Copyright – Kristen S. Kurland, Carnegie Mellon University

2. GIS 2 Outline Administrative Data Example Data Tables Data Joins Common Datasets Spatial Joins ArcCatalog Overview Geodatabases Editing Tables Excel Tips Copyright – Kristen S. Kurland, Carnegie Mellon University

3. GIS 3 Administrative Data Example

4. GIS 4 Administrative Data Mission What does the organization do? Transaction event (who, what, where, when) - must have spatial component What data is available? Databases Spreadsheets Copyright – Kristen S. Kurland, Carnegie Mellon University

5. GIS 5 Example County Property Assessments Assesses the value of each land parcel and its structures Sets a property tax rate Sends property tax bill = assessed value * tax rate Copyright – Kristen S. Kurland, Carnegie Mellon University

6. GIS 6 Allegheny County Assessment WEB Site http://www.county.allegheny.pa.us Copyright – Kristen S. Kurland, Carnegie Mellon University

7. GIS 7

8. GIS 8

9. GIS 9 Westmoreland County Assessment WEB Site http://207.140.67.68/westmoreland/viewer.htm Copyright – Kristen S. Kurland, Carnegie Mellon University

10. GIS 10 Data Tables

11. GIS 11 Property Table Property Data Owner Address Sale Date and Price Map Lot Block Number Copyright – Kristen S. Kurland, Carnegie Mellon University

12. GIS 12 Parcels GIS Layer Smallest geographic element is a deeded land parcel Copyright – Kristen S. Kurland, Carnegie Mellon University

13. GIS 13 Data Joins

14. GIS 14 Join Property Table to Parcels Join on common attribute value Values must be the same Copyright – Kristen S. Kurland, Carnegie Mellon University Must remove dashes!

15. GIS 15 Import Property Table to ArcMap Save Excel file as a comma separated file.CSV File or DBF (DBASE IV) file Copyright – Kristen S. Kurland, Carnegie Mellon University

16. GIS 16 Add Table as Data Layer Copyright – Kristen S. Kurland, Carnegie Mellon University

17. GIS 17 Join Table to Map A common field joins or links tables Records with the same value are matched Some cleaning necessary (dashes removed) Copyright – Kristen S. Kurland, Carnegie Mellon University

18. GIS 18 Join Table to Parcels Copyright – Kristen S. Kurland, Carnegie Mellon University

19. GIS 19 Resultant Parcels Table Property fields are appended to parcels table Source files remain separate Joins can be removed Maps can be created from values in the new fields Copyright – Kristen S. Kurland, Carnegie Mellon University

20. GIS 20 Resulting Assessment Map

21. GIS 21 Resulting Assessment Map Copyright – Kristen S. Kurland, Carnegie Mellon University Central Oakland Land Parcels 2003 Assessment

22. GIS 22 Problems with Joins Saving.DBF and.CSV files in Excel Avoid special formats Keep it simple Use Access as a “middle man”

23. GIS 23 Common Datasets

24. GIS 24 Common Datasets U.S. Census Maps and U.S. Census Tables Copyright – Kristen S. Kurland, Carnegie Mellon University

25. GIS 25 Common Datasets Zip Codes - Use with U.S. Census data or Geocoding Copyright – Kristen S. Kurland, Carnegie Mellon University

26. GIS 26 Place Geocodes: FIPS Codes Federal Information Processing Standards Codes Developed by the National Institute of Standards and Technology Codes for Place Names Throughout the World countries states/provinces counties metropolitan statistical areas (MSA’s) cities places - indian reservations, airports, and post offices in the US Copyright – Kristen S. Kurland, Carnegie Mellon University

27. GIS 27 Place Geocodes: Hierarchy Country: US FIPS CODES County: 003 (Allegheny) State: 42 (Pennsylvania) Tract: 0501 Block: 12 (US420030501312) Block Group: 3 CENSUS CODES Minor Civil Division: 85188 (Wilkinsburg) Parcel (Block & Lot#) Copyright – Kristen S. Kurland, Carnegie Mellon University

28. GIS 28 Locating Data Contact agencies Obtain data on-line Copyright – Kristen S. Kurland, Carnegie Mellon University

29. GIS 29 Spatial Joins

30. GIS 30 Spatial Joins Spatially count points within polygons Join tables using Shape field Join points to polygons or polygons to points

31. GIS 31 Spatial Joins Join municipality name to points spatially Copyright – Kristen S. Kurland, Carnegie Mellon University

32. GIS 32 Spatial Joins Resultant point layer (food points) now contains municipality information Copyright – Kristen S. Kurland, Carnegie Mellon University

33. GIS 33 Aggregate Data Summarize on spatial join - Counts the number of points (records) for each municipality Copyright – Kristen S. Kurland, Carnegie Mellon University

34. GIS 34 Aggregate Data Resultant Table - Count of points (food stores) in each polygon (municipality) Copyright – Kristen S. Kurland, Carnegie Mellon University

35. GIS 35 Join Summary Table Join summary table of counts (based on municipality name from sum table) back to municipalities for labeling Copyright – Kristen S. Kurland, Carnegie Mellon University

36. GIS 36 Label Counts Label the count of stores from the summary join Copyright – Kristen S. Kurland, Carnegie Mellon University

37. GIS 37 Label Counts Show counts as a Choropleth Map Copyright – Kristen S. Kurland, Carnegie Mellon University

38. GIS 38 Map with Points Copyright – Kristen S. Kurland, Carnegie Mellon University

39. GIS 39 Map without Points Copyright – Kristen S. Kurland, Carnegie Mellon University

40. GIS 40 ArcCatalog

41. GIS 41 ArcCatalog Copyright – Kristen S. Kurland, Carnegie Mellon University

42. GIS 42 Metadata Copyright – Kristen S. Kurland, Carnegie Mellon University

43. GIS 43 Metadata Copyright – Kristen S. Kurland, Carnegie Mellon University

44. GIS 44 Metadata Copyright – Kristen S. Kurland, Carnegie Mellon University

45. GIS 45 Metadata Copyright – Kristen S. Kurland, Carnegie Mellon University

46. GIS 46 Metadata Copyright – Kristen S. Kurland, Carnegie Mellon University

47. GIS 47 Geodatabases

48. GIS 48 Geodatabase ‘geographic database’ represents geographic features and attributes as objects and is hosted inside a relational database management system managing your coverages, grids, and shapefiles inside a database management system, or DBMS Copyright – Kristen S. Kurland, Carnegie Mellon University

49. GIS 49 Enterprise Geodatabases require a ‘host’ DBMS - SQL Server, Oracle, or IBM DB2 Copyright – Kristen S. Kurland, Carnegie Mellon University

50. GIS 50 Personal Geodatabases based on the Microsoft JET engine - appear as an.mdb file (Microsoft’s JET engine is also used by Microsoft Access). Copyright – Kristen S. Kurland, Carnegie Mellon University

51. GIS 51 Geodatabase Advantages Provide a uniform and IT compliant repository for geographic data. Many users can edit geographic data simultaneously. Copyright – Kristen S. Kurland, Carnegie Mellon University

52. GIS 52 Geodatabases Copyright – Kristen S. Kurland, Carnegie Mellon University

53. GIS 53 Importing Shapefiles into Geodatabases Copyright – Kristen S. Kurland, Carnegie Mellon University

54. GIS 54 Importing Tables into Geodatabases Copyright – Kristen S. Kurland, Carnegie Mellon University

55. GIS 55 dBASE and Tables

56. GIS 56 dBASE Tables Copyright – Kristen S. Kurland, Carnegie Mellon University

57. GIS 57 Editing Tables Field definitions edited in ArcCatalog Layers cannot be in use elsewhere

58. GIS 58 Calculator Functions Copyright – Kristen S. Kurland, Carnegie Mellon University

59. GIS 59 Calculator Functions Copyright – Kristen S. Kurland, Carnegie Mellon University Not just for numeric fields

60. GIS 60 Excel Tips and Tricks

61. GIS 61 FIPS Code Reminder Country: US FIPS CODES County: 003 (Allegheny) State: 42 (Pennsylvania) Tract: 0501 Block: 12 (US420030501312) Block Group: 3 CENSUS CODES Minor Civil Division: 85188 (Wilkinsburg) Parcel (Block & Lot#) Copyright – Kristen S. Kurland, Carnegie Mellon University

62. GIS 62 Formatting and Replace Delete any Excel formatting (e.g. borders, patterns, etc.) Delete unwanted text (e.g. word “tract”) - Find and replace

63. GIS 63 Transpose Data Transpose data - Some census data saves data as rows instead of columns - You need transpose the data so that tracts will be a column - Select your data in excel and go to Edit menu and select copy - Click on a cell outside of your selected data and go to edit menu to select paste special…

64. GIS 64 Now you see the data transposed in the right way. All you need to do is to delete the original rows and save your file.

65. GIS 65 Concatenate Strings Sometimes you need add certain string before or after a value, and sometimes you want to combine two values. The excel CONCATENATE function makes that happen for you.

66. GIS 66 If you have the below dataset, and want to combine the state ID and county ID together as another variable and you want to make sure the new StateCountyID has the length of 5 For example, you want to add a “0” to State IDs that are only 1 character long, and you want add “00” to county IDs that that is 1 character long and “0” to those that are 2 characters. Concatenate Strings

67. GIS 67 Start by adding a new column right to StateID, and enter: =IF(LEN(A2)=1,CONCATENATE(0,A2),A2) What you tell excel is: if the length of the cell A2 is 1, add 0 before the original value, otherwise, keep the original value Concatenate Strings

68. GIS 68 After that, you copy and paste the formula to the rest of the column, and you will see the following result Concatenate Strings

69. GIS 69 Now let’s solve the problem for county ID. In the cell next to C2, you enter: =IF(LEN(C2)=1,CONCATENATE("00",C2),IF(LEN(C2)=2,CONCAT ENATE("0",C2),C2)) What this tells excel is if the length of county ID is 1, add “00” before it, if the length is 2, add “0” before it, if the length is 3, keep the original Concatenate Strings

70. GIS 70 Now you copy and paste the formula to the rest of the column and you get the above result Concatenate Strings

71. GIS 71 Next, you create a new column called StateCountyID, and enter is the cell E2: =concatenate(B2,D2) By this, you are telling Excel to combine the two new columns that you created in the previous steps Concatenate Strings

72. GIS 72 Now you just need to copy and paste the formula to the rest of the column and you finally get what you want. Concatenate Strings

73. GIS 73 Mid Function Sometimes, a simple replace won’t do for you to substring a column. In this case, you can use Excel’s mid function to get a subset of a value. For example, if you have the following data want extract two letters in the middle, say 12 from the first row, and 13 from the second row, and so on, the Excel MID function is your choice.

74. GIS 74 Mid Function You enter: =mid(A1,4,2) in the cell next to A1. What you tell excel to do is: From cell A1, extract 2 characters starting from the 4th character from left.

75. GIS 75 Mid Function Then you copy and paste the formula from B1 to the rest of the column and you get what you need.

76. GIS 76 Excel Tips and Tricks Formatting Find and Replace Transpose MID Function Concatenate Copyright – Kristen S. Kurland, Carnegie Mellon University

77. GIS 77 Other Excel Functions You might want to learn some other excel functions that could help you clean the data, such as: Right() Left() Exact() Copyright – Kristen S. Kurland, Carnegie Mellon University

78. GIS 78 Conclusion Administrative Data Example Data Tables Data Joins Common Datasets Spatial Joins ArcCatalog Overview Geodatabases Editing Tables Excel Tips Copyright – Kristen S. Kurland, Carnegie Mellon University