TerraPop Vision An organizational and technical framework to preserve, integrate, disseminate, and analyze global-scale spatiotemporal data describing.

Slides:



Advertisements
Similar presentations
Dissemination of U.S. Census Data and Results: The role of ICPSR First Conference of Al-Khawarezmi Committee on Statistics Doha, Qatar 6-8 December 2010.
Advertisements

Oh Myyy! Dr. Robert S. Chen Director and Senior Research Scientist CIESIN, The Earth Institute.
Aggregate data Also called summary data, tabular data Counts of things for places (e.g. counties) or entities Examples: –census volumes –HSUS –ICPSR files.
WORKSHOP ON INTEGRATING GLOBAL CENSUS MICRO DATA Paris, June 7 – 10, 2006 UGANDA COUNTRY REPORT by Andrew Mukulu.
2010 Census and ACS in Oregon: Results and Resources Census Data Workshops November, 2011 Charles Rynerson Census State Data Center Coordinator Population.
5. Integration of Microdata and Metadata (9 slides)
Searching the University of Alberta Library’s Statistics Canada-based Websites 2001 Census of Canada Canadian Centre for Justice Statistics Canadian Business.
Competency with the Census E. Turner CSU Northridge FOR MORE INFO...
The Roll of GIS In School Board Planning. Presentation Overview ► Introduction ► Board’s Roll in the Planning Process ► GIS at York Catholic ► GIS At.
Labor Statistics in the United States Grace York March 2004.
MONGOLIA COUNTRY REPORT National Statistical Office IPUMS-Global Workshop, Lisbon, Portugal, August 22-26, 2007.
UNDERSTANDING SPATIAL DISTRIBUTION OF ASTHMA USING A GEOGRAPHICAL INFORMATION SYSTEM Mohammad A. Rob Management Information Systems University of Houston-Clear.
Census 2001 Your window to Census information. What is a Census? The Census of population and housing is undertaken every 5 years by the ABS. It aims.
Raw Census Microdata from IPUMS IPUMS Data Structure Household record (shaded) followed by a person record for each member of the household Relationship.
1 The American Community Survey (ACS) 2005 Data Release.
U.S. Census Bureau Demographic Census 2000 July 8, 2003.
Your Community by the Numbers Accessing the most current and relevant Census data Alexandra Barker Data Dissemination Specialist U.S Census Bureau New.
RATIONALE The storage in a smart phone would cost (in 2011 dollars) $7,571 in 2001 $212,040 in 1991 $3,796,800 in 1981 $56,168,800 in 1971 $1,233,179,000.
ASSESSING THE LOCAL EARTHQUAKE RISK Justin Czarka, Lehman College, CUNY – May 2013 Agung Swastika/AFP/Getty Images.
1 Using the American Community Survey with American Factfinder CTPP Webinar Dec 2, 2008 Melissa Chiu, CTPP Coordinator Journey to Work and Migration Statistics.
U.S. Census Bureau census.gov Census Data Immersion From A Novice to A Skilled Data Miner Infopeople Webinar August 7,
11 Comparison of Perturbation Approaches for Spatial Outliers in Microdata Natalie Shlomo* and Jordi Marés** * Social Statistics, University of Manchester,
111 American Community Survey Fundamentals 2009 Population Association of America ACS Workshop April 29, 2009.
The American Community Survey Texas Transportation Planning Conference Dallas, Texas July 19, 2012.
September 18-19, 2006 – Denver, Colorado Sponsored by the U.S. Department of Housing and Urban Development Using Geographic Information Systems (GIS) as.
U.S. Decennial Census Finding and Accessing Data Summer Durrant October 20, 2014 Data & Geographical Information Librarian Research Data Services
American Factfinder Workshop Nola du Toit Spring 2007.
C2ER 52 nd Annual Conference & LMI Training Institute Annual Forum Regional Socioeconomic Statistics Update on U.S. Census Bureau Programs June 8, 2012.
Geographical Information Systems (GIS): An Essential Tool for Research, Planning, and Archival of Data for Most Governmental Agencies Mohammad A. Rob University.
Using IPUMS.org Katie Genadek Minnesota Population Center University of Minnesota The IPUMS projects are funded by the National Science.
Introduction to the Public Use Microdata Sample (PUMS) File from the American Community Survey Updated February 2013.
Integrating Official Statistics and Geospatial Information – ABS experience Frank Yu First Assistant Statistician Project Management and Infrastructure.
 According to UN recommendations and the Statistical Law of Cambodia, the Royal Government of Cambodia is Committed to conducting a general population.
American Community Survey Overview September 4, 2013 Tim Gilbert American Community Survey Office.
Water Quality Data, Maps, and Graphs Over the Web · Chemical concentrations in water, sediment, and aquatic organism tissues.
The Minnesota Data Harmonization Projects Bill & Melinda Gates Foundation Seattle, Washington May 21, 2014 Elizabeth Boyle, Miriam King, Matthew Sobek.
American Community Survey. Outline American Community Survey basics Accessing ACS data products Resources for learning more 2.
Data Projects at the Minnesota Population Center Resources for Comparative Population and Health Research Seattle, Washington May 22, 2014 Elizabeth Boyle,
1 Risk Factors for Children in the U.S., States, and Metropolitan Areas: Data from the 2007 American Community Survey Robert Kominski, U.S. Census Bureau.
New and easier ways of working with aggregate data and geographies from UK censuses Justin Hayes UK Data Service Census Support.
The 2010 Population and Housing Census of Mongolia: Census PES 1 A.Amarbal Director of Population and Housing Census Bureau, National Statistical Office.
06/21/2012 Aggregations of spatial information for data dissemination.
The geographical distribution of poverty and food security in Bangladesh: Implications for the design of policy & agricultural R&D&E interventions IRRI.
American Community Survey (ACS) Product Types: Tables and Maps Samples Revised
Integrated Public Use Microdata Series IPUMSwww.ipums.org Matt Sobek Minnesota Population Center
Gridding global male and female populations: New data from the Gridded Population of the World (GPW) Erin Doxsey-Whitfield Susana B. Adamo Kytt MacManus.
The Integrated Public Use Microdata Series database IPUMSwww.ipums.org Lab 1 Background on the IPUMS and SPSS.
TerraPop Mission Enabling research, learning, and policy analysis by providing integrated spatiotemporal data describing people and their environment.
Beyond 2011 Administrative data sources and low-level aggregate models for producing population counts.
Census Office Fernando Casimiro Geneva, July 2010 Portugal – Census results tailored to user needs «
Corn Yield Comparison Between EPIC-View Simulated Yield And Observed Yield Monitor Data by Chad M. Boshart Oklahoma State University.
Integrated Public Use Microdata Series IPUMS Internationalwww.ipums.org Matt Sobek Minnesota Population Center
Land cover change in the Travis county GIS in Water Resources Fall 2015 University of Texas at austin Julie C Faure.
Integrated Public Use Microdata Series IPUMSwww.ipums.org.
Presentation to Travis County Commissioners Court March 8, 2011.
Trends and Characteristics of the Elderly Population in West Virginia Christiadi WVU Bureau of Business and Economic Researc h.
Data access and development: The IPUMS perspective United Nations Commission on Population and Development The data revolution in action: National and.
Lessons Learned from the production of Gridded Population of the World Version 4 (GPW4) Columbia University, CIESIN, USA EFGS October 2014.
ASDC Annual Meeting November 10, 2011 Kathleen Gabler Socioeconomic Research Associate Center for Business and Economic Research Culverhouse College of.
Lecture 18: Spatial Analysis Using Rasters Jeffery S. Horsburgh CEE 5190/6190 Geographic Information Systems for Civil Engineers Spring 2016.
Data Processing Hollerith 1921
DataNet Collaboration
Collaboration and Outreach
TerraPop Goals Lower barriers to conducting interdisciplinary human-environment interactions research by making data with different formats from different.
Global Statistical Geospatial Framework – interoperability challenges
CyberGIS: Reston, VA, September 22, 2018
Terra Populus Data Domains
and the Future of Historical Family Demography
TerraPop Goals Lower barriers to conducting interdisciplinary human-environment interactions research by making data with different formats from different.
The role of metadata in census data dissemination
Presentation transcript:

TerraPop Vision An organizational and technical framework to preserve, integrate, disseminate, and analyze global-scale spatiotemporal data describing population and the environment.  Develop tools to make data interoperable across data formats and subject areas  Break down disciplinary silos

TerraPop Goals Lower barriers to conducting interdisciplinary human- environment interactions research by making data with different formats from different scientific domains easily interoperable

DOMAINS & FORMATS POPULATION MICRODATA AREA-LEVEL DATA Source Data

Making disparate data formats interoperable Microdata: Characteristics of individuals and households Area-level data: Characteristics of places defined by boundaries Raster data: Values tied to spatial coordinates

Microdata Structure Household record (shaded) followed by a person record for each member of the household Relationship Age Sex Race Birthplace Mother’s birthplace Occupation For each type of record, columns correspond to specific variables Geographic and housing characteristics

Khartoum, CBS-Sudan

1973 Census Tapes arrive at Muller Media (New York) via Barcelona

Dhaka, Bangladesh Bureau of Statistics

The Power of Microdata Customized measures: Variables based on combined characteristics of family and household members, capitalizing on the hierarchical structure of the data Multivariate analysis: Analyze many individual, household, and community characteristics simultaneously Interoperability: Harmonize data across time and space Age classification for school enrollment in published U.S. Census

Growth of Public-Use Microdata (number of person-records available) We are Here

IPUMS-International Microdata Over 100 Collaborating National Statistical Agencies

Area Level (Vector) Data Describing characteristics of geographic polygons Median Household Income by Census Tract

Area-level Data Sources Census tables, especially where microdata is unavailable Other types of surveys, data  Agricultural surveys  Economic surveys, data  Election data  Disease data Legal/policy information  Environmental policy  Social policy  Human rights

Raster Data Represented as pixels in a grid Mean Precipitation

Raster Data Beta system  Global Land Cover 2000  Harvested Area and Yield for 175 crops (Global Landscapes Initiative)  Temperature and precipitation (WorldClim) Future additions  Additional LU/LC and climate datasets  Elevation  Vegetation characteristics  Bioclimatic & ecologic zones

MICRODATA  AREA-LEVEL  RASTER Location-Based Integration

Microdata Area-level data Rasters Mix and match variables originating in any of the data structures Obtain output in the data structure most useful to you

Location-Based Integration Individuals and households with their environmental and social context Microdata Area-level data Rasters

Location-Based Integration Summarized environmental and population Microdata Area-level data Rasters County ID G G G G G G G County ID Mean Ann. Temp. Max. Ann. Precip. G G G G G G G County ID Mean Ann. Temp. Max. Ann. Precip. Rent, Rural Rent, Urban Own, Rural Own, Urban G G G G G G G characteristics for administrative districts

Location-Based Integration Rasters of population and environment data Microdata Area-level data Rasters

Area-Level Summary of Raster Data

Rasterization of Area-Level Data

Rasterization Beta system – Uniform distribution assumption  Use lowest level units available  Rates – same value for all cells in unit  Counts – evenly distributed across cells in unit Future – Distribute based on ancillary data  Requires research on available methods  May provide as service – users select:  Ancillary data  Weights  Spatial distribution parameters

Data Access System

General Workflow Browse variables and metadata Select variables and datasets View data cart contents Select output options

Prototype Data Access System

Variable Groups

Variable Browsing

Variable Metadata

To join the beta test