Convert (flatten) IATI XML file to CSV file(s) using XQUERY

Slides:



Advertisements
Similar presentations
Query Methods (SQL). What is SQL A programming language for databases. SQL (structured Query Language) It allows you add, edit, delete and run queries.
Advertisements

With Microsoft Access 2010© 2011 Pearson Education, Inc. Publishing as Prentice Hall1 PowerPoint Presentation to Accompany GO! with Microsoft ® Access.
Corey A Harper DC2006 October 4, 2006 Authority Control for the Semantic Web Encoding Library of Congress Subject Headings (LCSH) in SKOS.
ORACLE Lecture 1: Oracle 11g Introduction & Installation.
Lecture Microsoft Access and Relational Database Basics.
Introduction to XQuery and eXist DSA. XSLT Tutorial Problems Bad language : – No ! – for XML schema –Some XSLT engines tolerant of extra tags (permissive),
Multiple Tiers in Action
XML –Query Languages, Extracting from Relational Databases ADVANCED DATABASES Khawaja Mohiuddin Assistant Professor Department of Computer Sciences Bahria.
Attribute databases. GIS Definition Diagram Output Query Results.
4/20/2017.
GIS Concepts ‣ What is a table? What is a table? ‣ Queries on tables Queries on tables ‣ Joining and relating tables Joining and relating tables ‣ Summary.
Organizing Information Digitally Norm Friesen. Overview General properties of digital information Relational: tabular & linked Object-Oriented: inheritance.
Attribute Data in GIS Data in GIS are stored as features AND tabular info Tabular information can be associated with features OR Tabular data may NOT be.
Databases C HAPTER Chapter 10: Databases2 Databases and Structured Fields  A database is a collection of information –Typically stored as computer.
DBA Developer. Responsibilities  Designing Relational databases  Developing interface layer Environment Microsoft SQL Server,.NET SQL Layer: Stored.
XML Anisha K J Jerrin Thomas. Outline  Introduction  Structure of an XML Page  Well-formed & Valid XML Documents  DTD – Elements, Attributes, Entities.
DATABASE and XML Moussa Mané. Learning Objectives ● Learn about Native XML Databases ● Learn about the conversion technology available ● Understand New.
Session II Chapter 2 – Chapter 2 – XSLhttp://
XML Overview. Chapter 8 © 2011 Pearson Education 2 Extensible Markup Language (XML) A text-based markup language (like HTML) A text-based markup language.
Simple Database.
Information Systems: Databases Define the role of general information systems Describe the elements of a database management system (DBMS) Describe the.
Overview of Data Access MacDonald Ch. 15 MIS 324 Professor Sandvig.
Release 11i Workshops Dallas, TX Raleigh, NC Denver, CO Atlanta, GA Detroit, MI Tim Sharpe Oracle E-Business Suite Release 11i Discoverer.
XML & Mediators Thitima Sirikangwalkul Wai Sum Mong April 10, 2003.
Database Essentials. Key Terms Big Data Describes a dataset that cannot be stored or processed using traditional database software. Examples: Google search.
Copyright © 2004 Pearson Education, Inc.. Chapter 26 XML and Internet Databases.
Database Management Systems.  Database management system (DBMS)  Store large collections of data  Organize the data  Becomes a data storage system.
AUC Technologies LINQ (Language Integrated Query) LINQ Presented By : SHAIKH SHARYAR JAVED Software Engineer (Daedalus Software Inc.) Technology Teacher.
Database Concepts Track 3: Managing Information using Database.
Database Management Supplement 1. 2 I. The Hierarchy of Data Database File (Entity, Table) Record (info for a specific entity, Row) Field (Attribute,
© 2006 Altova GmbH. All Rights Reserved. Altova ® Product Line Overview.
Advanced Tips And Tricks For Power Query
A table is a set of data elements (values) that is organized using a model of vertical columns (which are identified by their name) and horizontal rows.
The IPSO Factor Enriching portfolios with market data.
Google maps engine and language presentation Ibrahim Motala.
Chapter 04 Semantic Web Application Architecture 23 November 2015 A Team 오혜성, 조형헌, 권윤, 신동준, 이인용.
XML and SQL Server Better friends than you thought Matt Hartman.
XML 1. Chapter 8 © 2013 Pearson Education, Inc. Publishing as Prentice Hall SAMPLE XML SCHEMA (XSD) 2 Schema is a record definition, analogous to the.
IFS180 Intro. to Data Management Chapter 10 - Unions.
XML Databases Presented By: Pardeep MT15042 Anurag Goel MT15006.
Understanding Core Database Concepts Lesson 1. Objectives.
XML: Extensible Markup Language
The Operations Portal and the Grid Operations Interoperability
Generating Pieces of Web Applications with Type-Level Programming
Statistical Information Systems Introducing SIS tool .Stat
Data Virtualization Demoette… Data Lineage Reporting
Data Virtualization Tutorial: XSLT and Streaming Transformations
Middleware independent Information Service
ICT Database Lesson 1 What is a Database?.
Database Management  .
Databases.
Tutorial 8 Objectives Continue presenting methods to import data into Access, export data from Access, link applications with data stored in Access, and.
Populating a Data Warehouse
Populating a Data Warehouse
MANAGING DATA RESOURCES
Database.
1.1 The Evolution of Database Systems
Enhance BI Applications and Simplify Development
Populating a Data Warehouse
Introduction to Oracle Application Express
Populating a Data Warehouse
Data Model.
Sequences in XQuery Core data structure of XQuery Date: 8/25/2009
Data Management Innovations 2017 High level overview of DB
Manipulating and Sharing Data in a Database
2/18/2019.
Tutorial 6 PHP & MySQL Li Xu
MIS2502: Data Analytics MySQL and MySQL Workbench
Understanding Core Database Concepts
SQL Tutorial Basic SQL Commands
Presentation transcript:

Convert (flatten) IATI XML file to CSV file(s) using XQUERY Ibrahim Aboalfadl Omar TAG2018, Kathmandu

Why XQUERY? WIKIBOOKS says: The principal benefits of XQuery are: Expressiveness - XQuery can query many different data structures and its recursive nature makes it ideal for querying tree and graph structures Brevity - XQuery statements are shorter than similar SQL or XSLT programs Flexibility - XQuery can query both hierarchical and tabular data Consistency - XQuery has a consistent syntax and can be used with other XML standards such as XML Schema data types XQuery is frequently compared with two other languages, SQL and XSLT

BaseX: A Tool used to run XQUERY BaseX is a robust, high-performance XML database engine Simple and easy to run XQUERY script Highly compliant XQuery 3.1 processor Open source Lightweight It comes with interactive user interfaces (desktop, web-based) that give you great insight into your data.

IATI XML FILE

The Script

Imported CSV File

Imported CSV File

Imported CSV File, DAC column striped to a new table records

Conclusion Use XQUERY to get the data of a tree item in one concatenated column separated each value with “|” sign and if the value has a descriptor separate them by “>” sign, or use any other sign. Import the generated CSV file in a Database or spreadsheet Strip the concatenated column to be converted into multiple columns or rows

Thank You