A Platform for Personal Information Management and Integration

Slides:



Advertisements
Similar presentations
Uncertainty in Data Integration Ai Jing
Advertisements

Three-Step Database Design
Data Mining: Potentials and Challenges Rakesh Agrawal & Jeff Ullman.
Introduction Lesson 1 Microsoft Office 2010 and the Internet
With Microsoft Access 2010© 2011 Pearson Education, Inc. Publishing as Prentice Hall1 PowerPoint Presentation to Accompany GO! with Microsoft ® Access.
Semex: A Platform for Personal Information Management and Integration Xin (Luna) Dong University of Washington June 24, 2005.
Reference Reconciliation in Complex Information Spaces Xin (Luna) Dong, Alon Halevy, Jayant Sigmod 2005 University of Washington.
Search Engines and Information Retrieval
Data Management for XML: Research Directions By: Jennifer Widom Stanford University Reviewer: Kristin Streilein.
A Web of Concepts Dalvi, et al. Presented by Andrew Zitzelberger.
1 CBioC: Collaborative Bio- Curation Chitta Baral Department of Computer Science and Engineering Arizona State University.
Microsoft Office XP Illustrated Introductory, Enhanced Microsoft Office XP Introducing.
Architecture External Web Services Supported Services Repository LMS Services Domain Model Process Container Process Instance Course Sequencing Presentation.
© 2004, The Trustees of Indiana University 1 OneStart Workflow Basics Brian McGough, Manager, Systems Integration, UITS Ryan Kirkendall, Lead Developer.
Model Management and the Future Zachary G. Ives University of Pennsylvania CIS 650 – Database & Information Systems April 20, 2005 Semex figures extracted.
What Can Databases Do for Peer-to-Peer Steven Gribble, Alon Halevy, Zachary Ives, Maya Rodrig, Dan Suciu Presented by: Ryan Huebsch CS294-4 P2P Systems.
Microsoft Office 2003 Illustrated Introductory, Premium Edition Microsoft Office 2003 Introducing.
Overview of Search Engines
A Platform for Personal Information Management and Integration Xin (Luna) Dong and Alon Halevy University of Washington.
Semantic Interoperability Jérôme Euzenat INRIA & LIG France Natasha Noy Stanford University USA.
Enterprise Systems & Architectures. Enterprise systems are mainly composed of information systems. Business process management mainly deals with information.
Challenges in Information Retrieval and Language Modeling Michael Shepherd Dalhousie University Halifax, NS Canada.
Lecture 2 The Relational Model. Objectives Terminology of relational model. How tables are used to represent data. Connection between mathematical relations.
Semantic Web outlook and trends May The Past 24 Odd Years 1984 Lenat’s Cyc vision 1989 TBL’s Web vision 1991 DARPA Knowledge Sharing Effort 1996.
Search Engines and Information Retrieval Chapter 1.
1 Adapted from Pearson Prentice Hall Adapted form James A. Senn’s Information Technology, 3 rd Edition Chapter 7 Enterprise Databases and Data Warehouses.
Computer Science 101 Database Concepts. Database Collection of related data Models real world “universe” Reflects changes Specific purposes and audience.
Ontology-Driven Automatic Entity Disambiguation in Unstructured Text Jed Hassell.
Siteman Cancer Center at Barnes-Jewish Hospital and Washington University School of Medicine Cancer Center Administration Database.
The Data Ring: Community Content Sharing Serge Abiteboul (INRIA) Alkis Polyzotis (UC Santa Cruz)
Database Design and Management CPTG /23/2015Chapter 12 of 38 Functions of a Database Store data Store data School: student records, class schedules,
Mining Structured vs. Unstructured Data Where is the structure and where did the semantics go? Rahim Yaseen SAP Labs LLC.
2007. Software Engineering Laboratory, School of Computer Science S E Web-Harvest Web-Harvest: Open Source Web Data Extraction tool 이재정 Software Engineering.
인지구조기반 마이닝 소프트컴퓨팅 연구실 박사 2 학기 박 한 샘 2006 지식기반시스템 응용.
Individualized Knowledge Access David Karger Lynn Andrea Stein Mark Ackerman Ralph Swick.
The Semantic Logger: Supporting Service Building from Personal Context Mischa M Tuffield et al. Intelligence, Agents, Multimedia Group University of Southampton.
Data Integration Hanna Zhong Department of Computer Science University of Illinois, Urbana-Champaign 11/12/2009.
Scalable Hybrid Keyword Search on Distributed Database Jungkee Kim Florida State University Community Grids Laboratory, Indiana University Workshop on.
DAT300 SQL Server Notification Services: Application Development Ken Henderson Technical Lead, SQL Server Support Microsoft Corporation
GOOGLE FUSION TABLES: WEB- CENTERED DATA MANAGEMENT AND COLLABORATION HectorGonzalez, et al. Google Inc. Presented by Donald Cha December 2, 2015.
Information Integration 15 th Meeting Course Name: Business Intelligence Year: 2009.
Refined Online Citation Matching and Adaptive Canonical Metadata Construction CSE 598B Course Project Report Huajing Li.
Toward Entity Retrieval over Structured and Text Data Mayssam Sayyadian, Azadeh Shakery, AnHai Doan, ChengXiang Zhai Department of Computer Science University.
Instance Discovery and Schema Matching With Applications to Biological Deep Web Data Integration Tantan Liu, Fan Wang, Gagan Agrawal {liut, wangfa,
CIS750 – Seminar in Advanced Topics in Computer Science Advanced topics in databases – Multimedia Databases V. Megalooikonomou Link mining ( based on slides.
An Experience Report from the Use of Digital Repositories in Building a New Module Simon McGinnes Trinity College Dublin.
1 Personalizing Search via Automated Analysis of Interests and Activities Jaime Teevan, MIT Susan T. Dumais, Microsoft Eric Horvitz, Microsoft SIGIR 2005.
Warren Shen, Xin Li, AnHai Doan Database & AI Groups University of Illinois, Urbana Constraint-Based Entity Matching.
Information Retrieval in Practice
Building Enterprise Applications Using Visual Studio®
KNOWLEDGE MANAGEMENT (KM) Session # 32
CaRT eCapacity Initiative Ghana Productivity Apps
MICROSOFT OUTLOOK and Outlook service Provider
Decomposition Storage Model (DSM)
StYLiD: Structured Information Sharing with User-defined Concepts
Datamining : Refers to extracting or mining knowledge from large amounts of data Applications : Market Analysis Fraud Detection Customer Retention Production.
Data Warehouse.
Microsoft Office 2003 Illustrated Introductory, Premium Edition
Relational Algebra Chapter 4, Part A
Modeling Your Data Chapter 2 cs542
Data Integration with Dependent Sources
Attributes and Values Describing Entities.
Teaching slides Chapter 8.
CLIENT RELATIONSHIP MANAGEMENT KEEPING TRACK OF REQUESTS THE EASY WAY
Database Systems Instructor Name: Lecture-3.
Browsing Associations with Semex
Research on Personal Dataspace Management
Haystack: an Adaptive Personalized Information Retrieval System
Information Retrieval and Web Design
Fading Schemas… Alon Y. Halevy.
Presentation transcript:

A Platform for Personal Information Management and Integration Xin (Luna) Dong and Alon Halevy University of Washington

Is Your Personal Information a Mine or a Mess? Intranet Internet Is Your Personal Information a Mine or a Mess? Mention Tim-Bernslee PIM workshop last VLDB?

Is Your Personal Information a Mine or a Mess? Intranet Internet Is Your Personal Information a Mine or a Mess? Mention Tim-Bernslee PIM workshop last VLDB?

Questions Hard to Answer Find my SEMEX paper and the presentation slides (maybe in an attachment).

Index Data from Different Sources E.g. Google, MSN desktop search Intranet Internet Mention Tim-Bernslee PIM workshop last VLDB?

Questions Hard to Answer Find my SEMEX paper and the presentation slides (maybe in an attachment). Find me the people working on SEMEX Find me all the “schema matching” papers by my advisor List me the phone numbers of my coauthors

Organize Data in a Semantically Meaningful Way Co-authors Intranet Internet Mention Tim-Bernslee PIM workshop last VLDB?

Questions Hard to Answer Find my SEMEX paper and the presentation slides (maybe in an attachment). Find me the people working on SEMEX Find me all the “schema matching” papers by my advisor List me the phone numbers of my coauthors Find me the authors of CIDR’05 papers, who have sent me emails in the last 2 years

Integrate Organizational and Public Data with Personal Data Intranet Internet Mention Tim-Bernslee PIM workshop last VLDB?

SEMEX (SEMantic EXplorer) – I. Provide a Logical View of Data Cites Event Message Document Web Page Presentation Cached Softcopy Sender, Recipients Organizer, Participants Person Paper Author Homepage Mail & calendar HTML Files Presentations Papers

SEMEX (SEMantic EXplorer) – II. On-the-fly Data Integration Cites Event Message Document Web Page Presentation Cached Softcopy Sender, Recipients Organizer, Participants Person Paper Author Homepage

Browse by Associations

Browse by Associations “A survey of approaches to automatic schema matching” “Corpus-based schema matching” “Database management for peer-to-peer computing: A vision” “Matching schemas by learning from others” “A survey of approaches to automatic schema matching” “Corpus-based schema matching” “Database management for peer-to-peer computing: A vision” “Matching schemas by learning from others” Publication Bernstein

Browse by Associations Cited by Publication Publication Citations Bernstein

An Ideal PIM is a Magic Wand

An Ideal PIM is a Magic Wand

Main Goals of Semex How can we create an ‘AHA!’ browsing experience? How can we leverage the PIM (Personal Information Management) environment and knowledge to increase productivity?

Outline Problem definition and project goals Technical issues: Semex architecture Reference reconciliation Importing external data sources Domain model personalization Overarching PIM Themes

System Architecture Event Message Document Web Page Presentation Cites Event Message Document Web Page Presentation Cached Softcopy Sender, Recipients Organizer, Participants Person Paper Author Homepage Mail & calendar HTML Files Presentations Papers

System Architecture Domain Model Data Repository Reference Reconciliation Objects Associations Simple Extracted External Defined Word Excel PPT PDF Bibtex Latex Email Contacts

System Architecture Core Searcher and browser Data analyzer External data importer Extractor plug-ins Domain model personalization Word Excel PPT PDF Bibtex Latex Email Contacts Domain Model Objects Associations Reference Reconciliation Data Repository Simple Extracted External Defined

Outline Problem definition and project goals Technical issues: Semex architecture Reference reconciliation Importing external data sources Domain model personalization Overarching PIM Themes

Reference Reconciliation

Reference Reconciliation A very active area of research in Databases, Data Mining and AI Typically assume matching tuples from a single table Approaches based on pair-wise comparisons Harder in our context

Challenges Article: a1=(“Bounds on the Sample Complexity of Bayesian Learning”, “703-746”, {p1,p2,p3}, c1) a2=(“Bounds on the sample complexity of bayesian learning”, “703-746”, {p4,p5,p6}, c2) Venue: c1=(“Computational learning theory”, “1992”, “Austin, Texas”) c2=(“COLT”, “1992”, null) Person: p1=(“David Haussler”, null) p2=(“Michael Kearns”, null) p3=(“Robert Schapire”, null) p4=(“Haussler, D.”, null) p5=(“Kearns, M. J.”, null) p6=(“Schapire, R.”, null)

Challenges Article: a1=(“Bounds on the Sample Complexity of Bayesian Learning”, “703-746”, {p1,p2,p3}, c1) a2=(“Bounds on the sample complexity of bayesian learning”, “703-746”, {p4,p5,p6}, c2) Venue: c1=(“Computational learning theory”, “1991”, “Austin, Texas”) c2=(“COLT”, “1992”, null) Person: p1=(“David Haussler”, null) p2=(“Michael Kearns”, null) p3=(“Robert Schapire”, null) p4=(“Haussler, D.”, null) p5=(“Kearns, M. J.”, null) p6=(“Schapire, R.”, null) p7=(“Robert Schapire”, “schapire@research.att.com”) p8=(null, “mkearns@cis.uppen.edu”) p9=(“mike”, “mkearns@cis.uppen.edu”) 2. Limited Information ? 1. Multiple Classes 3. Multi-value Attributes ?

Intuition— Exploit Context Information E.g. name v.s. email E.g. contact list Propagate similarities between different types of objects E.g., reconciling papers helps reconcile conferences Exploit richness of merged references E.g., remember alternate representations of entities

Outline Problem definition and project goals Technical issues: Semex architecture Reference reconciliation Importing external data sources Domain model personalization Overarching PIM Themes

Importing External Data Sources Cites Event Message Document Web Page Presentation Cached Softcopy Sender, Recipients Organizer, Participants Person Paper Author Homepage

Challenges— On-thy-fly Data Integration Current data integration study focuses on integrating enterprise data Large-scale, heavy-weight Performed by professional technicians Built to support very frequently occurring queries The PIM context presents unique challenges Small-scale, light-weight Performed by non-technical savvy Doing transient queries (done only once or twice, or use different pieces of data)

Intuition— Using Past Experiences and Knowledge We have a large number of instances E.g., importing DBLP – help from overlapping paper instances [Doan et al, Sigmod’04][Etzioni et al, 1995] We know a lot about the domain model Schema matching work [Doan et al, Sigmod’01][Madhavan et al, ICDE’05] Others have imported similar (or the same) data sources

Outline Problem definition and project goals Technical issues: Semex architecture Reference reconciliation Importing external data sources Domain model personalization Overarching PIM Themes

The Domain Model The Semex core provides very basic classes and associations Users will need to personalize further Event Message Document Web Page Presentation Cached Softcopy Sender, Recipients Organizer, Participants Person Paper Author Homepage cite

Challenges Easy-to-use for non-technical users Suggest appropriate modifications Make the fragments fit together Guarantee high efficiency of updating and querying

Intuition— Suggest Changes from Past Experiences Strategy: mix and match from small components May come with extractor plug-ins A by-product of importing external data sources Learn from other people’s domain models

Outline Problem definition and project goals Technical issues: Semex architecture Reference reconciliation Importing external data sources Domain model personalization Overarching PIM Themes

Overarching PIM Themes PERSONAL It is PERSONAL data! What is the right granularity for modeling personal data? Manipulate any kind of INFORMATION How to combine structured and un-structured data? Data and “schema” evolve over time How to do life-long data management? Bring the benefits of data MANAGEMENT to users How to build a system supporting users in their own habitat? INFORMATION MANAGEMENT

Related Work Personal Information Management Systems Indexing Stuff I’ve Seen (MSN Desktop Search) [Dumais et al., 2003] Google Desktop Search [2004] Richer relationships LifeStreams [Freeman and Gelernter, 1996] Placeless Documents [Dourish et al., 2000] MyLifeBits [Gemmell et al., 2002] Objects and Associations Haystack [Karger et al., 2005]

Summary 60 years passed since the personal Memex was envisioned It’s time to get serious Great challenges for data management The goal of Semex Set up a platform for applications that increase user’s productivity Bring benefits of data management to ordinary users There is a lot of technology to build on. It is not a pipe dream!

A Platform for Personal Information Management and Integration @CIDR 2005 Xin (Luna) Dong and Alon Halevy University of Washington data.cs.washington.edu/semex