LifeLogOn: Log on to Your Lifelog Ontology! Introduction & Demonstration Sangkeun Lee, Gihyun Gong, Sang-goo Lee Intelligent Database Systems Lab Seoul National University

Introduction

Motivation If we can integrate currently available logs from different devices and create semantic relationships among logs, then it can be a practical starting point of realizing lifelogging... …

We already have many types of available logs..., but they are independent LifeLogOn creates semantic relationships among log items Idea Music Logs Movie Logs GPS Logs Phone Call Logs History Web History Schedules Music Logs Movie Logs GPS LogsPhone Call Logs HistorySchedules Sematnic Relationships LifeLog On

LifeLogOn Overview Gives a simple and effective way of integrating heterogeneous logs gathered from many different devices Transforms relational log data and metadata into Lifelog Instance-level Ontology and stores in Lifelog Knowledge Base(LKB) Entity Attribute Event Entity Role Identifier Domain

LifeLogOn Overview What can we use it for? You can create your own lifelog ontology without understanding any ontology languages You can use LifeLogOn when you want to ✓ Find a song you listened at your birthday party and but only know the filename of the photos at the party ✓ Find photos that you took when you are talking with your friend on the phone, saying "It's so beautiful here~!" ✓ Find any events and entities those you know their context information such as time, location,... ✓... even more

Demonstration

✓ We setup LifeLogOn on our server: ✓ For the demo purpose, we have generated ✓ 50 digital camera logs ✓ 50 histories ✓ 20 music logs ✓ 10 phone call logs ✓ 17 schedule items ✓ 100 music metadata ✓ 3 users Demo Setup

Overall Process

Part I. Ontology Creation

Lifelog Ontology Schema Definition Define Domains Define Entities & Attributes Define Events Create Domain - Entity Relationships Create Domain - Event Relationships Music Entity Language Track Name Album Name Artist Playtime Play User Date Time Location Take Photo Digital Camera Photo Entity File Name Resolution

Mapping Source Data Schema to Lifelog Ontology Schema Mapping Log data to Lifelog Ontology Schema Mapping Metadata to Lifelog Ontology Schema

Generating Lifelog Ontology Instances Choose a Log Data Mapping Profile Choose a Metadata Mapping Profile Click ‘Instantiation’

Part II. Use Case Scenarios

Use Case I: Finding a song that you don’t remember Find a song you listened at your birthday party and but only know the filename of the photo that is taken at the party The filename is ‘DSC_2128.JPG’ Try below Type ‘DSC_2128’ in the keyword search box Browse Ontology, following 'TakePhoto#467928' - '2009/07/23' - 'MusicPlay#468016' - 'Lazy Rhapsody' You've found the song title! and even artist, album names!

Use Case II: Finding a photo that you took when you were talking on the phone with your friend Find a picture that you took when you were talking on the phone with your friend, saying ‘It’s so beautiful here~!’ Now, you want to show the picture to your friends But you forgot the date, time,.... You only remember your friends cellphone number The friend’s cellphone number is ‘ ’ Try below Type ‘ ’ in the keyword search box Browse Ontology, following 'PhoneCall#465893' - '2009/01/04' - 'TakePhoto#467929' - 'DSC_4204.JPG' You've found the filename! - 'DSC_4204.JPG'