Supporting Time Series Data Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: 2015-07-01 Work Item :WI-0033.

Slides:



Advertisements
Similar presentations
Copyright © 2007 Ramez Elmasri and Shamkant B. Navathe Slide
Advertisements

Release 2: Work Items best practices Group Name: TP15 Source: Scarrone Enrico, Telecom Italia Meeting Date:
Problem of non-Blocking Synchronous mode Group Name: ARC WG Source: Yuan Tao, Mitch Tseng, Huawei Technologies Meeting Date: ARC 15.0 Agenda Item: TBD.
Discussion on constraint device optimization Group Name: ARC Source: Jiaxin (Jason) Yin, Huawei Technologies Co., Ltd., Meeting Date:
Group:WG3 (PRO) Source:Peter Niblett, IBM, Date: Agenda:PRO#14 TS-0004 Data Representation Proposal Discussion.
Patrick Seto CS157A Section 3 Data Warehouses Presented by Patrick Seto CS157A Section 3.
©2012 Experian Information Solutions, Inc. All rights reserved. Experian and the marks used herein are service marks or registered trademarks of Experian.
OneM2M-MP Data_Model_Repository Establishing Data Model Repository for oneM2M Group Name: Method and Procedure Sub-commitee Source: WG3 chair.
Business Intelligence
Group:WG3 (PRO) Source:Peter Niblett, IBM, Date: Agenda:PRO#14 TS-0004 Data Representation Proposal Discussion.
File Management Chapter 12. File Management File management system is considered part of the operating system Input to applications is by means of a file.
Resource Announcement Procedures Group Name: WG2 Source: Rajesh Bhalla, Hao Wu - ZTE Meeting Date: Agenda Item: TBD.
Mechanism to support establishment of charging policies Group Name: WG2-ARC Source: InterDigital Meeting Date: TP8 Agenda Item:
Discussions for oneM2M Semantics Standardization Group Name: WG5 Source: InterDigital Communications Meeting Date: Agenda Item: WI-0005 ASN/MN-CSE.
Chapter 16 Methodology – Physical Database Design for Relational Databases.
Discussion on Time Series Data Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: Work Item :WI-0033.
© 2012 Experian Information Solutions, Inc. All rights reserved. Experian and the marks used herein are service marks or registered trademarks of Experian.
Thoughts on oneM2M resource tree Group Name: WG2 Architecture at TP#7 (Sophia, October 2013) Source: Nicolas Damour, Sierra Wireless
Announcement Resources ARC Announcement_Issues Group Name: WG2 Source: Barbara Pareglio, NEC Meeting Date: Agenda Item: Input Contribution.
Discussion on the problem of non- Blocking Synchronous mode Group Name: ARC WG Source: Yuan Tao, Mitch Tseng, Huawei Technologies Meeting Date: ARC 15.2.
WG1 status report to TP#17 Group Name: oneM2M TP17 Source: Shelby Kiewel (iconectiv) Meeting Date: to Agenda Item: TP#17, Item 10.3,
Union-find Algorithm Presented by Michael Cassarino.
Ontology Architectural Support Options Group Name: MAS WG Source: Catalina Mladin, Lijun Dong, InterDigital Meeting Date: Agenda Item: TBD.
Customized Resource Types MAS Group Name: MAS + ARC + PRO WGs Source: Wolfgang Granzow, Qualcomm Inc., Meeting Date:
Discussion on the problem of non- Blocking Synchronous mode Group Name: ARC WG Source: Yuan Tao, Mitch Tseng, Huawei Technologies Meeting Date: ARC 15.2.
Work for the next release Group Name: TP Source: JaeSeung Song, KETI, Jaeho Kim, KETI,
WG5 - MAS Progress Report at TP #10 Group Name: WG5 MAS (Management, Abstraction & Semantics) Source: WG5 Chairs Meeting Date: to
CISC Machine Learning for Solving Systems Problems Presented by: Suman Chander B Dept of Computer & Information Sciences University of Delaware Automatic.
TP WG1 status report to TP#16 Group Name: oneM2M TP16 Source: Shelby Kiewel (iconectiv) Meeting Date: to Agenda Item: TP#16,
Ontology Architectural Support Options Group Name: MAS WG Source: Catalina Mladin, Lijun Dong, InterDigital Meeting Date: Agenda Item: TBD.
WG 2 Progress Report at TP#9 Group Name: oneM2M TP #9 Source: WG2 leadership Meeting Date: /21 Agenda Item: WG Reports.
Supporting Time Series Data Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: Work Item :WI-0033.
Different planes for the resource structure Group Name: WG5 – MAS and WG2 – ARC Source: Nicolas Damour, Sierra Wireless
Different planes for the resource structure Group Name: WG5 – MAS and WG2 – ARC Source: Nicolas Damour, Sierra Wireless
WG-2 - ARC TP #18 Status Report Group Name: oneM2M TP #18 Source: WG2 Chair (Nicolas Damour – Meeting Date: Agenda.
PRO/ARC and TST/PRO joint sessions at TP20 Group Name: oneM2M TP20 Source: Peter Niblett, IBM Meeting Date:
Planning for the test event Group Name: TST Source: Jiaxin Yin, Huawei Technologies Co., Ltd., Meeting Date: Agenda Item:
Architectural Considerations for Semantic Support Group Name: WG5 Source: Martin Bauer (NEC), Joerg Swetina (NEC) Meeting Date: Agenda Item:
OIC INTERWORKING Resource mapping
WG5 – MAS#19 Status Report Group Name: WG5 MAS (Management, Abstraction & Semantics) Source: Yongjing Zhang (Huawei, WG5 Chair) Meeting Date:
WG1 status report to TP#21 Group Name: oneM2M TP21 Source: Shelby Kiewel (iconectiv) Meeting Date: to Agenda Item: TP#21, Item 10.4,
ARC / PRO questions Source: Peter Niblett, IBM Date:
Status of Active Work Items Level of Completeness Group Name: WPM Source: Roland Hechwartner, WPM Convenor Updated:
Attribute-level access control Group Name: ARC WG Source: Yuan Tao, Mitch Tseng, Huawei Technologies Meeting Date: ARC 16 Agenda Item: TBD.
WG1 status report to TP#20 Group Name: oneM2M TP20 Source: Joerg Swetina (NEC) Meeting Date: to Agenda Item: TP#19, Item 10.4, Reports.
Subscription and Notification Issue Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: ~23 Agenda Item:
WG5 – MAS#22 Status Report Group Name: WG5 MAS (Management, Abstraction & Semantics) Source: Tim Carey(Alcatel-Lucent, WG5 Vice Chair) Meeting Date:
What’s New – Shipments Comparison of GSCP and the New Supply Chain Platform for Ministry of Defence (SCP-MOD) January 2014.
DM Execute Group Name: WG2/WG5 Source: Jiaxin Yin, Huawei Technologies Co., Ltd., Meeting Date: Agenda Item: TBD.
Discussion of open issues for WebSocket binding Group Name: PRO WG Source: Qualcomm Inc., Wolfgang Granzow, Nobu Uchida Meeting Date: PRO#22,
TS-0004 guideline for new resource type definition Group Name: PRO WG Source: SeungMyeong JEONG, LG Electronics Meeting Date: Agenda Item: TS.
Introduction to Service Session Management Group Name: WG2-ARC Source: IDCC, LGE, ZTE Meeting Date: TP8 Agenda Item:
Possible options of using DDS in oneM2M Group Name: ARC Source: KETI, Huawei, Hitachi, China Unicom Meeting Date: Agenda Item: DDS binding.
Methods of Work Report Group Name: TP#10 Source: Enrico Scarrone, Telecom Italia, Meeting.
Joint PRO/ARC session at TP20 Group Name: oneM2M TP20 Source: Peter Niblett, IBM Meeting Date:
Status of Active Work Items Level of Completeness
Practical Database Design and Tuning
CSE Retargeting to AE, IPE, and NoDN Hosted Resources
CSE Retargeting to AE, IPE, and NoDN Hosted Resources
Service Enabled AE (SAE)
Possible options of using DDS in oneM2M
Issues of <locationPolicy> Discussion
Discussions on Heterogeneous Identification Service
TS-0004 Data Representation Proposal Discussion
oneM2M Versioning Next Steps
Project Overview Introduction to Factory Automation Numerical Control
Practical Database Design and Tuning
Database Design Chapters 17 and 18.
Financial Control (FC)
Presentation transcript:

Supporting Time Series Data Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: Work Item :WI-0033

Introduction The definition of Time Series Data in TS-0011: Time series data is a sequence of data points, typically consisting of successive measurements made over a time interval. The following two requirements have been agreed and the related WI-0033 Supporting Time Series Data has been agreed at TP#17 as well. – The oneM2M System shall be able to collect, store time series data. – The oneM2M System shall be able to detect and report the missing data in time series. © 2015 oneM2M Partners 2

Introduction Time Series data is widely existing in many verticals. – Periodical monitoring data from product line in industrial domain – Report Heartbeat and blood pressure periodically in ehealth – Report location information of the car in ITS The characters of time series data :(v1,t1),(v2,t2),(v3,t3)……. – Chronologically – Dynamically – Infinitely – In most cases, small amount of data in each occurrence

Use of Time Series Data Example: Collecting Location data of taxis in Beijing. The taxi should report its location information to the platform once every minute. This information includes the GPS data and time when the data was generated. The taxi company can use these data to do the following analysis: Average miles which the taxi is driven daily or monthly. Track historical location information of the taxi in a specific month …… The platform should store the data; however, the use of data depends on the requirements from the application.

Issues © 2015 oneM2M Partners 5 1.Time series data need to be updated whenever there are new data present. However, cannot be modified once created. 2.The current cannot reflect the time information when the data are collected by the device. Whenever a new data is arriving, a new contenInstance ressource needs to be created. It will add to the data redundanby in the attributes e.g. reourceType,ParentID…. Attributes of Multiplicit y resourceType1 resourceID1 resourceName1 parentID1 labels0..1 (L) expirationTime1 creationTime1 lastModifiedTime1 stateTag1 announceTo0..1 (L) announcedAttribute0..1 (L) creator0..1 contentInfo0..1 contentSize1 ontologyRef0..1 content1

Issues Location information (GPS) of Beijing’ taxis There are nearly taxis by Every minute, the taxis generates one GPS data in general. So the total amount of data transactions have reached near 100 Million times level in a day. (67000*24*60 ~ 96.5 Millions) ̶There are at 100M level of resources to be created. That’s to say we should organize and manage these new resources and a huge amount of history data resource. ̶There are also at least 4 attributes (resourceType, resourceName, parentID, stateTag) which will be created for one location values in a resource. So it will make large data redundancy.

Option 1 © 2015 oneM2M Partners 7 Option1 to solve this problem is to define a new resource for time series data. The List attribute is used to store data and time when the device generated the data.

Option 2 A new attribute generatedTime is defined to reflect the time when the device or senor generated the time series data. A new time series data will lead to create a new contentInstance resource.

Option 3 A new attribute generatedTime is defined to reflect the time when the device or senor generated the time series data. Multiplicity of content is changed as well to accommodate more time series data. In this case, the content attribute needs to store the data and the related time when the data were collected by the device. It will also lead to a need to update content attribute when new data arrive.

Option 4 Two new attributes are defined to store time series data. In this case, these two attribute needs to store the data and the related time when the data were collected by the device.

Comparison of Solutions © 2015 oneM2M Partners 11 OptionAnalysis Option1A new resource is defined and has minimum impact on R1. Option2A new attribute generatedTime is defined. A new time series data will lead to create a new contentInstance resource and may result in redundancy. Option3A new attribute generatedTime is defined to reflect the time when the device or senor generated the time series data. Multiplicity of content is changed as well to accommodate more time series data. This follows the rule that contentInstance cannot be modified once created. Option4Two new attributes are defined to store time series data. This follows the rule that contentInstance cannot be modified once created

Way Forward Define a new resource or new attributes to support the time series data.

Thanks © 2015 oneM2M Partners 13