Discussion on Time Series Data Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: 2015-07-01 Work Item :WI-0033.

Slides:



Advertisements
Similar presentations
Problem of non-Blocking Synchronous mode Group Name: ARC WG Source: Yuan Tao, Mitch Tseng, Huawei Technologies Meeting Date: ARC 15.0 Agenda Item: TBD.
Advertisements

1.2 Row Reduction and Echelon Forms
Database Systems: A Practical Approach to Design, Implementation and Management International Computer Science S. Carolyn Begg, Thomas Connolly Lecture.
Discussion on constraint device optimization Group Name: ARC Source: Jiaxin (Jason) Yin, Huawei Technologies Co., Ltd., Meeting Date:
Group:WG3 (PRO) Source:Peter Niblett, IBM, Date: Agenda:PRO#14 TS-0004 Data Representation Proposal Discussion.
Method of Converting Resource definitions into XSD Group Name: WG3 (PRO) Source: Shingo Fujimoto, FUJITSU, Meeting Date:
Business Intelligence
Group:WG3 (PRO) Source:Peter Niblett, IBM, Date: Agenda:PRO#14 TS-0004 Data Representation Proposal Discussion.
Practical Database Design and Tuning. Outline  Practical Database Design and Tuning Physical Database Design in Relational Databases An Overview of Database.
Resource Announcement Procedures Group Name: WG2 Source: Rajesh Bhalla, Hao Wu - ZTE Meeting Date: Agenda Item: TBD.
Mechanism to support establishment of charging policies Group Name: WG2-ARC Source: InterDigital Meeting Date: TP8 Agenda Item:
Recursion, Complexity, and Searching and Sorting By Andrew Zeng.
Chapter 16 Methodology – Physical Database Design for Relational Databases.
Recursion, Complexity, and Sorting By Andrew Zeng.
Announcement Resources ARC Announcement_Issues Group Name: WG2 Source: Barbara Pareglio, NEC Meeting Date: Agenda Item: Input Contribution.
Introduction of PRO WG activities Group Name: TP Source: Shingo Fujimoto, FUJITSU, Meeting Date: Agenda Item:
Chapter 10: File-System Interface 10.1 Silberschatz, Galvin and Gagne ©2011 Operating System Concepts – 8 th Edition 2014.
Operating Systems (CS 340 D) Dr. Abeer Mahmoud Princess Nora University Faculty of Computer & Information Systems Computer science Department.
Chapter 16 Practical Database Design and Tuning Copyright © 2004 Pearson Education, Inc.
Supporting Time Series Data Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: Work Item :WI-0033.
Management of CMDH Policies Group Name: WG5-MAS Source: Wolfgang Granzow, Qualcomm, Meeting Date: Agenda Item: Management.
Discussion on the problem of non- Blocking Synchronous mode Group Name: ARC WG Source: Yuan Tao, Mitch Tseng, Huawei Technologies Meeting Date: ARC 15.2.
Union-find Algorithm Presented by Michael Cassarino.
WG5 - MAS Progress Report at TP #9 Group Name: WG5 MAS (Management, Abstraction & Semantics) Source: Yongjing Zhang, Chair, Meeting.
Ontology Architectural Support Options Group Name: MAS WG Source: Catalina Mladin, Lijun Dong, InterDigital Meeting Date: Agenda Item: TBD.
Methodology – Physical Database Design for Relational Databases.
File Structures. 2 Chapter - Objectives Disk Storage Devices Files of Records Operations on Files Unordered Files Ordered Files Hashed Files Dynamic and.
Customized Resource Types MAS Group Name: MAS + ARC + PRO WGs Source: Wolfgang Granzow, Qualcomm Inc., Meeting Date:
Discussion on the problem of non- Blocking Synchronous mode Group Name: ARC WG Source: Yuan Tao, Mitch Tseng, Huawei Technologies Meeting Date: ARC 15.2.
Work for the next release Group Name: TP Source: JaeSeung Song, KETI, Jaeho Kim, KETI,
Step by step approach Group Name: WG2 Source: Michael hs. Yang, LG uplus, Jaeseung Song, NEC Europe, Meeting.
Node-Specific Resource Group Name: ARC&MAS Source: LGE, Meeting Date: Agenda Item: Contribution.
TP WG1 status report to TP#16 Group Name: oneM2M TP16 Source: Shelby Kiewel (iconectiv) Meeting Date: to Agenda Item: TP#16,
Ontology Resource Discussion
App-ID Use Cases, Syntax and Attributes ARC R01-App-ID_Use_Cases,_Syntax_and_Attributes Group Name: Architecture Source: Darold Hemphill, iconectiv,
Ontology Architectural Support Options Group Name: MAS WG Source: Catalina Mladin, Lijun Dong, InterDigital Meeting Date: Agenda Item: TBD.
Supporting Time Series Data Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: Work Item :WI-0033.
Management of Semantic Instances in resources using SPARQL update operation with HTTP verbs Group Name: MAS 19 Source: Minwoo Ryu, jaeho Kim, Sungchan.
CIS 250 Advanced Computer Applications Database Management Systems.
Different planes for the resource structure Group Name: WG5 – MAS and WG2 – ARC Source: Nicolas Damour, Sierra Wireless
Routing Problem of the Current Architecture Group Name: ARC Source: Hongbeom Ahn, LG Electronics, Meeting Date: Agenda.
Different planes for the resource structure Group Name: WG5 – MAS and WG2 – ARC Source: Nicolas Damour, Sierra Wireless
M2M Service Subscription Profile Discussion Group Name: oneM2M TP #19.2 Source: LG Electronics Meeting Date: Agenda Item:
PRO/ARC and TST/PRO joint sessions at TP20 Group Name: oneM2M TP20 Source: Peter Niblett, IBM Meeting Date:
WG5 – MAS#19 Status Report Group Name: WG5 MAS (Management, Abstraction & Semantics) Source: Yongjing Zhang (Huawei, WG5 Chair) Meeting Date:
WG1 status report to TP#21 Group Name: oneM2M TP21 Source: Shelby Kiewel (iconectiv) Meeting Date: to Agenda Item: TP#21, Item 10.4,
ARC / PRO questions Source: Peter Niblett, IBM Date:
Attribute-level access control Group Name: ARC WG Source: Yuan Tao, Mitch Tseng, Huawei Technologies Meeting Date: ARC 16 Agenda Item: TBD.
WG1 status report to TP#20 Group Name: oneM2M TP20 Source: Joerg Swetina (NEC) Meeting Date: to Agenda Item: TP#19, Item 10.4, Reports.
Adding Non-blocking Requests Contribution: oneM2M-ARC-0441R01R01 Source: Josef Blanz, Qualcomm UK, Meeting Date: ARC 7.0,
Authorization Architecture Discussion Group Name: SEC WG Source: Seongyoon Kim, LG Electronics, Meeting Date: 28 MAY, 2014 Agenda.
Subscription and Notification Issue Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: ~23 Agenda Item:
1 1.2 Linear Equations in Linear Algebra Row Reduction and Echelon Forms © 2016 Pearson Education, Ltd.
Discussion of open issues for WebSocket binding Group Name: PRO WG Source: Qualcomm Inc., Wolfgang Granzow, Nobu Uchida Meeting Date: PRO#22,
Introduction to Service Session Management Group Name: WG2-ARC Source: IDCC, LGE, ZTE Meeting Date: TP8 Agenda Item:
Possible options of using DDS in oneM2M Group Name: ARC Source: KETI, Huawei, Hitachi, China Unicom Meeting Date: Agenda Item: DDS binding.
Status of Active Work Items Level of Completeness
Practical Database Design and Tuning
CSE Retargeting to AE, IPE, and NoDN Hosted Resources
CSE Retargeting to AE, IPE, and NoDN Hosted Resources
Service Enabled AE (SAE)
2nd Interoperability testing issues
Possible options of using DDS in oneM2M
Issues of <locationPolicy> Discussion
Discussions on Heterogeneous Identification Service
TS-0004 Data Representation Proposal Discussion
Considering issues regarding handling token
Service Layer Dynamic Authorization [SLDA]
Practical Database Design and Tuning
oneM2M interop 6 action point
Presentation transcript:

Discussion on Time Series Data Group Name: WG2 Source: Qi Yu, Mitch Tseng- Huawei Technologies, Co. LTD. Meeting Date: Work Item :WI-0033

Introduction The definition of Time Series Data in TS-0011: Time series data is a sequence of data points, typically consisting of successive measurements made over a time interval. The following two requirements have been agreed and the related WI-0033 Supporting Time Series Data has been agreed at TP#17 as well. – The oneM2M System shall be able to collect, store time series data. – The oneM2M System shall be able to detect and report the missing data in time series. © 2015 oneM2M Partners 2

Introduction Time Series data is widely existing in many verticals. – Periodical monitoring data from product line in industrial domain – Report Heartbeat and blood pressure periodically in ehealth – Report location information of the car in ITS The characters of time series data :(v1,t1),(v2,t2),(v3,t3)……. – Chronologically – Dynamically – Infinitely – In most cases, small amount of data in each occurrence

Use of Time Series Data Example: Collecting Location data of taxis in Beijing. The taxi should report its location information to the platform once every minute. This information includes the GPS data and time when the data was generated. The taxi company can use these data to do the following analysis: Average miles which the taxi is driven daily or monthly. Track historical location information of the taxi in a specific month …… The platform should store the data; however, the use of data depends on the requirements from the application.

Issues © 2015 oneM2M Partners 5 1.Time series data need to be updated whenever there are new data present. However, cannot be modified once created. 2.The current cannot reflect the time information when the data are collected by the device. Whenever a new data is arriving, a new contenInstance ressource needs to be created. It will add to the data redundanby in the attributes e.g. reourceType,ParentID…. Attributes of Multiplicit y resourceType1 resourceID1 resourceName1 parentID1 labels0..1 (L) expirationTime1 creationTime1 lastModifiedTime1 stateTag1 announceTo0..1 (L) announcedAttribute0..1 (L) creator0..1 contentInfo0..1 contentSize1 ontologyRef0..1 content1

Issues Location information (GPS) of Beijing’ taxis There are nearly taxis by Every minute, the taxis generates one GPS data in general. So the total amount of data transactions have reached near 100 Million times level in a day. (67000*24*60 ~ 96.5 Millions) ̶There are at 100M level of resources to be created. That’s to say we should organize and manage these new resources and a huge amount of history data resource. ̶There are also at least 4 attributes (resourceType, resourceName, parentID, stateTag) which will be created for one location values in a resource. So it will make large data redundancy. ̶The other issue we need to consider is the constrained devices which has limited resource.

Option 1 © 2015 oneM2M Partners 7 Option1 is to define a new resource for time series data. The List attribute is used to store data and time when the device generated the data. List is complex data type and it is used to store chronological series of arrays which includes the data and the time when the data was produced, for example, product line monitoring data (value1, time1), (value2, time2).,, (value1, time1),(value2,time2),(value3, time3),(value4, time4),.....

Option1 (cont.) OriginatorReceiver 1. Update Request (list=(vauleN, timeN)) 2.The Receiver shall insert this array into the list attribute based on time. 3.Update Response list: (value1, time1) (value2, time2) ……… (valueN, timeN) A new coming Time Series Data should be appended or inserted into the list attribute based on time information. The existing UPDATE operation allows to modify or create previously non-existing attributes of the resource type. This is whole replacement of the attribute. The option1 needs to change the existing UPDATE operation to support inserting array into the List.

Option 2 The option2 is to use the existing contentIstance resource and add a new atrribute. The contentGenerationTime attribute is the time when the corresponding content was generated by the M2M Node. A new coming Time Series Data will lead to create a new contentInstance. This will lead to redundancy.

Option3 Attributes of Multiplicity RW/ RO/ WO Description Attributes resourceType1ROSee clause where this common attribute is described. NA resourceID1ROSee clause where this common attribute is described. NA resourceName1WOSee clause where this common attribute is described. MA parentID1ROSee clause where this common attribute is described. NA creationTime1ROSee clause where this common attribute is described. NA Time1WOThis attribute contains the time when the data was collected from M2M Node OA Data1WOThis attribute contains the data collected from M2M Node OA The option 3 is to define a simple resource type which includes the data,time and necessary attributes. The other necessary attributes refer to the parent resource such as ACP, label, etc. A new coming Time Series Data will lead to create a new timeSeriesData.

Comparison of Solutions © 2015 oneM2M Partners 11 OptionAnalysis Option1A new resource is defined, but need to change the existing UPDAT operation. Option2A new attribute is defined. A new time series data will lead to create a new contentInstance resource. Option2 will lead to the data redundancy,especially for constrained devices with limited resource. Option3A new resource with limited attributes is defined.

Way Forward Define a new resource type with limited attributes to support the time series data based on the comparison of the solutions.

Thanks © 2015 oneM2M Partners 13