An Architecture for Video Surveillance Service based on P2P and Cloud Computing Yu-Sheng Wu, Yue-Shan Chang, Tong-Ying Juang, Jing-Shyang Yen speaker:

Slides:



Advertisements
Similar presentations
Suggested Course Outline Cloud Computing Bahga & Madisetti, © 2014Book website:
Advertisements

Building Cloud-ready Video Transcoding System for Content Delivery Networks(CDNs) Zhenyun Zhuang and Chun Guo Speaker: 饒展榕.
Reliability on Web Services Presented by Pat Chan 17/10/2005.
CEDCOM High performance architecture for big data applications Tanguy Raynaud CEDAR Project.
Authors: Thilina Gunarathne, Tak-Lon Wu, Judy Qiu, Geoffrey Fox Publish: HPDC'10, June 20–25, 2010, Chicago, Illinois, USA ACM Speaker: Jia Bao Lin.
Conclusions in Peer-to-Peer Systems Παρουσίαση: Τάσος Καραγιάννης, Σπυριδούλα Μαργαρίτη, Κώστας Στεφανίδης, Θοδωρής Τσώτσος.
Implementation of Simple Cloud-based Distributed File System Group ID: 4 Baolin Wu, Liushan Yang, Pengyu Ji.
Undergraduate Poster Presentation Match 31, 2015 Department of CSE, BUET, Dhaka, Bangladesh Wireless Sensor Network Integretion With Cloud Computing H.M.A.
Introduction to Cyberspace
Take An Internal Look at Hadoop Hairong Kuang Grid Team, Yahoo! Inc
Sanjay Ghemawat, Howard Gobioff, and Shun-Tak Leung Google∗
Research on cloud computing application in the peer-to-peer based video-on-demand systems Speaker : 吳靖緯 MA0G rd International Workshop.
1 The Google File System Reporter: You-Wei Zhang.
Cloud Distributed Computing Environment Content of this lecture is primarily from the book “Hadoop, The Definite Guide 2/e)
M i SMob i S Mob i Store - Mobile i nternet File Storage Platform Chetna Kaur.
Authors: Jiann-Liang Chenz, Szu-Lin Wuy,Yang-Fang Li, Pei-Jia Yang,Yanuarius Teofilus Larosa th International Wireless Communications and Mobile.
HDFS Hadoop Distributed File System
MapReduce: Hadoop Implementation. Outline MapReduce overview Applications of MapReduce Hadoop overview.
Hadoop Basics -Venkat Cherukupalli. What is Hadoop? Open Source Distributed processing Large data sets across clusters Commodity, shared-nothing servers.
W HAT IS H ADOOP ? Hadoop is an open-source software framework for storing and processing big data in a distributed fashion on large clusters of commodity.
Introduction to Apache Hadoop Zibo Wang. Introduction  What is Apache Hadoop?  Apache Hadoop is a software framework which provides open source libraries.
Hadoop/MapReduce Computing Paradigm 1 Shirish Agale.
Introduction to Hadoop and HDFS
Experimenting Lucene Index on HBase in an HPC Environment Xiaoming Gao Vaibhav Nachankar Judy Qiu.
Optimizing Cloud MapReduce for Processing Stream Data using Pipelining 作者 :Rutvik Karve , Devendra Dahiphale , Amit Chhajer 報告 : 饒展榕.
BFTCloud: A Byzantine Fault Tolerance Framework for Voluntary-Resource Cloud Computing Yilei Zhang, Zibin Zheng, and Michael R. Lyu
Mesos A Platform for Fine-Grained Resource Sharing in the Data Center Benjamin Hindman, Andy Konwinski, Matei Zaharia, Ali Ghodsi, Anthony Joseph, Randy.
An Architecture for Distributed High Performance Video Processing in the Cloud Speaker : 吳靖緯 MA0G IEEE 3rd International Conference.
Distributed File System By Manshu Zhang. Outline Basic Concepts Current project Hadoop Distributed File System Future work Reference.
An Architecture for Distributed High Performance Video Processing in the Cloud 作者 :Pereira, R.; Azambuja, M.; Breitman, K.; Endler, M. 出處 :2010 IEEE 3rd.
Performance Evaluation of Image Conversion Module Based on MapReduce for Transcoding and Transmoding in SMCCSE Speaker : 吳靖緯 MA0G IEEE.
Optimizing Cloud MapReduce for Processing Stream Data using Pipelining 2011 UKSim 5th European Symposium on Computer Modeling and Simulation Speker : Hong-Ji.
Introduction to Hbase. Agenda  What is Hbase  About RDBMS  Overview of Hbase  Why Hbase instead of RDBMS  Architecture of Hbase  Hbase interface.
HDFS (Hadoop Distributed File System) Taejoong Chung, MMLAB.
A framework for scalable cloud video recorder system in surveillance environment th International Conference on Ubiquitous Intelligence and Computing.
Vehicular Cloud Networking: Architecture and Design Principles
Introduction to HDFS Prasanth Kothuri, CERN 2 What’s HDFS HDFS is a distributed file system that is fault tolerant, scalable and extremely easy to expand.
Research of P2P Architecture based on Cloud Computing Speaker : 吳靖緯 MA0G0101.
HADOOP DISTRIBUTED FILE SYSTEM HDFS Reliability Based on “The Hadoop Distributed File System” K. Shvachko et al., MSST 2010 Michael Tsitrin 26/05/13.
CS525: Big Data Analytics MapReduce Computing Paradigm & Apache Hadoop Open Source Fall 2013 Elke A. Rundensteiner 1.
The IEEE International Conference on Cluster Computing 2010
HADOOP Carson Gallimore, Chris Zingraf, Jonathan Light.
Application Level QoS in Multimedia Peer-to-Peer (P2P) Networks Alireza Goudarzi Nematiy and Makoto Takizawa¤ Tokyo Denki University
CloudPP: A Novel Cloud-based P2P Live Video Streaming Platform with SVC technology Speaker : 吳靖緯 MA0G th International Conference.
SECURITY IN DISTRIBUTED FILE SYSTEMS Tejaswini Kalluri, Venkata Prudhvi Raj Konda, Kanna Karri.
Authors: Jiann-Liang Chenz, Szu-Lin Wuy, Yang-Fang Li, Pei-Jia Yang,
Experiments in Utility Computing: Hadoop and Condor Sameer Paranjpye Y! Web Search.
張仕佳 1. + Video surveillance system (VSS) is useful to society. + For traditional VSS, each camera stores streaming data to a centralized server.
Cloud Distributed Computing Environment Hadoop. Hadoop is an open-source software system that provides a distributed computing environment on cloud (data.
Implementation of Simple Cloud-based Distributed File System Group ID: 4 Baolin Wu, Liushan Yang, Pengyu Ji.
Distributed File System. Outline Basic Concepts Current project Hadoop Distributed File System Future work Reference.
INTRODUCTION TO HADOOP. OUTLINE  What is Hadoop  The core of Hadoop  Structure of Hadoop Distributed File System  Structure of MapReduce Framework.
Distributed File Systems Sun Network File Systems Andrew Fıle System CODA File System Plan 9 xFS SFS Hadoop.
Seminar On Rain Technology
What is it and why it matters? Hadoop. What Is Hadoop? Hadoop is an open-source software framework for storing data and running applications on clusters.
CPSC8985 FA 2015 Team C3 DATA MIGRATION FROM RDBMS TO HADOOP By Naga Sruthi Tiyyagura Monika RallabandiRadhakrishna Nalluri.
PERFORMANCE MANAGEMENT IMPROVING PERFORMANCE TECHNIQUES Network management system 1.
Presenter: Yue Zhu, Linghan Zhang A Novel Approach to Improving the Efficiency of Storing and Accessing Small Files on Hadoop: a Case Study by PowerPoint.
Hadoop Aakash Kag What Why How 1.
Introduction to Distributed Platforms
The Improvement of PaaS Platform ZENG Shu-Qing, Xu Jie-Bin 2010 First International Conference on Networking and Distributed Computing SQUARE.
Ministry of Higher Education
Unistore: Project Updates
湖南大学-信息科学与工程学院-计算机与科学系
GARRETT SINGLETARY.
Hadoop Technopoints.
CS6282 Very Large Scale Distributed Systems
Introduction to Cyberspace
Network management system
Presentation transcript:

An Architecture for Video Surveillance Service based on P2P and Cloud Computing Yu-Sheng Wu, Yue-Shan Chang, Tong-Ying Juang, Jing-Shyang Yen speaker: 饒展榕

Outline INTRODUCTION BACKGROUND AND RELATED WORK SYSTEM DESIGN IMPLEMENTATION ISSUES CONCLUSION AND FUTURE WORK

INTRODUCTION For traditional distributed Video Surveillance Services, each video catcher will store its streaming data to server. It will create a great volume of data daily. In this paper, we propose a novel architecture based on well-developed peer to peer technology and emerging cloud computing for solving the issues.

The architecture exploits inherent characteristics of P2P and Cloud computing to provide an economic, scalable, reliable and efficient approach to store video data.

BACKGROUND AND RELATED WORK A. Hadoop The Apache Hadoop is a framework that allows distributed processing for large data sets across clusters of computers using a simple programming model. Hadoop is built up by two important parts, Mapreduce and Hadoop File System (HDFS).

In the Hadoop File System (HDFS), it provides global access to files in the cluster and is implemented by two kinds of node; the Name Node and the Data Node.

B. Surveillance System In this paper, we apply the data placement concept of Hadoop file system to provide fault tolerant and efficient video access and apply P2P technology to improve the scalability, reliability, robust, and server cost. Therefore, integrating both Hadoop concept and P2P technology can solve many issues of surveillance system.

SYSTEM DESIGN A.System Architecture The proposed system has two kinds of node. One is Directory Node (DN) which is responsible for managing all FEs, but does not keep all video data. The other is Peer Node (PN) which is responsible for storing the video data using P2P technology.

In the Hadoop concept, a piece of data generally has three replicas. 1.Primary PN (P-PN) 2.Secondary PN (S-PN) 3.Secondary PN (S-PN)

B.Components and Functionality Directory Node (DN): The node provides the centralized directory services. It contains following components: Authenticator Module (AM), Replica Manager (RM), Replica Scheduler (RS), and a DN Database for the directory of whole system.

Primary Peer Node (P-PN): The Primary Peer Node gets video data from FE directly. Video Dispatcher is responsible for transmitting and storing video data into its RG currently. The Video Dispatcher will store the caught video into local storage and deliver it to two replicas (S-PNs).

The RM is to communicate with the RM of DN and other PNs for authentication and getting associated information of SPN. Secondary Peer Node (S-PN): Undoubtedly, an S-PN of a RG is also a P-PN of another RG.

C.Operation Flow

IMPLEMENTATION ISSUES A. Peer Node State Here, we present some information and states inside a PN used for PN selection and video data access. The information comprises of peer node state contains the Unique ID, the peer node group, bandwidth, peer node’s replica state, authentication key and authorized state.

B.The PNs Scheduler in Video Recording We utilize the same replication scheme with Hadooplike file system to store video data. When a PN registers itself into the DN, it will be grouped together with other PNs (replicas) using our PN scheduling algorithm that provides a lookup service which according to the Peer Node’s storage space state and bandwidth.

CONCLUSION AND FUTURE WORK In this paper, we have proposed an architecture for video surveillance service by integrating P2P and hadooplike file system technology. Adapting P2P is used for connecting with each PN and storing video data to replicas.

It can improve scalability, cost and efficiency, while Hadoop is to improve reliability and efficiency. In the future, we want to implement the system to various embedded platform; and turn and evaluate the performance of the system.