Undergraduate Poster Presentation Match 31, 2015 Department of CSE, BUET, Dhaka, Bangladesh Wireless Sensor Network Integretion With Cloud Computing H.M.A.

Slides:



Advertisements
Similar presentations
Mapreduce and Hadoop Introduce Mapreduce and Hadoop
Advertisements

EHarmony in Cloud Subtitle Brian Ko. eHarmony Online subscription-based matchmaking service Available in United States, Canada, Australia and United Kingdom.
 Need for a new processing platform (BigData)  Origin of Hadoop  What is Hadoop & what it is not ?  Hadoop architecture  Hadoop components (Common/HDFS/MapReduce)
The Google File System. Why? Google has lots of data –Cannot fit in traditional file system –Spans hundreds (thousands) of servers connected to (tens.
CS 441: Charles Durran Kelly.  What are Wireless Sensor Networks?  WSN Challenges  What is a Smartphone Sensor Network?  Why use such a network? 
AN INTRODUCTION TO CLOUD COMPUTING Web, as a Platform…
Presented by Sujit Tilak. Evolution of Client/Server Architecture Clients & Server on different computer systems Local Area Network for Server and Client.
WORKFLOWS IN CLOUD COMPUTING. CLOUD COMPUTING  Delivering applications or services in on-demand environment  Hundreds of thousands of users / applications.
Platform as a Service (PaaS)
Google Distributed System and Hadoop Lakshmi Thyagarajan.
Security Difficulties of E-Learning in Cloud Computing
Take An Internal Look at Hadoop Hairong Kuang Grid Team, Yahoo! Inc
U.S. Department of the Interior U.S. Geological Survey David V. Hill, Information Dynamics, Contractor to USGS/EROS 12/08/2011 Satellite Image Processing.
Building Sustainable MIS Infrastuctures
Cloud Computing All Copyrights reserved to Talal Abu-Ghazaleh Organization
Cloud computing is the use of computing resources (hardware and software) that are delivered as a service over the Internet. Cloud is the metaphor for.
CSC 456 Operating Systems Seminar Presentation (11/13/2012) Leon Weingard, Liang Xin The Google File System.
Cloud Distributed Computing Environment Content of this lecture is primarily from the book “Hadoop, The Definite Guide 2/e)
Cloud Computing 1. Outline  Introduction  Evolution  Cloud architecture  Map reduce operation  Platform 2.
Software Architecture
Authors: Jiann-Liang Chenz, Szu-Lin Wuy,Yang-Fang Li, Pei-Jia Yang,Yanuarius Teofilus Larosa th International Wireless Communications and Mobile.
CS525: Special Topics in DBs Large-Scale Data Management Hadoop/MapReduce Computing Paradigm Spring 2013 WPI, Mohamed Eltabakh 1.
HDFS Hadoop Distributed File System
Introduction to Cloud Computing
Latest Relevant Techniques and Applications for Distributed File Systems Ela Sharda
EXPOSE GOOGLE APP ENGINE AS TASKTRACKER NODES AND DATA NODES.
W HAT IS H ADOOP ? Hadoop is an open-source software framework for storing and processing big data in a distributed fashion on large clusters of commodity.
Introduction to Apache Hadoop Zibo Wang. Introduction  What is Apache Hadoop?  Apache Hadoop is a software framework which provides open source libraries.
Hadoop/MapReduce Computing Paradigm 1 Shirish Agale.
Introduction to Hadoop and HDFS
f ACT s  Data intensive applications with Petabytes of data  Web pages billion web pages x 20KB = 400+ terabytes  One computer can read
Cloud Computing & Amazon Web Services – EC2 Arpita Patel Software Engineer.
CSE 548 Advanced Computer Network Security Document Search in MobiCloud using Hadoop Framework Sayan Cole Jaya Chakladar Group No: 1.
By: Ashish Gohel 8 th sem ISE.. Why Cloud Computing ? Cloud Computing platforms provides easy access to a company’s high-performance computing and storage.
Grid Computing at Yahoo! Sameer Paranjpye Mahadev Konar Yahoo!
Issues Autonomic operation (fault tolerance) Minimize interference to applications Hardware support for new operating systems Resource management (global.
Tutorial: Big Data Algorithms and Applications Under Hadoop KUNPENG ZHANG SIDDHARTHA BHATTACHARYYA
HDFS (Hadoop Distributed File System) Taejoong Chung, MMLAB.
Windows Azure. Azure Application platform for the public cloud. Windows Azure is an operating system You can: – build a web application that runs.
HADOOP DISTRIBUTED FILE SYSTEM HDFS Reliability Based on “The Hadoop Distributed File System” K. Shvachko et al., MSST 2010 Michael Tsitrin 26/05/13.
CS525: Big Data Analytics MapReduce Computing Paradigm & Apache Hadoop Open Source Fall 2013 Elke A. Rundensteiner 1.
Stairway to the cloud or can we take the highway? Taivo Liik.
Chapter 8 – Cloud Computing
Hadoop/MapReduce Computing Paradigm 1 CS525: Special Topics in DBs Large-Scale Data Management Presented By Kelly Technologies
Microsoft Cloud Solution.  What is the cloud?  Windows Azure  What services does it offer?  How does it all work?  How to go about using it  Further.
3/12/2013Computer Engg, IIT(BHU)1 CLOUD COMPUTING-2.
{ Tanya Chaturvedi MBA(ISM) Hadoop is a software framework for distributed processing of large datasets across large clusters of computers.
Cloud Distributed Computing Environment Hadoop. Hadoop is an open-source software system that provides a distributed computing environment on cloud (data.
Distributed File System. Outline Basic Concepts Current project Hadoop Distributed File System Future work Reference.
PARALLEL AND DISTRIBUTED PROGRAMMING MODELS U. Jhashuva 1 Asst. Prof Dept. of CSE om.
INTRODUCTION TO HADOOP. OUTLINE  What is Hadoop  The core of Hadoop  Structure of Hadoop Distributed File System  Structure of MapReduce Framework.
1 Student Date Time Wei Li Nov 30, 2015 Monday 9:00-9:25am Shubbhi Taneja Nov 30, 2015 Monday9:25-9:50am Rodrigo Sanandan Dec 2, 2015 Wednesday9:00-9:25am.
BIG DATA/ Hadoop Interview Questions.
What is it and why it matters? Hadoop. What Is Hadoop? Hadoop is an open-source software framework for storing data and running applications on clusters.
Cofax Scalability Document Version Scaling Cofax in General The scalability of Cofax is directly related to the system software, hardware and network.
Leverage Big Data With Hadoop Analytics Presentation by Ravi Namboori Visit
Platform as a Service (PaaS)
Platform as a Service (PaaS)
Dr.S.Sridhar, Director, RVCT, RVCE, Bangalore
Introduction to Distributed Platforms
Dr.S.Sridhar, Director, RVCT, RVCE, Bangalore
Software Engineering Introduction to Apache Hadoop Map Reduce
Ministry of Higher Education
GARRETT SINGLETARY.
Outline Virtualization Cloud Computing Microsoft Azure Platform
Hadoop Technopoints.
Big Data Young Lee BUS 550.
Lecture 16 (Intro to MapReduce and Hadoop)
Presentation transcript:

Undergraduate Poster Presentation Match 31, 2015 Department of CSE, BUET, Dhaka, Bangladesh Wireless Sensor Network Integretion With Cloud Computing H.M.A Alam, Amit Biswas Department of Computer Science and Engineering, Bangladesh University of Engineering and Technology, Dhaka, Bangladesh  Cloud computing is a practice of using a network of remote servers hosted on the Internet to store, manage, and process data, rather than a local server or a personal computer.  Several types of cloud service available Software as a service (SaaS) Platform as a service (PaaS) Infrastructure as a service (SaaS)  A wireless sensor network (WSN) (sometimes called a wireless sensor and actor network (WSAN)) are spatially distributed autonomous sensors to monitor physical or environmental conditions.  Wireless sensor network send huge amount of data. This can not be handled in traditional way. I. Introduction II. Objective IV. Some DFS Services VI.HDFS(Hadoop Distributed File System)  Scalable  Secure  Fast  Possible to interface with computers III. Background  Sensors from wireless sensor network send data in almost every 5 second. If the number of sensor is high, the amount of data received at server will be huge.  We are not sure about how many space needed for storing sensor data. Cloud service can be a good solution.  Cloud Computing reduces capital costs. There’s no need to spend big money on hardware, software or licensing fees.  Processing this amount of data in one machine can be costly. So we use distributed file system. Some distributed file systems support scaling from one pc to thousands.  Nimbits  Nimbits Run on Google App Engine platform. Nimbits server can also be installed on any J2EE server like Apache,Tomcat,Jetty,WebSphere or JBOSS running on Amazon EC2,our servers or even a Raspberry Pi.  Nimbits is an Open Source Java Library that provides an easy way to develop JAVA, Web and Android solutions that use a Nimbits Server as a backend platform.  Nimbits Server records and processes geo and time stamped data and executes rules we define based on that information. V. Challenges of WSN o Ad hoc deployment, requiring that the system identities and copes with the resulting distribution and connectivity of nodes. o Dynamic environmental conditions requiring the system to adapt over time to changing connectivity and system stimuli. o Unattended operation requiring configuration and reconfiguration be automatic (self-configuration). o WSN deal with real world environments. In many cases, sensor data must be delivered within time constraints so that appropriate observations can be made or actions taken. o WSN are limited in their energy, computation, and communication capabilities.  Data is organized into les and directories.  Files are divided into uniform sized blocks (default 64MB) and distributed across cluster nodes.  Blocks are replicated (default 3) to handle hardware failure.  Replication for performance and fault tolerance (Rack- Aware placement).  HDFS keeps checksums of data for corruption detection and recovery.  Hadoop  Hadoop is a free, Java-based programming framework that supports the processing of large data sets in a distributed computing environment. The Apache Hadoop project develops open-source software for reliable, scalable, distributed computing.  Hadoop DFS provides high throughput access to application data.  Hadoop Yarn is a framework for job scheduling and cluster management.  Hadoop Map Reduce is Yarn based system for parallel processing of large data set. VI.Goal Main advantage of Hadoop is that, it is open source. So we can study it’s code. We are currently studying about Hadoop open source code, configuration and sensor network simultaneously. As sensor network send data at a high rate, a huge amount of data has to be analyzed. Which is quite impossible to do with normal machine. We have to use Hadoop. In the next few week we will try to and some ways to improve the performance and also see security of Hadoop closely to look for any error. We can also use Hadoop Map Reduce to do a job with big data.