Cassandra Installation Guide and Example Lecturer : Prof. Kyungbaek Kim Presenter : I Gde Dharma Nugraha.

Slides:



Advertisements
Similar presentations
COP 3530 JDK Environment Variables. COP 3530 JDK Environment Variables Environment Variables Environment variables are a set of dynamic values that can.
Advertisements

Platforms: Unix and on Windows. Linux: the only supported production platform. Other variants of Unix, like Mac OS X: run Hadoop for development. Windows.
The map and reduce functions in MapReduce are easy to test in isolation, which is a consequence of their functional style. For known inputs, they produce.
Hyrax Installation and Customization ESIP ‘08 Summer Meeting Best Practices in Services and Data Interoperability Dan Holloway James Gallagher.
Georgia Institute of Technology DrJava Appendix A Barb Ericson Georgia Institute of Technology May 2006.
Chapter Apache Installation on Linux. Acknowledgement The contribution made by Darrin Morison is acknowledged.
Introduction to Java IEEM241 Routing and Fleet Management Feb 3, 2005.
Java Programming Working with TextPad. Using TextPad to Work with Java This text editor is designed for working with Java You can download a trial version.
Install Software in Ubuntu. Do you have Internet? Everything is on the Internet and Free!
Johan Janssen, Info Support. Continuous delivery Docker Jenkins Questions.
Introduction to Java.
CS0007: Introduction to Computer Programming Setting Up Java.
DataStax Enterprise on Microsoft Azure. BrightView Analytics provides a robust Software-as-a-Service (SaaS) business solution, which delivers critical.
Reproducible Environment for Scientific Applications (Lab session) Tak-Lon (Stephen) Wu.
Tomcat Celsina Bignoli History of Tomcat Tomcat is the result of the integration of two groups of developers. – JServ, an open source.
Integrating HADOOP with Eclipse on a Virtual Machine Moheeb Alwarsh January 26, 2012 Kent State University.
One to One instructions Installing and configuring samba on Ubuntu Linux to enable Linux to share files and documents with Windows XP.
V Avon High School Tech Crew Agenda Old Business –Delete Files New Business –Week 10 Topics: Coming up: –Yearbook Picture: Feb 7 12:20PM.
The Network Management Lab pc pc pc pc pc Virtual Servers Your Laptop.
Servlets Environment Setup. Agenda:  Setting up Java Development Kit  Setting up Web Server: Tomcat  Setting up CLASSPATH.
CONNECT: Install Webinar for Code-A-Thon April 20th, 2010.
Hive Installation Guide and Practical Example Lecturer : Prof. Kyungbaek Kim Presenter : Alvin Prayuda Juniarta Dwiyantoro.
A few Linux basics Network Monitoring & Management.
UCSC All rights reserved. No part of this material may be reproduced and sold. 1 IT1202-Fundamentals Of Programming (Using JAVA) Interacting with.
1 Installation When this module is complete, you will be able to:  Set a static IP address for your laptop  Install the snom ONE software  Navigate.
1 Working with MS SQL Server Textbook Chapter 14.
CPSC1301 Computer Science 1 Overview of Dr. Java.
Cassandra – A Decentralized Structured Storage System Lecturer : Prof. Kyungbaek Kim Presenter : I Gde Dharma Nugraha.
1 Lab 2 “Hello world” in Unix/Linux #include "std_lib_facilities_4.h" int main(){ cout
Guide to Linux Installation and Administration1 Chapter 4 Running a Linux System.
Jabberd Quick Installation Guide. The jabberd server is the original open-source server implementation of the Jabber protocol, and is the most popular.
Distributed Networks & Systems Lab Distributed Networks and Systems(DNS) Lab, Department of Electronics and Computer Engineering Chonnam National University.
Basic Unix Commands CGS 3460, Lecture 6 Jan 23, 2006 Zhen Yang.
VMWare Workstation Installation. Starting Vmware Workstation Go to the start menu and start the VMware Workstation program. *Note: The following instructions.
Java Programming, Second Edition Appendix A Working with Java SDK 1.4.
Building Your Own Android Systems from Source Adam C. Champion CSE 5236: Mobile App Development 1.
Pig Installation Guide and Practical Example Presented by Priagung Khusumanegara Prof. Kyungbaek Kim.
Working with Hadoop. Requirement Virtual machine software –VM Ware –VirtualBox Virtual machine images –Download from Cloudera (Founded by leaders in the.
SQOOP INSTALLATION GUIDE Lecturer : Prof. Kyungbaek Kim Presenter : Zubair Amjad.
1 Installing Java on Your PC. Installing Java To develop Java programs on your PC: Install JDK (Java Development Kit) Add the directory where JDK was.
HDB++: High Availability with
Settings MySQL Database and JDBC configuration Instructor: Sergey Goldman.
VICTORIA UNIVERSITY OF WELLINGTON Te Whare Wananga o te Upoko o te Ika a Maui SWEN 432 Advanced Database Design and Implementation Cassandra Architecture.
Building Your Own Website Using:. Install & configure LAMP. Download WordPress and run it as a local website on your Raspberry Pi. Configure WordPress.
16 Copyright © 2004, Oracle. All rights reserved. Testing the Migrated Oracle Database.
Ns2 Installations and Basics Abdul Razaque. How to install Ubuntu on windows-7 & 8 Download the Ubuntu ISO file. You can get the ISO file from the Ubuntu.
VICTORIA UNIVERSITY OF WELLINGTON Te Whare Wananga o te Upoko o te Ika a Maui SWEN 432 Advanced Database Design and Implementation Cassandra Tools and.
Cassandra The Fortune Teller
EE516: Embedded Software Project 1
Hadoop Architecture Mr. Sriram
Getting started with CentOS Linux
Install external command line softwares
How to download, configure and run a mapReduce program In a cloudera VM Presented By: Mehakdeep Singh Amrit Singh Chaggar Ranjodh Singh.
Cassandra Tools and Config Files
Using XML Tools CS551 – Fall 2001.
Appendix A Barb Ericson Georgia Institute of Technology May 2006
Tomcat Celsina Bignoli
A Short DOS Presentation
Using Linux and Lab Setup OS Lab 1
Practice #0: Introduction
Lab 1 introduction, debrief
INSTALLING AND SETTING UP APACHE2 IN A LINUX ENVIRONMENT
How To Install CentOS 6.5 & Virtual Box
Run Java file with Window cmd
Hadoop install.
Getting started with CentOS Linux
How To Install CentOS 6.5 & Virtual Box
Configuration Of A Pull Network.
bitcurator-access-webtools Quick Start Guide
Hadoop Installation Fully Distributed Mode
Presentation transcript:

Cassandra Installation Guide and Example Lecturer : Prof. Kyungbaek Kim Presenter : I Gde Dharma Nugraha

Cassandra Environment VMWare Player/Oracle VirtualBox Ubuntu LTS 64bits Java Version 1.7 (Oracle version) Cassandra Version cassandra bin.tar.gz

Preparing Java Java development kit $sudo add-apt-repository ppa:webupd8team/java $sudo apt-get update $sudo apt-get install oracle-java7-installer Check success installation, run: $java –version Automatically setting java environment variables $sudo apt-get install oracle-java7-set- default

Preparing Cassandra Code This exercise uses Cassandra Get apache-cassandra bin.tar.gz $wget cassandra bin.tar.gz cassandra bin.tar.gz $tar xvf apache-cassandra bin.tar.gz $mv apache-cassandra cassandra Run single mode Cassandra $cd cassandra/bin $./cassandra –f (running Cassandra in the foreground and log gratuitously to the console). Stop Cassandra Press “Control-C” in the same window with the command above.

Cassandra Single Mode Run single mode Cassandra $cd cassandra/bin $./cassandra –f Screenshot:

Cassandra Single Mode Check Cassandra Node Open new Terminal Window Type command $cd cassandra/bin $./nodetool status Screenshot

Cassandra Multiple Node Mode Preparation Make two new VM. Repeat the step for preparing the environment with Java 7. Download apache-cassandra bin.tar.gz and repeat Cassandra preparation step for each new VM. Setting the IP for all the VM with the same IP Network to perform LAN. For this exercise: Node 1 : Node 2 : Node 3 :

Cassandra Multiple Node Mode Configuration for all VM Enter conf folder $cd cassandra/conf Edit cassandra.yaml and configure with the setting below cluster_name: ‘MyCassandraCluster’ num_tokens: 256 seed_provider: class_name: org.apache.cassandra.locator.SimpleSeedProv ider Parameters: seeds: “ ” listen_address: or listen_interface: eth0 rpc_address: broadcast_rpc_address: endpoint_snitch: GossipingPropertyFileSnitch

Cassandra Multiple Node Mode Run Cassandra in each VM First empty cassandra/data directory $cd cassandra/data $rm –rf * $cd cassandra/bin $./cassandra -f

Cassandra Multiple Node Mode This screenshot shows that all nude have UP.

Cassandra Multiple Node Mode To make sure, run Nodetool command in new terminal window. $./nodetool status

Cassandra Interaction Interaction with Cassandra, use cqlsh (CQL Shell) Type command below to run cqlsh $cd cassandra/bin $./cqlsh

Practical Example (1) Interaction using CQL Source : Running cqlsh from installation_tarball/cassandra/bin directory.

Practical Example (1) Cont’d Interaction using CQL Create keyspace then use the new keyspace.

Practical Example (1) Cont’d Interaction using CQL Create user table within demo keyspace.

Practical Example (1) Cont’d Interaction using CQL Show schema

Practical Example (1) Cont’d Interaction using CQL Insert Data Select Data

Practical Example (1) Cont’d Interaction using CQL Update Data and show the result Delete Data

Practical Example (1) Cont’d Inside Cassandra Data Directory

Practical Example (2) Simple Java Application with Cassandra Java Driver Preparation Download Cassandra java driver $wget java-driver tar.gzhttp://downloads.datastax.com/java-driver/cassandra- java-driver tar.gz $tar xvf cassandra-java-driver tar.gz $mv cassandra-java-driver cassandrajava Download slf4j $wget $tar xvf slf4j tar.gz $mv slf4j slf4j Make java file with filename GettingStarted.java

Practical Example (2) Cont’d Simple Java Application with Cassandra Java Driver GettingStarted.java

Practical Example (2) Cont’d Simple Java Application with Cassandra Java Driver GettingStarted.java

Practical Example (2) Cont’d Simple Java Application with Cassandra Java Driver Compile GettingStarted.java $javac –classpath $HOME_PATH/cassandrajava/cassandra- driver-core jar:. GettingStarted.java Run GettingStarted $java –classpath $HOME_PATH/cassandrajava/*:$HOME_PATH/cassandrajava/li b*:$HOME_PATH/slf4j/slf4j-nop jar:. GettingStarted The Result

Practical Example (3) Integrate Hadoop and Cassandra Integrating Hadoop and Cassandra perform big analytic tools. Cassandra will be the data source and Hadoop will be the processor. Requirements for integrate Hadoop and Cassandra: Isolate Cassandra and Hadoop nodes in separate data centers. Disable virtual nodes (vnodes) Set num_tokens to 1 in the cassandra.yaml file. Uncomment the initial_token property and set it to 1 or the value of a generated token for a multimode cluster. Start the cluster for the first time.

Practical Example (3) Cont’d Integrate Hadoop and Cassandra Preparation Download source code and library $wget t.tar.gz?dl=0 t.tar.gz?dl=0 $mv CassandraWordCount.tar.gz?dl=0 CassandraWordCount.tar.gz $tar xvf CassandraWordCount.tar.gz Create keyspace in Cassandra, name : test cqlsh>CREATE KEYSPACE test WITH REPLICATION = { ‘class’ : ‘SimpleStrategy’, ‘replication_factor’ : 2}; cqlsh>USE test; cqlsh>CREATE TABLE documents(id uuid, content text, primary key (id)); Insert sample data.

Practical Example (3) Cont’d Integrate Hadoop and Cassandra Compile $javac -classpath $HADOOP_HOME/hadoop-core jar:/home/hduser/CassandraWordCount/lib/cassandra- driver-core jar:/home/hduser/cassandra/lib/*.jar:/home/hduser/Cas sandraWordCount/lib/cassandra-all jar -d bin src/WordCount.java $cd bin $jar –cvf wordcount.jar *.class

Practical Example (3) Cont’d Integrate Hadoop and Cassandra Run Run Hadoop Run Cassandra Run apps using command: hadoop jar wordcount.jar WordCount -libjar /home/hduser/CassandraWordCount/lib/cassandra-all jar,/home/hduser/CasssandraWordCount/lib/cassandra- driver-core jar,/home/hduser/CassandraWordCount/lib/cassandra- thrift jar,/home/hduser/CassandraWordCount/lib/google- collect-1.0.jar,/home/hduser/CassandraWordCount/lib/jamm jar,/home/hduser/CassandraWordCount/lib/libthrift jar,/home/hduser/CassandraWordCount/lib/metrics-core jar,/home/hduser/CassandraWordCount/lib/netty.jar - Dinput=localhost -Doutput=/user/hduser/out31

Practical Example (3) Cont’d WordCount mapper

Practical Example (3) Cont’d WordCount reducer

Practical Example (3) Cont’d WordCount run

Practical Example (3) Cont’d