1. Fifth International Workshop on Knowledge Discovery, Knowledge Management and Decision Support – EUREKA 2015. Big Data architecture for Social Media Sentiment Analysis supporting Context Aware Recommendation Systems Authors: Lic. Giosvany Miranda - Cuba Dra. Tatiana Delgado - Cuba Mexico City. April 23, 2015

2. Introduction

3. Introduction Mark Troester, 2012, SAS, White paper “Big Data Meets Big Data Analytics”

4. Introduction

5. Architecture Approach An Architecture Approach Data Source Layer Ingestion LayerIngestion Layer Infrastructure Layer Hadoop Storage Layer Analysis Layer Visualitation Layer

6. Architecture Approach Data Source Layer Infrastructure Layer Ingestion Layer An Architecture Approach Hadoop Storage Layer AnalysisLayerAnalysisLayer Visualitation Layer Internal Structured Data Social Web Data Internal Data Structured Data External Data Semi Structured Data

7. Architecture Approach Data Source Layer Infrastructure Layer Ingestion Layer An Architecture Approach Hadoop Storage Layer AnalysisLayerAnalysisLayer Visualitation Layer Internal Structured Data Social Web Data IdentificationFiltrationValidationTransformationIntegration

8. Architecture Approach Data Source Layer Infrastructure Layer Ingestion Layer An Architecture Approach Hadoop Storage Layer AnalysisLayerAnalysisLayer Visualitation Layer Internal Structured Data Social Web Data Infrastructure Layer Virtualization Cloud Services

9. Architecture Approach Data Source Layer Infrastructure Layer Ingestion Layer An Architecture Approach Hadoop Storage Layer AnalysisLayerAnalysisLayer Visualitation Layer Internal Structured Data Social Web Data Infrastructure Layer Virtualization Cloud Services No SQL Key Value Pair Structured Key Value Pair Structured Column – Oriented Semi-Structured Column – Oriented Semi-Structured Hadoop Storage Layer

10. Architecture Approach Data Source Layer Infrastructure Layer Ingestion Layer An Architecture Approach Hadoop Storage Layer AnalysisLayerAnalysisLayer Visualitation Layer Internal Structured Data Social Web Data Infrastructure Layer Virtualization Cloud Services Hadoop Storage Layer No SQL Key Value Pair Structured Key Value Pair Structured Column – Oriented Semi-Structured Column – Oriented Semi-Structured Analysis Layer Data Evaluation Similarity Recommendation Semantic Sentiment Analysis Start Rating Evaluation Collaborative & Content Filter

11. Architecture Approach Data Source Layer Infrastructure Layer Ingestion Layer An Architecture Approach Hadoop Storage Layer AnalysisLayerAnalysisLayer Visualitation Layer Data Evaluation Entity Quality Rating Entity Rating Entity Polarity

12. Architecture Approach Data Source Layer Infrastructure Layer Ingestion Layer An Architecture Approach Hadoop Storage Layer AnalysisLayerAnalysisLayer Visualitation Layer Similarity Recommendation Service Output Service

13. Architecture Approach Data Source Layer Infrastructure Layer Ingestion Layer An Architecture Approach Hadoop Storage Layer AnalysisLayerAnalysisLayer Visualitation Layer Internal Structured Data Social Web Data Infrastructure Layer Virtualization Cloud Services Hadoop Storage Layer No SQL Key Value Pair Structured Key Value Pair Structured Column – Oriented Semi-Structured Column – Oriented Semi-Structured Analysis Layer Data Evaluation Similarity Recommendation Semantic Sentiment Analysis Start Rating Evaluation Collaborative & Content Filter Visualitation Layer CARS & Hadoop Administration Social Web Ranking ANDARIEGO CARS

14. Architecture Approach Data Source Layer Infrastructure Layer Ingestion Layer An Architecture Approach Hadoop Storage Layer AnalysisLayerAnalysisLayer Visualitation Layer CARS Hadoop Administration ANDARIEGO Top Entities Twitter Ranking Facebook Ranking ANDARIEGO Social Web Ranking ANDARIEGO CARS

15. Future Work Future Work  Implementing the proposal architecture in a real scenario such as ANDARIEGO geographical application.  Evaluate implementation methods for implementing infrastructure layer based on cloud computing.  Evaluate metrics based on fuzzy logic to contribute to the semantic sentiment analysis.

16. Conclusions Conclusions  The proposed big data architecture, provides elements for an efficient storage, management and analysis of social streaming data.  The proposed context aware recommendation system have emerged as a very useful element for general mobile systems users.

17. Fifth International Workshop on Knowledge Discovery, Knowledge Management and Decision Support – EUREKA 2015. Big Data architecture for Social Media Sentiment Analysis supporting Context Aware Recommendation Systems Authors: Lic. Giosvany Miranda – Cuba gmiranda@geosi.geocuba.cu Dra. Tatiana Delgado – Cuba tdelgado@ind.cujae.edu.cu Mexico City. April 23, 2015