Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1.

Slides:



Advertisements
Similar presentations
A Survey of Distributed Database Management Systems Brady Kyle CSC
Advertisements

The NewSQL database you’ll never outgrow Taming the Big Data Fire Hose John Hugg Sr. Software Engineer, VoltDB.
A Fast Growing Market. Interesting New Players Lyzasoft.
A Java Architecture for the Internet of Things Noel Poore, Architect Pete St. Pierre, Product Manager Java Platform Group, Internet of Things September.
Adding scalability to legacy PHP web applications Overview Mario A. Valdez-Ramirez.
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1.
© 2011 Citrusleaf. All rights reserved.1 A Real-Time NoSQL DB That Preserves ACID Citrusleaf Srini V. Srinivasan Brian Bulkowski VLDB, 09/01/11.
With the Help of the Microsoft Azure Platform, Devbridge Group Provides Powerful, Flexible, and Scalable Responsive Web Solutions MICROSOFT AZURE ISV PROFILE:
Microsoft SQL Server x 46% 900+ For Hosting Service Providers
Architecting for the Internet of Things
Copyright © 2014 Oracle and/or its affiliates. All rights reserved. | Globally Distributed Data Management How Oracle NoSQL Database addresses the challenge.
NoSQL and NewSQL Justin DeBrabant CIS Advanced Systems - Fall 2013.
HOL9396: Oracle Event Processing 12c
Module 14: Scalability and High Availability. Overview Key high availability features available in Oracle and SQL Server Key scalability features available.
Database Design Table design Index design Query design Transaction design Capacity Size limits Partitioning (shard) Latency Redundancy Replica overhead.
Training Workshop Windows Azure Platform. Presentation Outline (hidden slide): Technical Level: 200 Intended Audience: Developers Objectives (what do.
1 Progress Software’s OpenEdge Platform Which database is right for your environment? Simon Epps.
1 NETE4631 Using Google Web Services and Using Microsoft Cloud Services Lecture Notes #7.
Introduction to Hadoop and HDFS
DBSQL 14-1 Copyright © Genetic Computer School 2009 Chapter 14 Microsoft SQL Server.
A Presentation to Oracle OpenWorld Blistering Web Applications with Oracle TimesTen In Memory Option.
Techcello Provides SaaS Lifecycle Management Solution to “SaaS-ify” Your Application Efficiently on the Powerful Microsoft Azure Cloud Platform MICROSOFT.
INNOV-10 Progress® Event Engine™ Technical Overview Prashant Thumma Principal Software Engineer.
Accumulus Delivers Enterprise Class Subscription Billing and Automation Solutions for Gaming, Retail, and More on the Scalable Microsoft Azure Platform.
Powered by Microsoft Azure, PointMatter Is a Flexible Solution to Move and Share Data between Business Groups and IT MICROSOFT AZURE ISV PROFILE: LOGICMATTER.
Girish M. Jashnani Sales Consultant Manage your E-Business Suite more effectively.
Copyright © 2006, GemStone Systems Inc. All Rights Reserved. Increasing computation throughput with Grid Data Caching Jags Ramnarayan Chief Architect GemStone.
Clusterpoint Margarita Sudņika ms RDBMS & NoSQL Databases & tables → Document stores Columns, rows → Schemaless documents Scales UP → Scales UP.
Distributed Time Series Database
NoSQL Or Peles. What is NoSQL A collection of various technologies meant to work around RDBMS limitations (mostly performance) Not much of a definition...
CISC 849 : Applications in Fintech Namami Shukla Dept of Computer & Information Sciences University of Delaware iCARE : A Framework for Big Data Based.
Mark Gilbert Microsoft Corporation Services Taxonomy Building Block Services Attached Services Finished Services.
Microsoft Azure and ServiceNow: Extending IT Best Practices to the Microsoft Cloud to Give Enterprises Total Control of Their Infrastructure MICROSOFT.
Introduction to Core Database Concepts Getting started with Databases and Structure Query Language (SQL)
SQL Server Evolution New innovations Jen Underwood Sr. Program Manager of Business Intelligence & Analytics Microsoft George Walters Sr. Technical Solutions.
MarkLogic The Only Enterprise NoSQL Database Presented by: Aashi Rastogi ( ) Sanket Patel ( )
BIG DATA. Big Data: A definition Big data is a collection of data sets so large and complex that it becomes difficult to process using on-hand database.
Seminar: Deep Dive into Oracle NoSQL Technologies and Solutions Presenter: Zohar Elkayam, CTO, Brillix.
Abstract MarkLogic Database – Only Enterprise NoSQL DB Aashi Rastogi, Sanket V. Patel Department of Computer Science University of Bridgeport, Bridgeport,
When Big Data Meets Fast Data
The Holmes Platform and Applications
Univa Grid Engine Makes Work Management Automatic and Efficient, Accelerates Deployment of Cloud Services with Power of Microsoft Azure MICROSOFT AZURE.
Organizations Are Embracing New Opportunities
Data Platform Modernization
Data Platform and Analytics Foundational Training
Business Critical Application Platform
Open Source distributed document DB for an enterprise
Couchbase Server is a NoSQL Database with a SQL-Based Query Language
Enabling Scalable and HA Ingestion and Real-Time Big Data Insights for the Enterprise OCJUG, 2014.
Business Critical Application Platform
NGAGE Intelligence Leverages Microsoft Azure Platform to Provide Essential Analytics for Hybrid SharePoint Server/Office 365 Environments MICROSOFT AZURE.
Designed for Big Data Visual Analytics, Zoomdata Allows Business Users to Quickly Connect, Stream, and Visualize Data in the Microsoft Azure Platform MICROSOFT.
Federico Perrero – Plant Manager
Logsign All-In-One Security Information and Event Management (SIEM) Solution Built on Azure Improves Security & Business Continuity MICROSOFT AZURE APP.
Data Platform Modernization
Big Red Cloud Offers a Simple Online Accounts Solution for Business Owners and Bookkeepers Hosted on the Powerful Microsoft Azure Platform MICROSOFT AZURE.
DeFacto Planning on the Powerful Microsoft Azure Platform Puts the Power of Intelligent and Timely Planning at Any Business Manager’s Fingertips Partner.
Azure's Performance, Scalability, SQL Servers Automate Real Time Data Transfer at Low Cost MINI-CASE STUDY “Azure offers high performance, scalable, and.
Dell Data Protection | Rapid Recovery: Simple, Quick, Configurable, and Affordable Cloud-Based Backup, Retention, and Archiving Powered by Microsoft Azure.
TruRating: Mass Point-of-Payment Customer Rating System Uses the Power of Microsoft Azure to Store and Analyze Millions of Ratings for Business Owners.
Adra ACCOUNTS: Transaction Matching Software Powered by the Microsoft Azure Cloud That Helps Optimize the Accounting and Finance Processes MICROSOFT AZURE.
AdQ is Azure-Powered Pre-Roll Ad Management Software That Improves Pre-Roll Ad Performance, Increases Profits, and Optimizes User Experience MICROSOFT.
Clouds & Containers: Case Studies for Big Data
XtremeData on the Microsoft Azure Cloud Platform:
Taming the Big Data Fire Hose
Technical Capabilities
Big DATA.
NoSQL databases An introduction and comparison between Mongodb and Mysql document store.
SQL Server 2019 Bringing Apache Spark to SQL Server
Presentation transcript:

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1

2 Oracle NoSQL Database and Big Data Chao Huang Senior Manager, Oracle NoSQL Database development

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 3  Relational Databases replace IMS for ‘Business Data processing’  Relational Databases become the standard for OLTP  SQL is better  Query Optimizers beat programmers 1970s - OLTP Relational Era Edgar F. Codd Replaced By

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 4  Unhappy Developers  More code to write  Unhappy DBAs  Complicates backup, schema changes, indexing, hotspots  Unhappy users  No cross-shard applications What’s wrong with Sharding Big Data Era - Volume

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 5  More and more semi-structured data sources  Consumers are talking and so are sensors  Schema-less is the critical need for agility What’s wrong with my Data Big Data Era - Variety

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 6 Big Data Era - Simplicity Simple Data Models K-V Logs, Sensors Real-time Ads User Profiles

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 7  Horizontal Scale – Data Volume requires scaling on multiple machines  Leading Technology giants – have embraced NoSQL - Google, Amazon, Facebook et al.  New Kinds of Data – more semi-structured and unstructured data sources.  New Speeds of Data – real time customer experience, real time sensor feedbacks  Cost Sensitivity – Scale is not a yes/no question. Scale is an ROI question. Why NoSQL Trends Driving NoSQL Technology

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 8  Simple Key-Value Data Model  Horizontally Scalable  Highly Available  Simple administration  ACID Transactions at scale  Transparent load balancing  Elastic Configuration  Commercial grade software and support Scalable, HA, Key-Value What is Oracle NoSQL Database

Copyright © 2013, Oracle and/or its affiliates. All rights reserved M ops/sec 2 billion records 2 TB of data 95% read, 5% update Low latency High Scalability YCSB Performance

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 10 NoSQL Use Cases

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 11  NoSQL DB for High velocity, High volume, High variety, Low information density ACID transactional data capture  Hadoop and Data Warehouse for analytics  Applications: Web browsing, Web Retail, CDR processing, Sensor data capture Oracle NoSQL DB Use Case – Web Scale Transactions Hadoop Cluster NoSQL DB Driver Application Acquire AnalyzeOrganize Enterprise Data Warehouse

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 12  Platform for real-time content delivery  Content & market segmentation Acquired and Analyzed in Hadoop & RDBMS  NoSQL provides low latency content lookup and delivery to end- customers  Applications: Advertising, Marketing segmentation, Location-aware content delivery Oracle NoSQL DB Use Case – Last Mile Content Delivery Hadoop Cluster Multi-Reporting Dimensional NoSQL DB Driver Application Acquire, Analyze, Prepare Content Delivery Business Users End Customers Web Click-stream

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 13  Real time events trigger rule execution in Oracle Event Processor  OEP rules perform low latency lookups to Oracle NoSQL DB for additional data  Applications: Utilities, Medical Monitoring, Factory Automation, Oil & Gas Exploration, Geo- location Tracking Oracle NoSQL DB Use Case – Real Time Event Processing NoSQL DB Driver Oracle Event Processor Rule Action Event Stream Low Latency Lookups

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 14 NoSQL for Social Online Betting Objectives  Scalable in-play sports betting platform  Increase new business revenue  Improve operational efficiency Solution  Match in-play bets with incoming events  Promote interaction between customers  Scale system with customers and events  Feeds MySQL database for revenue tracking and operational reporting James Anthony Chief Technology Officer Passoker  “Oracle NoSQL Database enabled the rapid, scalable processing of incoming XML, ensuring high available and guaranteed event ordering.” NoSQL DBMySQL Accounting & Operations Event Capture & Store Customers Real-Time, In-Play Sports Betting Providers XML App Challenge Solution

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 15 NoSQL for Scalable PaaS  Provide special purpose application server services to financial institutions  Provide cost competitive subscriptions Benefits  Low latency application object persistence  Flexible data format and serialization techniques  Highly reliable data store that can scale as the number of hosted apps and app objects grow  Oracle NoSQL database for unstructured data capture and application object persistence  Oracle database for business analytics and insight into the data collected NoSQL DB Driver Application Challenge Solution

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 16 NoSQL for Oracle Communications Mgmt  Improve billing and revenue management  Calculate charges for any service combo  Provide scalable CDR processing NoSQL DB Driver Application Data Ingestion OCM Rated Event s Processor  Coherence cluster for real time event rating  NoSQL database for rated event persistence and consumption by downstream systems  Coherence memory optimization using NoSQL database for out of band data Challenge Solution Benefits  Extend Coherence data caching to disk  Manage growth in data volume, 400M customers  Handle extreme TXN volumes with low latency  Always on and highly available

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 17  Supported OS – Linux and Solaris 10  Oracle NoSQL DB is written in Java  Java and C APIs  Bindings available for Jython, Jruby, Clojure, Groovy, Rhino Oracle NoSQL Compatibility

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18  Provides linear scale-out of write ops/sec  No need to develop sharding logic in Application  Intelligent Driver – aware of hash function and shard location  Hash function to map a key to a partition  Each partition is routed to a single shard Auto-Sharding Features - Sharding Shard 0 Rep Node Master Rep Node Replic a Shard 11 Rep Node Master Rep Node Replic a … Partitions Hash Fn

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 19  Master-Slave replication  Supports Heterogeneous platform hardware/OS/JVM  Provides linear scale out for read ops/sec High Availability Features - Replication Shard 0 Rep Node Master Rep Node Replica

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 20  Configurable Durability per operation  Configurable Consistency per operation  ACID by default  Transaction scope is single API call  Records share same major key  Multiple operations supported Greater Flexibility Features – Configurable CAP

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 21  Automatic election of new Master  Rejoining nodes automatically synchronize with the Master  Isolated nodes can still service reads  All nodes are symmetric Automatic Failover Features - Failover Replication factor = 5 Rep Node Master Rep Node Replica New Master

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 22 Enterprise Integration – Extensions  Integration with Oracle Database – External Tables  RDF Graph for NoSQL – Support for SPARQL  Event Processing with Oracle Event Processor  Integration with Hadoop

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23 Why Oracle NoSQL Database Always-On Elastic Processing Configurable ACID Transactions at scale Easy to use Smart Data Center Topologies Integration with the Oracle technology stack A trusted vendor here for the long term Scalable, Available with Predictable Latency  It’s Oracle  Differentiating Features

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 24

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 25