Presentation is loading. Please wait.

Presentation is loading. Please wait.

Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1.

Similar presentations


Presentation on theme: "Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1."— Presentation transcript:

1 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1

2 2 Oracle NoSQL Database and Big Data Chao Huang Senior Manager, Oracle NoSQL Database development

3 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 3  Relational Databases replace IMS for ‘Business Data processing’  Relational Databases become the standard for OLTP  SQL is better  Query Optimizers beat programmers 1970s - OLTP Relational Era Edgar F. Codd Replaced By

4 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 4  Unhappy Developers  More code to write  Unhappy DBAs  Complicates backup, schema changes, indexing, hotspots  Unhappy users  No cross-shard applications What’s wrong with Sharding Big Data Era - Volume

5 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 5  More and more semi-structured data sources  Consumers are talking and so are sensors  Schema-less is the critical need for agility What’s wrong with my Data Big Data Era - Variety

6 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 6 Big Data Era - Simplicity Simple Data Models K-V Logs, Sensors Real-time Ads User Profiles

7 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 7  Horizontal Scale – Data Volume requires scaling on multiple machines  Leading Technology giants – have embraced NoSQL - Google, Amazon, Facebook et al.  New Kinds of Data – more semi-structured and unstructured data sources.  New Speeds of Data – real time customer experience, real time sensor feedbacks  Cost Sensitivity – Scale is not a yes/no question. Scale is an ROI question. Why NoSQL Trends Driving NoSQL Technology

8 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 8  Simple Key-Value Data Model  Horizontally Scalable  Highly Available  Simple administration  ACID Transactions at scale  Transparent load balancing  Elastic Configuration  Commercial grade software and support Scalable, HA, Key-Value What is Oracle NoSQL Database

9 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 9 1.25M ops/sec 2 billion records 2 TB of data 95% read, 5% update Low latency High Scalability YCSB Performance

10 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 10 NoSQL Use Cases

11 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 11  NoSQL DB for High velocity, High volume, High variety, Low information density ACID transactional data capture  Hadoop and Data Warehouse for analytics  Applications: Web browsing, Web Retail, CDR processing, Sensor data capture Oracle NoSQL DB Use Case – Web Scale Transactions Hadoop Cluster NoSQL DB Driver Application Acquire AnalyzeOrganize Enterprise Data Warehouse

12 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 12  Platform for real-time content delivery  Content & market segmentation Acquired and Analyzed in Hadoop & RDBMS  NoSQL provides low latency content lookup and delivery to end- customers  Applications: Advertising, Marketing segmentation, Location-aware content delivery Oracle NoSQL DB Use Case – Last Mile Content Delivery Hadoop Cluster Multi-Reporting Dimensional NoSQL DB Driver Application Acquire, Analyze, Prepare Content Delivery Business Users End Customers Web Click-stream

13 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 13  Real time events trigger rule execution in Oracle Event Processor  OEP rules perform low latency lookups to Oracle NoSQL DB for additional data  Applications: Utilities, Medical Monitoring, Factory Automation, Oil & Gas Exploration, Geo- location Tracking Oracle NoSQL DB Use Case – Real Time Event Processing NoSQL DB Driver Oracle Event Processor Rule Action Event Stream Low Latency Lookups

14 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 14 NoSQL for Social Online Betting Objectives  Scalable in-play sports betting platform  Increase new business revenue  Improve operational efficiency Solution  Match in-play bets with incoming events  Promote interaction between customers  Scale system with customers and events  Feeds MySQL database for revenue tracking and operational reporting James Anthony Chief Technology Officer Passoker  “Oracle NoSQL Database enabled the rapid, scalable processing of incoming XML, ensuring high available and guaranteed event ordering.” NoSQL DBMySQL Accounting & Operations Event Capture & Store Customers Real-Time, In-Play Sports Betting Providers XML App Challenge Solution

15 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 15 NoSQL for Scalable PaaS  Provide special purpose application server services to financial institutions  Provide cost competitive subscriptions Benefits  Low latency application object persistence  Flexible data format and serialization techniques  Highly reliable data store that can scale as the number of hosted apps and app objects grow  Oracle NoSQL database for unstructured data capture and application object persistence  Oracle database for business analytics and insight into the data collected NoSQL DB Driver Application Challenge Solution

16 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 16 NoSQL for Oracle Communications Mgmt  Improve billing and revenue management  Calculate charges for any service combo  Provide scalable CDR processing NoSQL DB Driver Application Data Ingestion OCM Rated Event s Processor  Coherence cluster for real time event rating  NoSQL database for rated event persistence and consumption by downstream systems  Coherence memory optimization using NoSQL database for out of band data Challenge Solution Benefits  Extend Coherence data caching to disk  Manage growth in data volume, 400M customers  Handle extreme TXN volumes with low latency  Always on and highly available

17 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 17  Supported OS – Linux and Solaris 10  Oracle NoSQL DB is written in Java  Java and C APIs  Bindings available for Jython, Jruby, Clojure, Groovy, Rhino Oracle NoSQL Compatibility

18 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18  Provides linear scale-out of write ops/sec  No need to develop sharding logic in Application  Intelligent Driver – aware of hash function and shard location  Hash function to map a key to a partition  Each partition is routed to a single shard Auto-Sharding Features - Sharding Shard 0 Rep Node Master Rep Node Replic a Shard 11 Rep Node Master Rep Node Replic a … Partitions Hash Fn

19 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 19  Master-Slave replication  Supports Heterogeneous platform hardware/OS/JVM  Provides linear scale out for read ops/sec High Availability Features - Replication Shard 0 Rep Node Master Rep Node Replica

20 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 20  Configurable Durability per operation  Configurable Consistency per operation  ACID by default  Transaction scope is single API call  Records share same major key  Multiple operations supported Greater Flexibility Features – Configurable CAP

21 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 21  Automatic election of new Master  Rejoining nodes automatically synchronize with the Master  Isolated nodes can still service reads  All nodes are symmetric Automatic Failover Features - Failover Replication factor = 5 Rep Node Master Rep Node Replica New Master

22 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 22 Enterprise Integration – Extensions  Integration with Oracle Database – External Tables  RDF Graph for NoSQL – Support for SPARQL  Event Processing with Oracle Event Processor  Integration with Hadoop

23 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23 Why Oracle NoSQL Database Always-On Elastic Processing Configurable ACID Transactions at scale Easy to use Smart Data Center Topologies Integration with the Oracle technology stack A trusted vendor here for the long term Scalable, Available with Predictable Latency  It’s Oracle  Differentiating Features

24 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 24

25 Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 25


Download ppt "Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1."

Similar presentations


Ads by Google