Download presentation
Presentation is loading. Please wait.
Published byRuth Malone Modified over 9 years ago
1
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 1
2
2 Oracle NoSQL Database and Big Data Chao Huang Senior Manager, Oracle NoSQL Database development
3
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 3 Relational Databases replace IMS for ‘Business Data processing’ Relational Databases become the standard for OLTP SQL is better Query Optimizers beat programmers 1970s - OLTP Relational Era Edgar F. Codd Replaced By
4
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 4 Unhappy Developers More code to write Unhappy DBAs Complicates backup, schema changes, indexing, hotspots Unhappy users No cross-shard applications What’s wrong with Sharding Big Data Era - Volume
5
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 5 More and more semi-structured data sources Consumers are talking and so are sensors Schema-less is the critical need for agility What’s wrong with my Data Big Data Era - Variety
6
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 6 Big Data Era - Simplicity Simple Data Models K-V Logs, Sensors Real-time Ads User Profiles
7
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 7 Horizontal Scale – Data Volume requires scaling on multiple machines Leading Technology giants – have embraced NoSQL - Google, Amazon, Facebook et al. New Kinds of Data – more semi-structured and unstructured data sources. New Speeds of Data – real time customer experience, real time sensor feedbacks Cost Sensitivity – Scale is not a yes/no question. Scale is an ROI question. Why NoSQL Trends Driving NoSQL Technology
8
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 8 Simple Key-Value Data Model Horizontally Scalable Highly Available Simple administration ACID Transactions at scale Transparent load balancing Elastic Configuration Commercial grade software and support Scalable, HA, Key-Value What is Oracle NoSQL Database
9
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 9 1.25M ops/sec 2 billion records 2 TB of data 95% read, 5% update Low latency High Scalability YCSB Performance
10
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 10 NoSQL Use Cases
11
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 11 NoSQL DB for High velocity, High volume, High variety, Low information density ACID transactional data capture Hadoop and Data Warehouse for analytics Applications: Web browsing, Web Retail, CDR processing, Sensor data capture Oracle NoSQL DB Use Case – Web Scale Transactions Hadoop Cluster NoSQL DB Driver Application Acquire AnalyzeOrganize Enterprise Data Warehouse
12
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 12 Platform for real-time content delivery Content & market segmentation Acquired and Analyzed in Hadoop & RDBMS NoSQL provides low latency content lookup and delivery to end- customers Applications: Advertising, Marketing segmentation, Location-aware content delivery Oracle NoSQL DB Use Case – Last Mile Content Delivery Hadoop Cluster Multi-Reporting Dimensional NoSQL DB Driver Application Acquire, Analyze, Prepare Content Delivery Business Users End Customers Web Click-stream
13
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 13 Real time events trigger rule execution in Oracle Event Processor OEP rules perform low latency lookups to Oracle NoSQL DB for additional data Applications: Utilities, Medical Monitoring, Factory Automation, Oil & Gas Exploration, Geo- location Tracking Oracle NoSQL DB Use Case – Real Time Event Processing NoSQL DB Driver Oracle Event Processor Rule Action Event Stream Low Latency Lookups
14
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 14 NoSQL for Social Online Betting Objectives Scalable in-play sports betting platform Increase new business revenue Improve operational efficiency Solution Match in-play bets with incoming events Promote interaction between customers Scale system with customers and events Feeds MySQL database for revenue tracking and operational reporting James Anthony Chief Technology Officer Passoker “Oracle NoSQL Database enabled the rapid, scalable processing of incoming XML, ensuring high available and guaranteed event ordering.” NoSQL DBMySQL Accounting & Operations Event Capture & Store Customers Real-Time, In-Play Sports Betting Providers XML App Challenge Solution
15
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 15 NoSQL for Scalable PaaS Provide special purpose application server services to financial institutions Provide cost competitive subscriptions Benefits Low latency application object persistence Flexible data format and serialization techniques Highly reliable data store that can scale as the number of hosted apps and app objects grow Oracle NoSQL database for unstructured data capture and application object persistence Oracle database for business analytics and insight into the data collected NoSQL DB Driver Application Challenge Solution
16
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 16 NoSQL for Oracle Communications Mgmt Improve billing and revenue management Calculate charges for any service combo Provide scalable CDR processing NoSQL DB Driver Application Data Ingestion OCM Rated Event s Processor Coherence cluster for real time event rating NoSQL database for rated event persistence and consumption by downstream systems Coherence memory optimization using NoSQL database for out of band data Challenge Solution Benefits Extend Coherence data caching to disk Manage growth in data volume, 400M customers Handle extreme TXN volumes with low latency Always on and highly available
17
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 17 Supported OS – Linux and Solaris 10 Oracle NoSQL DB is written in Java Java and C APIs Bindings available for Jython, Jruby, Clojure, Groovy, Rhino Oracle NoSQL Compatibility
18
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 18 Provides linear scale-out of write ops/sec No need to develop sharding logic in Application Intelligent Driver – aware of hash function and shard location Hash function to map a key to a partition Each partition is routed to a single shard Auto-Sharding Features - Sharding Shard 0 Rep Node Master Rep Node Replic a Shard 11 Rep Node Master Rep Node Replic a … Partitions Hash Fn
19
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 19 Master-Slave replication Supports Heterogeneous platform hardware/OS/JVM Provides linear scale out for read ops/sec High Availability Features - Replication Shard 0 Rep Node Master Rep Node Replica
20
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 20 Configurable Durability per operation Configurable Consistency per operation ACID by default Transaction scope is single API call Records share same major key Multiple operations supported Greater Flexibility Features – Configurable CAP
21
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 21 Automatic election of new Master Rejoining nodes automatically synchronize with the Master Isolated nodes can still service reads All nodes are symmetric Automatic Failover Features - Failover Replication factor = 5 Rep Node Master Rep Node Replica New Master
22
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 22 Enterprise Integration – Extensions Integration with Oracle Database – External Tables RDF Graph for NoSQL – Support for SPARQL Event Processing with Oracle Event Processor Integration with Hadoop
23
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 23 Why Oracle NoSQL Database Always-On Elastic Processing Configurable ACID Transactions at scale Easy to use Smart Data Center Topologies Integration with the Oracle technology stack A trusted vendor here for the long term Scalable, Available with Predictable Latency It’s Oracle Differentiating Features
24
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 24
25
Copyright © 2013, Oracle and/or its affiliates. All rights reserved. 25
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.