Oracle Coherence Product Overview Raanan Dagan / Coherence Team.

Slides:



Advertisements
Similar presentations
Performance Testing - Kanwalpreet Singh.
Advertisements

Distributed Processing, Client/Server and Clusters
Database Architectures and the Web
SYSTEM CENTER OPERATIONS MANAGER 2012: AN OVERVIEW Baelson Duque Senior Program Manager System Center Operations Manager.
Introduction to DBA.
Netscape Application Server Application Server for Business-Critical Applications Presented By : Khalid Ahmed DS Fall 98.
Oracle Data Guard Ensuring Disaster Recovery for Enterprise Data
Distributed Processing, Client/Server, and Clusters
Distributed components
Business Continuity and DR, A Practical Implementation Mich Talebzadeh, Consultant, Deutsche Bank
Dr. Zahid Anwar. Simplified Architecture of Linux Cluster Simplified Architecture of a Single Computer Simplified architecture of an enterprise cluster.
Chris Shuster 4/29/2009 1Chris Shuster.  Application Servers ◦ Backend processing platform. ◦ Multiple platforms, operating system and architecture.
The Architecture of Transaction Processing Systems
McGraw-Hill/Irwin Copyright © 2007 by The McGraw-Hill Companies, Inc. All rights reserved. Chapter 17 Client-Server Processing, Parallel Database Processing,
Lesson 1: Configuring Network Load Balancing
5.1 © 2004 Pearson Education, Inc. Exam Managing and Maintaining a Microsoft® Windows® Server 2003 Environment Lesson 5: Working with File Systems.
Module 14: Scalability and High Availability. Overview Key high availability features available in Oracle and SQL Server Key scalability features available.
Manage & Configure SQL Database on the Cloud Haishi Bai Technical Evangelist Microsoft.
GridGain – Java Grid Computing Made Simple Dmitriy Setrakyan
Word Wide Cache Distributed Caching for the Distributed Enterprise.
Module 13: Network Load Balancing Fundamentals. Server Availability and Scalability Overview Windows Network Load Balancing Configuring Windows Network.
Training Workshop Windows Azure Platform. Presentation Outline (hidden slide): Technical Level: 200 Intended Audience: Developers Objectives (what do.
An Engineer’s Introduction to Oracle Coherence Brian Oliver Senior Principal Solutions Architect | Oracle.
JOnAS developer workshop – /02/2004 status Emmanuel Cecchet
Module 12: Designing High Availability in Windows Server ® 2008.
Oracle10g RAC Service Architecture Overview of Real Application Cluster Ready Services, Nodeapps, and User Defined Services.
1 Copyright © 2004, Oracle. All rights reserved. Introduction to Oracle Forms Developer and Oracle Forms Services.
INSTALLING MICROSOFT EXCHANGE SERVER 2003 CLUSTERS AND FRONT-END AND BACK ‑ END SERVERS Chapter 4.
JBoss Cache. Cache A place to temporarily store data that is expensive or difficult to compute or retrieve. Caches should be fast to access. May or may.
DISTRIBUTED COMPUTING
GigaSpaces Global HTTP Session Sharing October 2013 Massive Web Application Scaling.
Enterprise Java Beans Java for the Enterprise Server-based platform for Enterprise Applications Designed for “medium-to-large scale business, enterprise-wide.
1 Moshe Shadmon ScaleDB Scaling MySQL in the Cloud.
Unit – I CLIENT / SERVER ARCHITECTURE. Unit Structure  Evolution of Client/Server Architecture  Client/Server Model  Characteristics of Client/Server.
Applications Web et bases de données en grappe Séminaire InTech 3 Février 2005 – Grenoble.
Usenix Annual Conference, Freenix track – June 2004 – 1 : Flexible Database Clustering Middleware Emmanuel Cecchet – INRIA Julie Marguerite.
Chapter 5 McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved. Enterprise Architectures.
Chapter 5 McGraw-Hill/Irwin Copyright © 2011 by The McGraw-Hill Companies, Inc. All rights reserved.
The Replica Location Service The Globus Project™ And The DataGrid Project Copyright (c) 2002 University of Chicago and The University of Southern California.
OSIsoft High Availability PI Replication
11 CLUSTERING AND AVAILABILITY Chapter 11. Chapter 11: CLUSTERING AND AVAILABILITY2 OVERVIEW  Describe the clustering capabilities of Microsoft Windows.
Highly available database clusters with JDBC
70-293: MCSE Guide to Planning a Microsoft Windows Server 2003 Network, Enhanced Chapter 12: Planning and Implementing Server Availability and Scalability.
Chapter 20 Parallel Sysplex
Oracle Database Architecture By Ayesha Manzer. Automatic Storage Management Spreads database data across all disks Creates and maintains a storage grid.
Chapter 7: Consistency & Replication IV - REPLICATION MANAGEMENT By Jyothsna Natarajan Instructor: Prof. Yanqing Zhang Course: Advanced Operating Systems.
Ahmet Fuat – Bahçe ş ehir University İleri Seviyede Oracle Ön Bellek Mekanizması (Oracle Coherence)
Microsoft Azure and DataStax: Start Anywhere and Scale to Any Size in the Cloud, On- Premises, or Both with a Leading Distributed Database MICROSOFT AZURE.
Features Scalability Manage Services Deliver Features Faster Create Business Value Availability Latency Lifecycle Data Integrity Portability.
Mick Badran Using Microsoft Service Fabric to build your next Solution with zero downtime – Lvl 300 CLD32 5.
Microsoft Azure and ServiceNow: Extending IT Best Practices to the Microsoft Cloud to Give Enterprises Total Control of Their Infrastructure MICROSOFT.
Amazon Web Services. Amazon Web Services (AWS) - robust, scalable and affordable infrastructure for cloud computing. This session is about:
OSIsoft High Availability PI Replication Colin Breck, PI Server Team Dave Oda, PI SDK Team.
Introduction to Oracle Forms Developer and Oracle Forms Services
Scaling Network Load Balancing Clusters
Affinity Depending on the application and client requirements of your Network Load Balancing cluster, you can be required to select an Affinity setting.
Netscape Application Server
Introduction to Oracle Forms Developer and Oracle Forms Services
New Heights by Guiding Them into the Cloud
Open Source distributed document DB for an enterprise
Network Load Balancing
Introduction to Oracle Forms Developer and Oracle Forms Services
Maximum Availability Architecture Enterprise Technology Centre.
Couchbase Server is a NoSQL Database with a SQL-Based Query Language
An Engineer’s Introduction to Oracle Coherence
Dell Data Protection | Rapid Recovery: Simple, Quick, Configurable, and Affordable Cloud-Based Backup, Retention, and Archiving Powered by Microsoft Azure.
Appcelerator Arrow: Build APIs in Minutes. Connect to Any Data Source
Quasardb Is a Fast, Reliable, and Highly Scalable Application Database, Built on Microsoft Azure and Designed Not to Buckle Under Demand MICROSOFT AZURE.
Web Application Server 2001/3/27 Kang, Seungwoo. Web Application Server A class of middleware Speeding application development Strategic platform for.
Data Grid Patterns Brian Oliver | Global Solutions Architect | Oracle Corporation | JBFOne 2008.
Presentation transcript:

Oracle Coherence Product Overview Raanan Dagan / Coherence Team

What is Oracle Coherence? Distributed Memory Data Management Solution (aka: Data Grid)

How Can a Data Grid Help? Provides a reliable data tier with a single, consistent view of data Enables dynamic data capacity including fault tolerance and load balancing Ensures that data capacity scales with processing capacity Mainframes Databases Web Services Enterprise Applications Real Time Clients Web Services Application Tier Coherence™ Data Grid Data Sources Data Services

Oracle Grid Computing: Enterprise Ready Enterprise Application Grid Extreme Transaction Processing XTP Oracle RAC Common Shared Application Infrastructure (Application Virtualization) Data Virtualization (Data as a Service) Middle tier scale out for Grid Based OLTP Massive Persistent scale out with Oracle RAC Oracle Coherence Application Tier

Requirements of Enterprise Data Grid Dynamically Expandable No data loss at any volume No interruption of service Leverage Commodity Hardware Cost Effective Built for continuous operation Data Fault Tolerance Self-Diagnosis and Healing “Once and Only Once” Processing Single view of data Single management view Simple programming model Any Application Any Data Source Reliable Scalable Universal Data Caching Analytics Transaction Processing Event Processing Data

How Does Coherence ™ Data Grid Work? Cluster of nodes holding % of primary data locally Back-up of primary data is distributed across all other nodes Logical view of all data from any node All nodes verify health of each other In the event a node is unhealthy, other nodes diagnose state Unhealthy node isolated from cluster Remaining nodes redistribute primary and back-up responsibilities to healthy nodes X

Customers & Coherence? Caching Applications request data from the Data Grid rather than backend data sources Analytics Applications ask the Data Grid questions from simple queries to advanced scenario modeling Transactions Data Grid acts as a transactional System of Record, hosting data and business logic Events Automated processing based on event

Demo

Technical

Topology #1 - Replicated Cache

Topology #2 - Partitioned Cache

Topology #2 - Guaranteed Cluster Resiliency

Topology #2 - Partitioned Failover

Topology #2a – Cache Client/Cache Server

Topology #3 - Near Cache

Use Case: Coherence*Web Coherence*Web is an HTTP session-management module (built-in feature of Coherence) Supports a wide range of application servers. Does not require any changes to the application. Coherence*Web uses the NearCache technology to provide fully fault-tolerant caching, with almost unlimited scalability (to several hundred cluster nodes without issue). Heterogeneous applications running on mixed hardware/OS/application servers can share common user session data. This dramatically simplifies supporting Single-Sign-On across applications.

Coherence*Web: Session State Management Web Tier Clustered Oracle, WebLogic, WebSphere, JBoss, Tomcat Load Balanced Router Coherence Web Java EE or Servlet Container Web Application Application State Coherence Web Java EE or Servlet Container Web Application Application State In Memory Coherence Data Grid for Session State Coherence Web Java EE or Servlet Container Web Application Application State

Read-Through Caching

Write-Through Caching

Write-Behind Caching

Features Caching Applications request data from the Data Grid rather than backend data sources Analytics Applications ask the Data Grid questions from simple queries to advanced scenario modeling Transactions Data Grid acts as a transactional System of Record, hosting data and business logic Events Automated processing based on event

Transaction Implicit: Queuing of operations Virtual queue & thread per entry Explicit: Pessimistic locking Grid-Wide Mutex Transactions: Unit of work management Both optimistic and pessimistic transactions Isolation levels from read-committed through serializable Integrated with JTA

Events Universal: All data sets provide events, regardless of the topology. Distributed: The events are always delivered efficiently to the interested listeners. Regardless of originating node Flexible: Listen to entire data sets, specific identities, and even to queries! Provides “before” and “after” state Both sync and async event models

Query Parallel Query: A query is performed in parallel across the Data Grid, using indexing and a iterative Cost Based Optimizer. Customizable predicates Custom indexes Custom aggregators Continuous Query: Combines a query with events to provide a local materialized view. Result is up-to-date in real-time Like the Near Topology, but it always contains the desired data

InvocableMap – Server Side Processing

Coherence*Extend Supports “fat client” real-time applications such as trading desks, as well as other server tiers WAN support Connection to the cluster is over TCP Continuous query can be used to maintain real-time query results on the desktop!

Network

Tangosol Cluster Management Protocol (TCMP) Coherence’s own protocol between cluster members TCMP utilizes UDP Massively scalable Asynchronous Point-to-point UDP Multicast is used for: New JVMs to join the cluster automatically Maintaining cluster membership Multicast is not required; it may be disabled with Well Known Addresses (WKA) UDP Unicast is used for most communication Very fast and scalable TCMP guarantees packet order and delivery TCP/IP connections do not need to be maintained

Clustering is about Consensus! Oracle Coherence Clustering is very different! Goal: Maintain Cluster Membership Consensus all times Do it as fast as physically possible Do it without a single point of failure or registry of members Ensure all members have the same responsibility and work together to maintain consensus Ensure that no voting occurs to determine membership

Clustering is about Consensus! Why: If all members are always known… We can partition / load balance Data & Services We don’t need to hold TCP/IP connections open (resource intensive) Any member can “talk” directly with any other member (peer-to-peer) The cluster can dynamically (while running) scale to any size

Benchmarking Coherence Aggregation (DoubleSum) of Trade objects Scale out testing on Dual 2.3GHz PowerPC G5 XserveDual 2.3GHz PowerPC G5 Xserve Use of on index for direct access if you need to achieve 1,837,932 trade aggregations per second all that is required is to start 16 more cache servers across four more machines.

Coherence Management and Monitoring Management Features Coherence provides standard JMX APIs Cluster-wide JMX: Ability to monitor and manage the entire cluster from any node Customizable web-based console Does not require an mBean server or any JMX libraries on managed nodes Support custom application mBeans Support for Coherence*Web

Summary

Technical Resources White Papers & Presentations Technical Documentation Support Forums, Technical FAQ’s

Summary Coherence is the leading product set for high performance distributed in- memory data services Significant customer traction Established technology platform Coherence ™ delivers data performance, scalability and reliability Data Grids are a key enabler for SOA, EDA, virtualization Need for Reliability Time Defining Moment SOA EDA