Presentation is loading. Please wait.

Presentation is loading. Please wait.

 2009 Calpont Corporation 1 Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009 MySQL User Conference Santa.

Similar presentations


Presentation on theme: " 2009 Calpont Corporation 1 Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009 MySQL User Conference Santa."— Presentation transcript:

1  2009 Calpont Corporation 1 Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009 MySQL User Conference Santa Clara, CA Jim Tommaney Chief Product Architect jtommaney@calpont.com

2  2009 Calpont Corporation 2 In a Nutshell Calpont built…  a columnar storage engine optimized for data warehousing  an all-software solution  on a solid foundation 1.Capable 2.Scalable 3.Extendable 4.Simple Because…  today’s business asks more questions, by more people, across more data  “technology as usual” can’t keep up  there has to be a way

3  2009 Calpont Corporation 3 Calpont solves for this…and more. Because we fundamentally believe in the power of open source software  So does MySQL  So does this Community Because of the opportunity  MySQL is uniquely positioned to become a serious player in data warehousing  MySQL and its partners have made great strides in beginning to address the market  But to be truly successful, MySQL must add the ability to perform: 1.Transparent, distributed linear scaling 2.Distributed parallel table scans 3.Distributed joins 4.Hash joins 5.On-line add-column operations Why MySQL?

4  2009 Calpont Corporation 4 Serious Architecture for a Serious Problem. Calpont Pillars It needs to go! 1.Scalable scan, filter, aggregation and hash join operations 2.Intra-server parallelism 3.Inter-server parallelism Scalable It needs to be right! 1.Built for analytics 2.Built for big data 3.Built for speed Capable It needs to grow! 1.Extend the data 2.Extend the data model 3.Extend database functionality via UDFs Extendable It needs to be easy! 1.“Load & Go” 2.Automatic, maintenance-free partitioning 3.Automatic parallelism Simple

5  2009 Calpont Corporation 5 Building Blocks ModuleProcessFunctionalityValue Hosts MySQL Connection management SQL parsing & optimization Familiar DBMS interface Leverages existing partner integrations Abstracts physical and logical storage Metadata store Enables shared nothing and shared everything storage Enables partition elimination Built-in failover Controller Work distribution Final results management and aggregation Independent scalability and tunable concurrency Multi-threaded to take advantage of multi-core HW platforms Worker Scale-out cache management Distributed scan, filter, join and aggregation operations Resource management Independent scalability and tunable performance Multi-threaded to take advantage of multi-core HW platforms Data High Speed Bulk Load Transactional DML and DDL Online schema extensions Enables concurrent reads and writes, non-blocking read enabled Multi-threaded to take advantage of multi-core HW platforms MySQL Director MySQL Director Extent Map Extent Map Performance Module User Module

6  2009 Calpont Corporation 6 Calpont OAM Scalable Building Blocks User Module n User Module 1 Scale out for Performance Scale out for User Concurrency Add User Modules to scale user concurrency Add Performance Modules to scale performance Calpont OAM provides robust administration capabilities and monitors system health Each User Module can distribute work across all Performance Modules Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n

7  2009 Calpont Corporation 7 Multiple Storage Architectures Enabled by the Calpont Extent Map Storage Foundations “Shared Nothing” Storage Architecture Storage Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n “Shared Everything” Storage Architecture SAN Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n Enables both “rack and stack” and centrally managed storage deployments.

8  2009 Calpont Corporation 8 Build a Better Warehouse …one instance, Distributed Servers User Module n User Module 1 Scale out for Performance Scale out for User Concurrency Performance Module 1 Performance Module 2 Performance Module 3 Performance Module n Single Server User Module 1 Performance Module 1 Single Server User Module 1 Performance Module 1 Single Server User Module 1 Performance Module 1 Whether you need… …or many; …or to scale; …to start small, …you can do it with Calpont.

9  2009 Calpont Corporation 9 Let’s Take a Look 1.Simply Capable 2.Simply Scalable 3.Simply Extendable ScalableCapableExtendableSimple Demo Infrastructure SAN User Module 1 Performance Module 1 Performance Module 2 Performance Module 3 Performance Module 4 www.trueffect.com

10  2009 Calpont Corporation 10 What Did You See? ScalableCapableExtendableSimple

11  2009 Calpont Corporation 11 Calpont Early Adopter Program Serious about architecture, serious about support  We are completing our support infrastructure  We are forming the Calpont Community The Program  If you’re ready, so are we  We want your feedback  Register now at www.calpont.comwww.calpont.com Follow us  All things Calpont – read our blog on www.calpont.comwww.calpont.com  Follow us at www.twitter.com/calpontwww.twitter.com/calpont  Register for updates at www.calpont.comwww.calpont.com  Read me at http://jtommaney.livejournal.com/http://jtommaney.livejournal.com/

12  2009 Calpont Corporation 12 Get in the race… Jim Tommaney Chief Product Architect @ Calpont jtommaney@calpont.com www.calpont.com


Download ppt " 2009 Calpont Corporation 1 Calpont Open Source Columnar Storage Engine for Scalable MySQL Data Warehousing April 22, 2009 MySQL User Conference Santa."

Similar presentations


Ads by Google