Download presentation
Presentation is loading. Please wait.
Published byNathan Arnold Modified over 9 years ago
1
VectorWise The world’s fastest database GIUA, 13 September 2011
2
© 2011 Ingres Corporation
3
DBT-3 Database Schema © 2011 Ingres Corporation
4
DBT-3 Data © 2011 Ingres Corporation
5
What is VectorWise? Started as an academic project –Centrum Wiskunde & Informatica (CWI) Python MonetDB X100 VectorWise Adopted as an Ingres community project Joint venture company set up between CWI and Ingres Corp. Now wholly owned by Ingres Corp. © 2011 Ingres Corporation
6
What is VectorWise for? Data warehousing Data marts Data mining Online Analytical Processing (OLAP) Business Intelligence © 2011 Ingres Corporation
7
VectorWise Technology On Chip Computing Time / Cycles to Process Data Processed DISK RAM CHIP 10GB 2-3GB 40-400MB 2-20 150-250 Millions Vector Processing Breakthrough technology © 2011 Ingres Corporation
8
On Chip Computing Processing in Chip Cache CPU cache access is more efficient than RAM cache access Time / Cycles to Process Data Processed DISK RAM CHIP 10GB2-3GB40-100MB 2-20 150-250 Millions © 2011 Ingres Corporation
9
Vector Processing verses = 1 x 1 = 1 2 x 2 = 4 3 x 3 = 9 4 x 4 = 16 5 x 5 = 25 6 x 6 = 36 7 x 7 = 49 8 x 8 = 64... n x n = n 2 SISD Single Instruction Single Data processed SIMD Single Instruction Multiple Data processed © 2011 Ingres Corporation
10
VectorWise Technology Automatic Compression Updateable Column Store Automatic Storage Indexes Minimize IO Innovations on industry proven techniques © 2011 Ingres Corporation
11
Updateable Column Store Only access relevant data Efficient incremental update enabled –Traditionally a weakness of column stores Cust_NumCust_surnameCust_first_nameCust_DOBCust_SexCust_Add_1Cust_Addr_2Cust_CityCust_State 46328927956JonesSteven17-JAN-1971M333 StKilda RdMelbourneVic 98679975745SmithLeonard04-APR-1964M147 Trafalgar RoadBirminghamEngland 52634346735RogersCindy11-MAR-1980FBelmont Rail Service 421 Station St BelmontCA 346737347347AndrewsJenny14-SEP-1977F117 West 42 nd StNew YorkNY 88673477347CooperSheldon30-JUN-1980MIngres CorporationLevel 2, 426 Argello StRedwood CityCA 34673447568KollwitzRolf22-DEC-1975MIBM Headquarters123 Mount View CrsAtlantic CityPN 99554443044WongPenny13-NOV-1981FMing On Tower 1177 Moa Tzu Tung RdBeijingChina © 2011 Ingres Corporation
12
Automatic Compression Vectorized compression –Compressed on disk –Decompression for data processing in CPU cache –Compressed in RAM Column based compression with multiple algorithms –Automatically determined by VectorWise © 2011 Ingres Corporation
13
Compression Methods Run Length Encoding –Efficient if many duplicate adjacent tuple values are present –Such as in ordered columns with few unique values Patched Frame Of Reference –Encodes values as a small difference from a page-wide base value –PFOR is effective on any data distribution with some value distribution locality Delta encoding on top of PFOR –Integers are made smaller by considering the differences between subsequent values –Highly effective on ordered data PDICT dictionary encoding –Efficient in case the value distribution is dominated by a limited amount of very frequent values –Is currently the only one that applies to character data types © 2011 Ingres Corporation
14
Automatic Storage Indexes Stores min/max value per data block Automatically created Automatically maintained Enables efficient identification of candidate data blocks © 2011 Ingres Corporation
15
authpass IVW LOG User Interface (SQL, ABF, OpenROAD, JAVA, etc.) DAS Server (iigcd) Communications Server (iigcc) Archiver (iiacp) Recovery Server (iircp) Journals Ingres Transaction Log File VectorWise Instance Architecture Name Server (iigcn) User Interface (SQL, ABF, OpenROAD, etc.) DBMS Server (iidbms) LocksLog Buffers iix100 Server VectorWise Data Store IVW Memory IVW LOCK Databases © 2011 Ingres Corporation
16
Operating System Currently available on 64-bit Linux and Windows Runs on –RedHat –Fedora –CentOS –SuSE11 –Ubuntu –Works on other Linux flavours –Windows 2008 –Windows 7 © 2011 Ingres Corporation
17
Hardware Requirements Fast multi-core CPUs Memory –2 Gbytes for OS + IVW requirements + other apps –Minimum 8 Gbytes Disk –Lots © 2011 Ingres Corporation
18
And now live © 2011 Ingres Corporation
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.