Presentation is loading. Please wait.

Presentation is loading. Please wait.

How to Build a Platform that can Process 60 Terabytes of Data a Day PRESENTED BY Basil Shikin VP of Engineering, AppLovin October, 2015.

Similar presentations


Presentation on theme: "How to Build a Platform that can Process 60 Terabytes of Data a Day PRESENTED BY Basil Shikin VP of Engineering, AppLovin October, 2015."— Presentation transcript:

1 How to Build a Platform that can Process 60 Terabytes of Data a Day PRESENTED BY Basil Shikin VP of Engineering, AppLovin October, 2015

2 How to Build a Platform That Can Process 60 Terabytes of Data a Day2 30 billion ad requests per day 900μs median latency 100TB of data processed per day 9 data centers SYSTEM STATS

3 3How to Build a Platform That Can Process 60 Terabytes of Data a Day 201220142015 THE EVOLUTION Applovin Stack Evolution Overview

4 Technology that Delivers Higher Ad Revenues4 Define what matters to the engineering and business Look for major improvements 2 Always be monitoring 31 KEY STEPS How to Navigate the Scaling Journey?

5 How to Build a Platform That Can Process 60 Terabytes of Data a Day5 KEY PERFORMANCE INDICATORS

6 6 Revenue / Ads shown Median Request Latency Cost of Infrastructure How to Build a Platform That Can Process 60 Terabytes of Data a Day ENGINEERING KPI

7 How to Build a Platform That Can Process 60 Terabytes of Data a Day7 300 Servers 200 QPS 350K QPS 25K QPS 170K QPS 900 Servers 500 Servers 300 Servers Infrastructure Reduction 2012201320142015

8 8How to Build a Platform That Can Process 60 Terabytes of Data a Day Why metrics matter? Easy to Measure 1 Both Engineering and Business Sides Understand 2 Tested in Battle 3

9 How to Build a Platform That Can Process 60 Terabytes of Data a Day9 MAJOR IMPROVEMENTS

10 Membase Now it is Couchbase Simple Integration with PHP Commonly Known A Quest For The Perfect Cache GROWTH 10 How to Build a Platform That Can Process 60 Terabytes of Data a Day Redis Persists Data Has Basic Transactions Has Basic Replication CCache Home Grown Read Only Distributed Via Torrents mmap'ed Into Memory

11 How to Build a Platform That Can Process 60 Terabytes of Data a Day11 SQL StoreExternal Cache RAM Cache Ad Server BEFORE AFTER Ad Data Infrastructure

12 12How to Build a Platform That Can Process 60 Terabytes of Data a Day How we think about components? AVAILABILITY Fault Tolerance Recovery Speed REPLICATION Cross-DC Network PERFORMANCE Memory Connections PLATFORM RISK Stack Familiarity Compatibility

13 How to Build a Platform That Can Process 60 Terabytes of Data a Day13 CONSTANT MONITORING

14 How to Build a Platform That Can Process 60 Terabytes of Data a Day14 Metric Visualization

15 How to Build a Platform That Can Process 60 Terabytes of Data a Day15 BeforeAfter mechAdam

16 What are our monitoring milestones? MONITORING BASICS HERE’S HOW BRANDS USE OUR PLATFORM Create relevant in-app campaigns HEARTBEAT Availability Hardware Network APPLICATION App-Specific Built-in Third-party VISUALIZATION Find Correlations Grafana 65" Monitors FEEDBACK LOOP Alerts Learning Trends How to Build a Platform That Can Process 60 Terabytes of Data a Day16

17 17How to Build a Platform That Can Process 60 Terabytes of Data a Day THE EVOLUTION Applovin Stack Evolution Revisted 201220142015

18 SELECTED PARTNERS THANK YOU basil@applovin.com applovin.com @applovin


Download ppt "How to Build a Platform that can Process 60 Terabytes of Data a Day PRESENTED BY Basil Shikin VP of Engineering, AppLovin October, 2015."

Similar presentations


Ads by Google