Download presentation
Presentation is loading. Please wait.
Published byElaine Cox Modified over 8 years ago
1
Optimizing search through distributed space partitioning RUMBLE Gal Yaroslavsky
2
What is Rumble? Content aggregator Users “vote” and influence content Submissions are geographically fixated Content ranking based on locality
3
What are the requirements? Fast search results Fast insertions Space efficient Dynamic balancing & quick updates
4
Initial thoughts Peer-to-peer Servers are geographically distributed, client polls from surroundings latency – slow results data replication – redundancy update cascade – slow updates Peer-to-peer Servers are geographically distributed, client polls from surroundings
5
Initial thoughts Client-server. Single server Discretized search space certain areas are more popular than others – not space efficient still O(n) no fault tolerance
6
Initial thoughts Client-server Single server In-Memory Data Grid Discretized search space Spatial Database using a spatial database incurs large overhead not optimized certain types of queries
7
Initial thoughts Client-server Single server In-Memory Data Grid Discretized search space Spatial Database
8
Distributed Search Tree © Client-server REST with optional authentication. In-memory data grid Asynchronous operation. Concurrency. Dynamic addition and removal of cluster members Recursive space partitioning Subdivide dense regions into quadrants
9
Cluster Congregation Connect to database Join cluster ( Hazelcast) Join web proxy
10
Buckets, Bottles, Spills and Fills ® All operations on the Distributed Search Tree can be summarized as Buckets, Bottles, Spills and Fills
11
Technology Client Server Android Volley Asynchronous Networking Google Maps Static Map Images Google Maps APIv2 Jetty Session management RESTful requests Oracle MySQL Server Hazelcast Distributed, Open Source In-Memory Data Grid; Cluster
12
Client Webserver (Jetty) Hazelcast Cluster Failover Webserver (Jetty) Request Processing Volley
13
Future thought and implementation Social media integration Partition cluster members to preform unique actions Query by region -> draw on your screen Name-identified tags, !PSUHarrisburg
Similar presentations
© 2024 SlidePlayer.com. Inc.
All rights reserved.