1. Practices of Data Transmission Between BGI- Shenzhen and BGI-Hong Kong

2. Highlight A domestic “international” transmission
The Hyper transfer technology
Vision for global data sharing

3. Submarine Cable Map

4. BGI-Hong Kong Higher international cable density
BGI’s largest international NGS Center

5. BGI-Shenzhen Higher domestic cable density
BGI’s largest domestic NGS Center
More bioinformatics researchers

6. Geography Geography distance is less than 20 kilometer
Different Administration Systems
Different Internet Service Providers

7. Challenges Huge size of data Limited Bandwidth High Network Latency
Over 100GB/day and increasing
Limited Bandwidth
10Mbps ~ 20Mbps
High Network Latency
20 ~ 40ms or more

8. Solution A Procedure Adv. Defect Copy data to portable media
Call FedEx/UPS services
Retrieve data from the media
Adv.
Low Cost, High Throughput
Defect
Security & Flexibility

9. Solution B Data Sharing Network Adv. Defect Scheduled transmission
Optimized transmission
Adv.
Security & Flexibility
Defect
High Cost, Low Bandwidth

10. Hyper Transfer Technology
Compression Algorithm for Genomics Data
Balance between compression ratio and efficiency
Simultaneous improvement
Enhanced by UDT Technology
An Open Source Version of Reliable UDP
Solve the Network Latency Problem

11. Typical Data Flow Raw Data Raw Data UDT Compress Module Decompress
WAN

12. DEMO

13. Current Status Development start from March.2010
Compression Ratio from 25% ~ 50 %
Supporting Network Bandwidth up to 4Gbps
Network Latency Insensitive

14. Future Work Long Term Compression Algorithm Distributed File Sharing
Putting seq. pieces together
Improve Compress Ratio to 10%~ 20%
Distributed File Sharing
CDN ( Content Distributed Network )
Distributed CDN

15. Vision Primitive CDN Shenzhen
Create image sites on 4 different Locations
Users choose the nearest site for Data downloading
Data synchronized automatically among the 4 major sites
Europe
Americas
Hong Kong

16. Vision Distributed CDN Shenzhen Tracking User’s Data
Peer 2 Peer data sharing between users
Americas
Europe
Hong Kong