Download presentation
Presentation is loading. Please wait.
Published byMarshall Osborne Modified over 6 years ago
1
Spotlight on the Petroleum and Energy Vertical February 18, 2014
2
Introduction John Tkaczewski, President and Co-Founder
Andrea Rodolico, CTO and Co-Founder, NICE | © Copyright FileCatalyst, 2013
3
Overview Big Data Challenges Facing Energy Organizations
FileCatalyst - Why Accelerated File Transfer? NICE Introduction Joint Solution – EnginFrame and FileCatalyst Case Study | © Copyright FileCatalyst, 2013
4
Big Data Challenges Global operations Vs. HPC centralization
Data acquisition for drilling and exploration Engineering, construction, simulation data is VERY big but it is usually highly compressible Data distribution to geographically dispersed interpretation and analysis locations Diverse networks (Fiber, Satellite, 3/4G, Cable/DSL, Microwave), sometimes unreliable or congested | © Copyright FileCatalyst, 2013
5
Why Accelerated File Transfer?
File transfer acceleration technology allows large “big data” files to be sent quickly over large geographical distances without being impeded by network impairments such as latency and packet loss Accomplished by transferring files using the UDP protocol instead of the TCP protocol, the protocol used for FTP UDP wastes no time communicating about the receipt of a block of data so that regardless of network latency data transmission remains constant, thus overcoming the peak and valley effect that occurs with TCP based protocols on links with high latency Reliability and congestion control is added to UDP at the application layer thus it doesn’t sacrifice its other desirable properties Fine grain bandwidth management Smart resume and re-try of large file transfers. MD5 checksum is performed before a file is resumed | © Copyright FileCatalyst, 2013
6
Speed Gains with Acceleration vs. FTP
| © Copyright FileCatalyst, 2013
7
NICE Introduction EnginFrame: the leading HPC Portal for Oil&Gas applications Web based, intuitive, scheduler independent interface to address all HPC and Interactive needs of Technical Computing users Works with leading HPC applications including reservoir simulation, seismic analysis, fluid dynamics, structural analysis, etc. Desktop Cloud Visualization (DCV): 3D without workstations Enable high end 3D applications to be run securely, close to the data, in the Private or Public Cloud, optimizing network usage over WAN and enabling collaboration and full mobility NICE Services: accelerate Technical Cloud adoption Comprehensive service offering to analyze, implement and evolve Technical Cloud solutions based on NICE and 3rd party tools | © Copyright FileCatalyst, 2013
8
O&G “Technical Cloud” Architecture
Access Self-Service Offering Resources Thin viewer Collaborators, Support staff Linux & Windows 3D sessions DCV protocol Visualization Servers HTTP(S) Storage End Users FileCatalyst protocol FC Hot Folder FileCatalyst Server HPC schdulers HPC jobs Developers, Integrators SOAP
9
Result: Fully Centralized HPC Workflows
10
5 Key benefits of the Technical Cloud
Comprehensive, engineer-friendly experience Web based, command line, seamless job and data correlation Boosts existing data management Centralized, distributed, mixed, incremental transfers Hide the complexity of distributed systems Multiple HPC schedulers, multiple clusters, batch and visualization Compatible with Mainstream ISV applications Wrapping of HPC solvers, programmable APIs, full 3D management Ready for today’s complex Oil&Gas requirements Standards based, SSO support, secure deployments, non-intrusive
11
Case Study: Global Oil Company
Houston The engineers submit jobs from KL, Perth and other locations to Houston. The data sets vary from 2GB to 5GB. They transfer such large files to Houston using Windows Explorer, submit to the cluster and then copy back the results. Data transfer can take hours and overload the corporate network during peak time.
12
Improved User Workflow
User in KL/Perth submits ECLIPSE jobs through EnginFrame Input files are uploaded by EnginFrame Multiple File Upload Applet through FileCatalyst Uploaded files are cached by EnginFrame INCLUDE/SLAVES statements are analyzed and uploaded automatically Before upload occurs, the central cache is checked Cache is global for all the EnginFrame users, to maximize time savings FileCatalyst provides bandwidth control during peak hours Job starts and results are incrementally copied back to KL/Perth, while the job is running EnginFrame “job spooler” sync through FileCatalyst Unattended; no action required by the user
13
The Solution: EnginFrame + FileCatalyst
Houston FC Hot Folder Web browser Server, Agent, Cache FC Server FileCatalyst accelerates and automates transfer of input and output files. It seamlessly integrates with EnginFrame and eliminates most manual steps previously required. The integration has considerably improved the ease of use and reliability of the workflows, shortening time for each HPC iteration and reducing network usage and congestion. Data transfers went down from hours to seconds!
14
How to contact us For more information about NICE
For more information about FileCatalyst Full case study on: | © Copyright FileCatalyst, 2013
15
Upcoming Events - Prime Time, Ottawa Westin Hotel (Feb ) - FileCatalyst User Forum, Canadian High Commission, London, UK (Feb. 24th) - BVE 2014, Excel, London, UK (Feb 25-26) - CABSAT 2014, Dubai World Trade Centre (March 11-13) - NAB Show, Las Vegas, Nevada (April 5-10) And of course don’t forget our monthly webinars... | © Copyright FileCatalyst, 2013
16
Thank you! Questions?
Similar presentations
© 2025 SlidePlayer.com. Inc.
All rights reserved.