Experience with iRODS 4.0 Enabling Multisite Collaboration Presented by Richard Mansfield (Systems Engineer) Tuesday 9 th September iRODS User Group Meeting.

Slides:



Advertisements
Similar presentations
Module 13: Implementing ISA Server 2004 Enterprise Edition: Site-to-Site VPN Scenario.
Advertisements

1 Dynamic DNS. 2 Module - Dynamic DNS ♦ Overview The domain names and IP addresses of hosts and the devices may change for many reasons. This module focuses.
Module 5: TLS and SSL 1. Overview Transport Layer Security Overview Secure Socket Layer Overview SSL Termination SSL in the Hosted Environment Load Balanced.
© 2011 Autodesk Go Big or Go Home! Part 1 – Large Scale Autodesk Vault Deployments Irvin Hayes Jr. Technical Product Manager.
Extending ForeFront beyond the limit TMGUAG ISAIAG AG Security Suite.
1 Configuring Internet- related services (April 22, 2015) © Abdou Illia, Spring 2015.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 13: Administering Web Resources.
Module 5: Configuring Access to Internal Resources.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 13: Administering Web Resources.
CS 497C – Introduction to UNIX Lecture 35: - TCP/IP Networking Tools Chin-Chih Chang
Barracuda Web Filter Overview March 26, 2008 Alan Pearson, Monroe County School District Marcus Burge, Network Engineer.
 Proxy Servers are software that act as intermediaries between client and servers on the Internet.  They help users on private networks get information.
CLUSTER WEBLOGIC SERVER. 1.Creating clusters and understanding its concept GETTING STARTED.
1 Chapter Overview Introduction to Windows XP Professional Printing Setting Up Network Printers Connecting to Network Printers Configuring Network Printers.
1 Enabling Secure Internet Access with ISA Server.
Remote Accessing Your Home Computer Using VNC and a Dynamic DNS Name.
1 Advanced Application and Web Filtering. 2 Common security attacks Finding a way into the network Exploiting software bugs, buffer overflows Denial of.
Hosted Exchange The purpose of this Startup Guide is to familiarize you with ExchangeDefender's Exchange and SharePoint Hosting. ExchangeDefender.
Va-scanCopyright 2002, Marchany Securing Solaris Servers Randy Marchany.
Configuring a Web Server. Overview Overview of IIS Preparing for an IIS Installation Installing IIS Configuring a Web Site Administering IIS Troubleshooting.
LANDesk Management Gateway
Implementing Multi-Site Clusters April Trần Văn Huệ Nhất Nghệ CPLS.
MCSE Guide to Microsoft Exchange Server 2003 Administration Chapter Four Configuring Outlook and Outlook Web Access.
Implementing ISA Server Publishing. Introduction What Are Web Publishing Rules? ISA Server uses Web publishing rules to make Web sites on protected networks.
Grouper Training - Admin - WS - Part 2 Chris Hyzer Internet2 University of Pennsylvania This work licensed under a Creative Commons Attribution-NonCommercial.
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment, Enhanced Chapter 13: Administering Web Resources.
SUSE Linux Enterprise Desktop Administration Chapter 12 Administer Printing.
Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.
Module 4: Configuring ISA Server as a Firewall. Overview Using ISA Server as a Firewall Examining Perimeter Networks and Templates Configuring System.
TELE 301 Lecture 10: Scheduled … 1 Overview Last Lecture –Post installation This Lecture –Scheduled tasks and log management Next Lecture –DNS –Readings:
Designing Authentication for a Microsoft Windows 2000 Network Designing Authentication in a Microsoft Windows 2000 Network Designing Kerberos Authentication.
Module 11: Implementing ISA Server 2004 Enterprise Edition.
@CloudOps_www.cloudops.com Swift UI in CloudStack with Single Sign-On CloudStack Collaboration Conference 2012.
Module 5: Configuring Internet Explorer and Supporting Applications.
Internet Information Server Name : Yao Gu Date : 10-June-2000 COSC : 573.
A Brief Documentation.  Provides basic information about connection, server, and client.
1 Internet Network Services. 2 Module - Internet Network Services ♦ Overview This module focuses on configuring and customizing the servers on the network.
Integrating and Troubleshooting Citrix Access Gateway.
Extending ISA/IAG beyond the limit. AGAT Security suite - introduction AGAT Security suite is a set of unique components that allow extending ISA / IAG.
Module 7: Advanced Application and Web Filtering.
Networking in Linux. ♦ Introduction A computer network is defined as a number of systems that are connected to each other and exchange information across.
Accessing Evitech network via FTP by Susan Jansson.
Configuring and Troubleshooting Identity and Access Solutions with Windows Server® 2008 Active Directory®
1 Chapter Overview Creating Web Sites and FTP Sites Creating Virtual Directories Managing Site Security Troubleshooting IIS.
Administrasi Server Load Balancing. Load Balancing Load balancing means the ability to spread the load of processing for an application over a number.
FTP COMMANDS OBJECTIVES. General overview. Introduction to FTP server. Types of FTP users. FTP commands examples. FTP commands in action (example of use).
Website Design:. Once you have created a website on your hard drive you need to get it up on to the Web. This is called "uploading“ or “publishing” or.
1 CMPT 471 Networking II DNS © Janice Regan,
Computer Network Architecture Lecture 6: OSI Model Layers Examples 1 20/12/2012.
Open Science Grid Build a Grid Session Siddhartha E.S University of Florida.
Securing the Network Perimeter with ISA Server 2004 Ravi Sankar IT Professional Evangelist Microsoft.
John Rushford Apache Traffic Server Multi-Site Origin and Secondary Consistent Hash Feature John Rushford
Vmware 2V0-621D Vmware Exam Questions & Answers VMware Certified Professional 6 Presents
VIRTUAL SERVERS Chapter 7. 2 OVERVIEW Exchange Server 2003 virtual servers Virtual servers in a clustering environment Creating additional virtual servers.
1 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events.
Andrew Lahiff HEP SYSMAN June 2016 Hiding infrastructure problems from users: load balancers at the RAL Tier-1 1.
Module 3: Enabling Access to Internet Resources
Apache web server Quick overview.
Affinity Depending on the application and client requirements of your Network Load Balancing cluster, you can be required to select an Affinity setting.
Securing the Network Perimeter with ISA 2004
70-290: MCSE Guide to Managing a Microsoft Windows Server 2003 Environment Chapter 13: Administering Web Resources.
Implementing TMG Server Publishing
CompTIA Server+ Certification (Exam SK0-004)
Unit 27: Network Operating Systems
IIS.
IS 4506 Server Configuration (HTTP Server)
Configuring Internet-related services
Configuration Of A Pull Network.
Presentation transcript:

Experience with iRODS 4.0 Enabling Multisite Collaboration Presented by Richard Mansfield (Systems Engineer) Tuesday 9 th September iRODS User Group Meeting (UCL)

2 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Deploying WOS resource on iRODS 4.0 Download DDN WOS resource RPM – –Or, build from source on GitHub Install WOS driver on iRODS server & iCAT server –Failure to install on iCAT server will result in errors (!!!) Configure WOS resource on iRODS server –“wos_host” refers to single WOS endpoint –Be careful of length parameter length and use of semicolon $ iadmin mkresc wosResc compound $ iadmin mkresc cacheResc 'unix file system' eiserver1:/Vault $ iadmin mkresc archiveResc wos eiserver1:/fakePath \ 'wos_host= $ iadmin addchildtoresc wosResc cacheResc cache $ iadmin addchildtoresc wosResc archiveResc archive

3 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Node-local HTTP Proxy global log /dev/log local0 log /dev/log local1 notice user haproxy group haproxy daemon maxconn defaults log global mode http option dontlognull option tcplog retries 5 option redispatch contimeout 600s clitimeout 10m srvtimeout 10m maxconn errorfile 400 /etc/haproxy/errors/400.http errorfile 403 /etc/haproxy/errors/403.http errorfile 408 /etc/haproxy/errors/408.http errorfile 500 /etc/haproxy/errors/500.http errorfile 502 /etc/haproxy/errors/502.http errorfile 503 /etc/haproxy/errors/503.http errorfile 504 /etc/haproxy/errors/504.http... Continued listen stats *:9091 mode http balance timeout client 30s timeout connect 30s timeout server 60s stats uri /stats stats realm HAProxy\ Statistics stats auth admin:admin stats admin if TRUE frontend wos bind *:8200 mode http default_backend wos backend wos mode http timeout check 60s option httpchk GET /status/summary http-check expect ! rstatus ^5 balance roundrobin server :80 check inter 60s rise 3 fall 3 server :80 check inter 60s rise 3 fall 3 server :80 check inter 60s rise 3 fall 3 backup server :80 check inter 60s rise 3 fall 3 backup Example haproxy.conf on iRODS Server

4 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Public Health England & iRODS Introduction –Executive agency for England’s Dept. of Health –Provides centralised infectious disease sequencing service –Classify DNA samples of potentially harmful bacteria –Patient samples submitted by hospitals & medical establishments Sequencing service –Six Illumina sequencers –Supported by 60 in-house researches –Bacteria sequence analysed on EXAScaler –Results published to WOS archive –Collaboration with clinical partners via iRODS

5 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Proposed iRODS Architecture Object referenced via ObjectID & iRODS server name Object referenced via ObjectID & iRODS server name

6 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Remote Collaboration Client access remote iRODS server

7 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Non-optimal Data Affinity Client prevented from accessing local data

8 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com Optimal Data Affinity for Collaboration Object referenced via ObjectID & local hostname aliases iRODS Server auth. iCAT via common SAN cert Object referenced via ObjectID & local hostname aliases iRODS Server auth. iCAT via common SAN cert

9 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com SSL Certification for iRODS Servers Use SSL “Subject Alternative Names” –Allows multiple hostnames/IPs embedded in single SSL certificate –Commonly used for { www | ftp | mail }.example.com Multisite iRODS scenario –Can’t assume common hostname naming scheme –Certainly will use different IP addresses Use site specific common hostname aliases –“ irods-local ” & “ wos-local ” (either in /etc/hosts or site DNS) –Use host aliases in iRODS driver configuration Re-create WOS resource using aliases $ iadmin mkresc cacheResc 'unix file system' irods-local:/Vault $ iadmin mkresc archiveResc wos irods-local:/fakePath \ 'wos_host=

10 © 2014 DataDirect Networks, Inc. * Other names and brands may be claimed as the property of others. Any statements or representations around future events are subject to change. ddn.com WOS Driver roadmap on GitHub