Overview – SOE Rsync SEP 2014.

Slides:



Advertisements
Similar presentations
Backing up data On LINUX and UNIX. Logical backup Why? Job security For user data. Remember endian order, character set issues. Full backup + incremental.
Advertisements

CCNA2 MODULE 5.
Technical Aids for Mirroring Sites and China Popular Science Exhibition(CPSE) Chen Hui CNIC,CAS (Computer Network Information Center, Chinese Academy of.
Hands-On Microsoft Windows Server 2003 Chapter 2 Installing Windows Server 2003, Standard Edition.
Hands-On Microsoft Windows Server 2003 Administration Chapter 6 Managing Printers, Publishing, Auditing, and Desk Resources.
Guide to Operating System Security Chapter 2 Viruses, Worms, and Malicious Software.
Linux Operations and Administration
Copyright © 2002 Legato Systems, Inc. Authentication Version 1 Katrina Illari d1614 Authentication Version 1 Katrina Illari d June 2005 Legato Confidential.
Presenter: John Tkaczewski Duration: 30 minutes February Webinar: The Basics of Remote Data Replication.
Copyright MCL-Technologies v MCL-Collection MCL-Link.
Linux Operations and Administration
FTP Server and FTP Commands By Nanda Ganesan, Ph.D. © Nanda Ganesan, All Rights Reserved.
NT4 SP4 Security Jack Schmidt - Fermilab
FTP File Transfer Protocol Graeme Strachan. Agenda  An Overview  A Demonstration  An Activity.
Core 3: Communication Systems. Network software includes the Network Operating Software (NOS) and also network based applications such as those running.
Λειτουργικά Συστήματα – Lab2 Γιάννης Πετράκης. Directory Navigation and Control  The Unix file system is set up like a tree branching out from the root.
File Transfer Protocol (FTP) FTP host stores files Client logs into host Client program sends command to get a file FTP host downloads the file with error.
File Systems cs550 Operating Systems David Monismith.
FTP COMMANDS OBJECTIVES. General overview. Introduction to FTP server. Types of FTP users. FTP commands examples. FTP commands in action (example of use).
Interstage BPM v11.2 1Copyright © 2010 FUJITSU LIMITED ADMINISTRATION.
Problem Solving With C++ SVN ( Version Control ) April 2016.
Using Grsync with Ubuntu Presented by Dave Mawdsley, DACS Member, Linux SIG August 20, 2008 (making rsync easy with a memory key or a server)
Simple Backup Methods Jon Larsen Omaha Linux User Group March 7th, 2006.
Overview – SOE Syslog-ng
Computer System Structures
Back it up – Don't be a fool!
Web and Proxy Server.
Overview – SOE Cfengine v3.4.0
Overview – SOE Openssh Sep 2014.
Overview – SOE Openssh Dec 2013.
Overview – SOE Net-SNMP v5.7.2
Operating System Kernel Compilation
Overview – TI Services September-2016.
Overview – TI Services November-2015.
Overview – SOE Net-SNMP v
Overview – SOE Net-SNMP v5.7.3
SYSTEM ADMINISTRATION PART I by İlker Korkmaz and Kaya Oğuz
Overview – SOE Changepw
Jonathan Walpole Computer Science Portland State University
Overview – SOE Sudo SEP 2014.
CCNA Routing and Switching Routing and Switching Essentials v6.0
Chapter 9 Router Configuration (Ospf, Rip) Webmin, usermin Team viewer
Information Security Professionals
Linux file system "On a UNIX system, everything is a file;
Overview – SOE Sudo Dec 2013.
Overview – SOE PatchTT November 2015.
Overview – SOE Cfengine v3.6.5
Overview – SOE Openssh v7.1p1
Overview – SOE PatchTT December 2013.
Overview – SOE Sudo September 2016.
Chapter 2: System Structures
Overview – SOE Dssh September 2016.
Overview – SOE Sudo November 2015.
Part 3 – Remote Connection, File Transfer, Remote Environments
Overview – SOE Lsof v4.87 Dec 2013.
IBM Software Group | Tivoli Brand Software
Introduction to the Junos Operating System
Chapter 10: Device Discovery, Management, and Maintenance
CCNA Routing and Switching Routing and Switching Essentials v6.0
File Transfer Olivia Irving and Cameron Foss
Operating System Kernel Compilation
Troubleshooting Your Jobs
Chapter 10: Device Discovery, Management, and Maintenance
OPERATING SYSTEMS DESIGN AND IMPLEMENTATION Third Edition ANDREW S
Web Programming Essentials:
CIS 155 Lecture 10, Farewell to UNIX
Week 1 – Lesson 2: Creating Shell Scripts, Linux Commands
Version Control with Git and GitHub
STATEL an easy way to transfer data
Presentation transcript:

Overview – SOE Rsync SEP 2014

What is SOE Rsync? Synchronizes files and directories from one location to another Can perform differential uploads and downloads across the network, transferring only data that has changed Transfer the tiny pieces of diffs are then compressed on the fly, further saving you file transfer time and reducing the load on the network Part of the UnixSOE Enterpise Suite v9.0 and is supported across various UNIX flavors

SOE Rsync – Features Support for copying links, devices, owners, groups and permissions. Does not require root privileges. Pipelining of file transfers to minimize latency costs. Support for anonymous or authenticated rsync servers (ideal for mirroring). Exclude and exclude-from options similar to GNU tar. A CVS exclude mode for ignoring the same files that CVS would ignore.

Sun Sparc/x86-64 Architecture SOE Rsync – Supported OS Operating System Version Architecture Sun Solaris 8 Sun Sparc Solaris 9 Solaris 10 Sun Sparc/x86-64 Architecture Solaris 11 HP-UX HP-UX11i HP PA-RISC HP-UX11i V2 (11.23) HP PA-RISC/ HP Itanium HP-UX11i V3 (11.31) AIX AIX 5.3 IBM pSeries AIX 6.1 AIX 7.1

SOE Rsync – Command common options -v : Verbose (try -vv for more detailed information) -e "ssh options" : specify the ssh as remote shell -a : archive mode -r : recurse into directories -z : compress file data -X, --xattrs: preserve extended attributes -R, --relative: use relative path names -l, --links: copy symlinks as symlinks -H, --hard-links: preserve hard links -n, --dry-run: perform a trial run with no changes made -q, --quiet suppress non-error messages -b, --backup: make backups -u, --update: skip files that are newer on the receiver -d, --dirs transfer directories without recursing --delete : delete files that don't exist on sender (system) -p, --perms: preserve permissions -t, --times: preserve modification times -f, --filter=RULE add a file-filtering RULE

SOE Rsync – Examples Transfer of files /opt/soe/local/bin/rsync –t /data/web host2:/var/data/pub Running Unix SOE rsync on remote host it can use either ssh or rsh as medium of transport /opt/soe/local/bin/rsync –avz –rsh=ssh /data/web host2:/var/data/pub Transfer only Directory Tree Structure /opt/soe/local/bin/rsync -v –d /data/web host2:/var/data/pub Create backup of destination files which are not in sync /opt/soe/local/bin/rsync -av --backup --backup-dir dir=/tmp/rsync-backup --suffix=.bkb /data/web host2:/var/data/pub Run Rsync as daemon /opt/soe/local/bin/rsync -–daemon To exclude some specified files and generating a log /opt/soe/local/bin/rsync -avz --inplace --log-file=/tmp/rsync-backup/rsync-log --exclude=*extra* /data/web host2:/var/data/pub Do not sync just run a dry test /opt/soe/local/bin/rsync –avn /data/web host2:/var/data/pub

UnixSOE Rsync-3.1-1 – What is New? New Features If the receiver gets bogus filenames from the sender (an unexpected leading slash or a ".." infix dir), exit with an error. This prevents a malicious sender from trying to inject filenames that would affect an area outside the destination directories. Fixed a failure to remove the partial-transfer temp file when interrupted (and rsync is not saving the partial files). Changed the chown/group/xattr-set order to avoid losing some security-related xattr info (that would get cleared by a chown). Fixed a bug in the xattr-finding code that could make a non-root-run receiver not able to find some xattr numbers. Fixed a bug in the early daemon protocol where a timeout failed to be honored (e.g. if the remote side fails to send us the initial protocol greeting). Fixed unintended inclusion of commas in file numbers in the daemon log. We once again send the 'f' sub-flag (of -e) to the server side so it knows that we can handle incremental-recursion directory errors properly in older protocols. Fixed an issue with too-aggressive keep-alive messages causing a problem for older rsync versions early in the transfer.

UnixSOE Rsync-3.1-1 – What is New? New Features Fixed an incorrect message about backup-directory-creation when using --dry-run and the backup dir is not an absolute path. Fixed a bug where a failed deletion and/or a failed sender-side removal would not affect the exit code. Fixed a bug that caused a failure when combining --delete-missing-args with --xattrs and/or --acls. Fixed a strange dir_depth assertion error that was caused by empty-dir removals and/or duplicate files in the transfer. Fixed a problem with --info=progress2's output stats where rsync would only update the stats at the end of each file's transfer. It now uses the data that is flowing for the current file, making the stats more accurate and less jumpy. Fixed an itemize bug that affected the combo of --link-dest, -X, and -n. Fixed a problem with delete messages not appearing in the log file when the user didn't use --verbose. Improve chunked xattr reading for OS X. Removed an attempted hard-link xattr optimization that was causing a transfer failure. This removal is flagged in the compatibility code, so if a better fix can be discovered, we have a way to flip it on again.

UnixSOE Rsync-3.1-1 – What is New? New Features Fixed a bug when the receiver is not configured to be able to hard link symlimks/devices/special-file items but the sender sent some of these items flagged as hard-linked. We now generate a better error if the buffer overflows in do_mknod(). Fixed a problem reading more than 16 ACLs on some OSes. Fixed the reading of the secrets file to avoid an infinite wait when the username is missing. Fixed a parsing problem in the --usermap/--groupmap options when using MIN-MAX numbers. Switched Cygwin back to using socketpair "pipes" to try to speed it up. Added knowledge of a few new options to rrsync.

Solution Pack Unix SOE & TI Services Questions & Feedback Product Support Helpline unixsoe@csc.com