1. Overview – SOE Rsync
SEP 2014

2. What is SOE Rsync?
Synchronizes files and directories from one location to another
Can perform differential uploads and downloads across the network, transferring only data that has changed
Transfer the tiny pieces of diffs are then compressed on the fly, further saving you file transfer time and reducing the load on the network
Part of the UnixSOE Enterpise Suite v9.0 and is supported across various UNIX flavors

3. SOE Rsync – Features
Support for copying links, devices, owners, groups and permissions.
Does not require root privileges.
Pipelining of file transfers to minimize latency costs.
Support for anonymous or authenticated rsync servers (ideal for mirroring).
Exclude and exclude-from options similar to GNU tar.
A CVS exclude mode for ignoring the same files that CVS would ignore.

4. Sun Sparc/x86-64 Architecture
SOE Rsync – Supported OS
Operating System
Version
Architecture
Sun
Solaris 8
Sun Sparc
Solaris 9
Solaris 10
Sun Sparc/x86-64 Architecture
Solaris 11
HP-UX
HP-UX11i
HP PA-RISC
HP-UX11i V2 (11.23)
HP PA-RISC/ HP Itanium
HP-UX11i V3 (11.31)
AIX
AIX 5.3
IBM pSeries
AIX 6.1
AIX 7.1

5. SOE Rsync – Command common options
-v : Verbose (try -vv for more detailed information)
-e "ssh options" : specify the ssh as remote shell
-a : archive mode
-r : recurse into directories
-z : compress file data
-X, --xattrs: preserve extended attributes
-R, --relative: use relative path names
-l, --links: copy symlinks as symlinks
-H, --hard-links: preserve hard links
-n, --dry-run: perform a trial run with no changes made
-q, --quiet suppress non-error messages
-b, --backup: make backups
-u, --update: skip files that are newer on the receiver
-d, --dirs transfer directories without recursing
--delete : delete files that don't exist on sender (system)
-p, --perms: preserve permissions
-t, --times: preserve modification times
-f, --filter=RULE add a file-filtering RULE

6. SOE Rsync – Examples Transfer of files
/opt/soe/local/bin/rsync –t /data/web host2:/var/data/pub
Running Unix SOE rsync on remote host it can use either ssh or rsh as medium of transport
/opt/soe/local/bin/rsync –avz –rsh=ssh /data/web host2:/var/data/pub
Transfer only Directory Tree Structure
/opt/soe/local/bin/rsync -v –d /data/web host2:/var/data/pub
Create backup of destination files which are not in sync
/opt/soe/local/bin/rsync -av --backup --backup-dir dir=/tmp/rsync-backup --suffix=.bkb /data/web host2:/var/data/pub
Run Rsync as daemon
/opt/soe/local/bin/rsync -–daemon
To exclude some specified files and generating a log
/opt/soe/local/bin/rsync -avz --inplace --log-file=/tmp/rsync-backup/rsync-log --exclude=*extra* /data/web host2:/var/data/pub
Do not sync just run a dry test
/opt/soe/local/bin/rsync –avn /data/web host2:/var/data/pub

7. UnixSOE Rsync-3.1-1 – What is New?
New Features
If the receiver gets bogus filenames from the sender (an unexpected leading slash or a ".." infix dir), exit with an error. This prevents a malicious sender from trying to inject filenames that would affect an area outside the destination directories.
Fixed a failure to remove the partial-transfer temp file when interrupted (and rsync is not saving the partial files).
Changed the chown/group/xattr-set order to avoid losing some security-related xattr info (that would get cleared by a chown).
Fixed a bug in the xattr-finding code that could make a non-root-run receiver not able to find some xattr numbers.
Fixed a bug in the early daemon protocol where a timeout failed to be honored (e.g. if the remote side fails to send us the initial protocol greeting).
Fixed unintended inclusion of commas in file numbers in the daemon log.
We once again send the 'f' sub-flag (of -e) to the server side so it knows that we can handle incremental-recursion directory errors properly in older protocols.
Fixed an issue with too-aggressive keep-alive messages causing a problem for older rsync versions early in the transfer.

8. UnixSOE Rsync-3.1-1 – What is New?
New Features
Fixed an incorrect message about backup-directory-creation when using --dry-run and the backup dir is not an absolute path.
Fixed a bug where a failed deletion and/or a failed sender-side removal would not affect the exit code.
Fixed a bug that caused a failure when combining --delete-missing-args with --xattrs and/or --acls.
Fixed a strange dir_depth assertion error that was caused by empty-dir removals and/or duplicate files in the transfer.
Fixed a problem with --info=progress2's output stats where rsync would only update the stats at the end of each file's transfer. It now uses the data that is flowing for the current file, making the stats more accurate and less jumpy.
Fixed an itemize bug that affected the combo of --link-dest, -X, and -n.
Fixed a problem with delete messages not appearing in the log file when the user didn't use --verbose.
Improve chunked xattr reading for OS X.
Removed an attempted hard-link xattr optimization that was causing a transfer failure. This removal is flagged in the compatibility code, so if a better fix can be discovered, we have a way to flip it on again.

9. UnixSOE Rsync-3.1-1 – What is New?
New Features
Fixed a bug when the receiver is not configured to be able to hard link symlimks/devices/special-file items but the sender sent some of these items flagged as hard-linked.
We now generate a better error if the buffer overflows in do_mknod().
Fixed a problem reading more than 16 ACLs on some OSes.
Fixed the reading of the secrets file to avoid an infinite wait when the username is missing.
Fixed a parsing problem in the --usermap/--groupmap options when using MIN-MAX numbers.
Switched Cygwin back to using socketpair "pipes" to try to speed it up.
Added knowledge of a few new options to rrsync.

10. Solution Pack Unix SOE & TI Services
Questions & Feedback
Product Support Helpline