Presentation is loading. Please wait.

Presentation is loading. Please wait.

Australian Synchrotron Data curatorship for protein crystallography Julian Adams & Richard Farnsworth.

Similar presentations


Presentation on theme: "Australian Synchrotron Data curatorship for protein crystallography Julian Adams & Richard Farnsworth."— Presentation transcript:

1

2 Australian Synchrotron Data curatorship for protein crystallography Julian Adams & Richard Farnsworth

3 Australian Synchrotron Current Technologies Disks SCSI IDE RAID Tapes LTO DLT Robotic tape changers Optical Media DVD DVD2

4 Australian Synchrotron Data quantities (worst case) 1 image every 3-5 seconds 20 images per minute 1200 images per hour 29000 images per day Each image 15 – 30 MB 20x60x24x20Mb = 576 Mb = 0.6 TB per day 3 x 12weeks x 7days x.6 TB = 250 TB per year

5 Australian Synchrotron Data management Two copies in as short as practical time Create a take-home copy at the end of the run for the user Retain a single copy onsite for 3 months Deposit data in a long term storage facility  This data should only be accessible by requests sent back to the beam line.

6 Australian Synchrotron Practicality Data collection buffer with 1.5 TB disk Server with 30-40 TB raid array Users using a portable hard drives (Firewire, USB2), or optical media Long term storage, 5 years = 1.3 PB per PX beamline

7 Australian Synchrotron Data collection strategy

8 Australian Synchrotron Data rates LTO technology can stream at up to 80 MB/s given optimum conditions LTO2 typically gets in the region 8-15 MB/s Worst case sufficient for our purposes (just) Off sites limitations are: 96 10 Gb/s Links to VERN/GRANGENET/AARNET. Cost prohibitive for huge data flow at the moment


Download ppt "Australian Synchrotron Data curatorship for protein crystallography Julian Adams & Richard Farnsworth."

Similar presentations


Ads by Google