Ten Years and Change the MX data archive at ALS 8.3.1.

Slides:



Advertisements
Similar presentations
Keeping an old 35mm film in your drawer? - Don´t!
Advertisements

What is HathiTrust and How Can it Make a Difference? Sourcing and Scaling brought to the collective collection.
Data Curation in Crystallography: Publisher Perspectives JISC Data Cluster Consultation Workshop CCLRC, Didcot, Oxon 10 October 2006.
Your Credit History consumer.gov. You and your credit Have you ever had: – Credit card? – Loan? – Utilities in your name? – Cell phone with a monthly.
Credit. Borrowers & Lenders Find Your Match! Whos Your Middle-Man???
Lesson 9 Fixing Your Credit.
A new look at the Linux Operating System
Once upon a time, in the prosperous city of Hamelin, people used to live happy. But after a period of big, a plague of appeared and life became very sad.
RAISE YOUR CREDIT SCORE 50 POINTS IN FORTY-FIVE DAYS Bruce Gustafson (303) Crestline/Universal Lending.
1.
Image Storage and Archive. Current problems and goals of ‘Archive Project ‘ Images/image sets impossible to find No metadata, few notes for support Data.
Establishing Credit Presented By:. What is credit? Credit is more than a plastic card you use to buy things --- it is your financial trustworthiness.
clean up cheer up hand outraise money /ei/ call up Help the Old people put upgive out visit the old people’s home You could…
Page Image Compression for Large-Scale Digitization Sample Images JPEG 2000 Yale University Library January, 2008.
1 Copyright and Intellectual Property Design Issues by Jeremy Rowe
National Best Debt Solutions Richard Moxley
Lape’s Laws of Credit and Money THE MOST IMPORTANT INFORMATION YOU WILL EVER LEARN!!!
Cloud Don McGregor Research Associate MOVES Institute
By: Natalie Zoglman.  Branch of engineering  Paper converting  Mechanics  Kinematics  Robotics  Etc.
Green Eggs and Ham Book Report By: Cassandra Butler.
Chapter 3 Assessing your Potential. What do you want to be?
Casey Jackman Aaron Bailey Auguste Toluta’u. CAPTURE.
Keys to Success South Yorkshire Credit Union Ltd.
Ten Years and Change the MX data archive at ALS
CASH AND TRASH Experiences of a university professor at Ludhiana I contribute regularly for gurdwara functions. Once, special Gurpurb celebrations were.
Name: Mohamad Kechaiche Module: Graphic design Internship : NYC Department of Housing Preservation and Development (HPD)
Cloud Computing Dave Elliman 11/10/2015G53ELC 1. Source: NY Times (6/14/2006) The datacenter is the computer!
Term Project Part 3 Matt Willey. What effect does interest rate have on total payment? A lower the interest rate means less interest paid over all. When.
Checking Accounts. What is a checking account? A bank account that allows easy access to the funds. You can use your checking account to pay bills. With.
My personality By: Richard Chambers. About me Well I love to draw and read and not pay attention in my English class. I love to write stories about random.
Credit Reports How to improve your score, and help members to do the same.
Retrospective Testing - How Good Heuristics Really Work Andreas Marx AV-Test.org University of Magdeburg GEGA IT-Solutions GbR.
 Genre : Fiction  Recommendation : I recommend this entertaining book because it’s about a girl trying to steel a dog. Also, it is a great story for.
June 3, 2016 Research data management – an introduction Slides provided by the DaMaRO Project, University of Oxford Research Services.
Jenn Lavigne. Conducted primary source research with students? Noticed that this is really only possible with current events topics? Wished that you could.
Everything you have always wanted to know about the Perfect tenses… …and you probably did, but you forgot.
Optimizing structure determination How many are we solving? What is the limit? Are we there yet? Why not? What are the biggest problems?
What is Mean Absolute Deviation?  Another measure of variability is called the mean absolute deviation. The mean absolute deviation (MAD) is the average.
Salvation Army ST W, North Vancouver, British Columbia (604) ‎ northshoresalvationarmy.com.
WGS Data management course Try-out , Hugo Besemer.
INVENTORY TANGIBLE ITEMS HELD FOR RESALE IN THE ORDINARY COURSE OF BUSINESS PRESENTED ON THE BALANCE SHEET UNDER CURRENT ASSETS AT THE LOWER OF COST OF.
BY: ANDY Primary Sources / Titanic. My Topic: Titanic The topic I have chosen is the event of the Titanic. Since I don’t really know a lot about the event.
Sight Words.
Library of Congress Online Services. Mission The Library's mission is to support the Congress in fulfilling its constitutional duties and to further the.
What’s a Credit Report? From age 18 on, agencies collect data about your spending habits. Monitor your ability to handle risks (i.e. loans I installment.
Establishing Credit Presented By:. Credit is more than a plastic card you use to buy things --- it is your financial trustworthiness. What is credit?
Center for Structures of Membrane Proteins © 2006 Optimizing x-ray structure determination James Holton LBNL/UCSF April 6, 2006.
First Semester Review. Credit Score Credit score is lower if: Very brief credit history Apply for new cards frequently Exceed your credit card spending.
1 Saving The Right Way! Sally vs. Will 2 Who do you want to be like? $Will? $Sally?
Video Title MY LOGO. Today’s Promise “My promise (the transformation) goes here”
The Writing Process WEEK 2 Prewriting. During our review of the writing process… Make sure to keep your work organized in a writing folder. Make sure.
Chapter 27 Project By: J.T. Brown O.D. Quinn B.M. Scapa K.R. Thomas.
Chapter 6 Discovering Computers Fundamentals Storage.
1 B/Z/M F 06 - Lec 12 Today’s theme: using old exams What is the best way to use old exams (from my website)? –Look up all the answers and then just.
Preparing Lifelong Learning Personal Finance:.  Imagine you are 25 years old describe your life. - What is your job? - Where do you live? - What do you.
Savings Cents make Euros Next Slide. Aim of the Lesson ► To help students understand what savings are, the necessity of savings in certain situations,
Top producing beamlines of the world Structures credited.
Instructor: Natalia Fofanova University of Houston Created by: Eric Adler Section < Click to roar! Eric Adler.
Everything you know about DVDFab DVD copy DVDFab DVD copy is one of the most famous software used for copying and burning the DVD to the blank DVD disc.
Why are. we not solving more struct tures? James Holton University of California San Francisco and Advanced Light Source Lawrence.
Chance Chance Community Chest JOB SEEKER Community Chest JOB SEEKER
Lesson Objectives Aims You should know about: 1.3.1:
Steve Ko Computer Sciences and Engineering University at Buffalo
Steve Ko Computer Sciences and Engineering University at Buffalo
Carnegie Mellon University Libraries
Personal Globe Assessment
NIU Case Study Lynne M. Thomas
All About Me Name: Date:.
Present perfect vs. simple past
An Introduction to Partitioning
Presentation transcript:

Ten Years and Change the MX data archive at ALS 8.3.1

ALS data collection history terabytes (uncompressed)

ALS data collection history terabytes (uncompressed)

ALS data collection history images x 10 6

ALS data collection history images x 10 6

ALS data collection history images x PDB entries

ALS data collection history images x PDB entries

images x PDB entries

DVD data archive: 82 TB

Which data go with which PDB? 260,000 images are called “test” cell: – is within 5 Å and 5° of 16,000 PDBs focusing on PDBs credit ALS with data 44 of these didn’t actually collect data 64 collected data, but no credit

1.images from collected “near” edges 3.find “runs” of >10 images 4.unify multi-wedge sets 5.run labelit & XDS 6.>70% complete? 7.I/σ > 10 8.reduced cell vs PDB 1,604, , to 200+ Which data go with which PDB?

Responses to inquiries “I have to find my old note book as I have no idea what that is.” “I have changed jobs a few times since and am really far away from crystallography now.” “Will see what I can find.” “We solved it but never published it. Sorry!”

DVD data archive

Primary failure mode of DVDs

dataset identification protocol 1.images from collected “near” edges 3.find “runs” of >10 images 4.sort out multi-wedge sets 5.run XDS 6.>70% complete? 7.I/σ > 10 8.reduced cell vs PDB 1,604, , to 200+

Unit Cell: best R cryst after rigid-body refinement RMS unit cell length deviation (Å) 1hh7 M. TB CSOR 1rb5 myoglobin

MAD/SAD datasets R iso vs PDB deposit best R cryst after rigid-body refinement Published non-isomorphous Unsolved?

EGDA Dec 01 19:45: egda46_*1_E#_###.img (1112 images, Se MAD) Dec 02 15:10: egda27_*1_###.img (180, 1A, native?) Dec 02 19:21: egdau1_*1_###.img (427, 8000eV (U?) SAD) Dec 02 20:58: egdau1_*2_###.img (360, 8000eV (U?) SAD) Jun 01 14:07: egda60_*1_###.img (360, Lutetium SAD) “I think that these EGDA data sets are very likely some of xxx’s data sets, he was working on E.coli guanine deaminase, something he brought from yyy. No structure was ever published James, xxx was unable to solve the structure from these data.”

~2.9 Å P R = 0.32 R free = 0.39 PDB ID: ???? E. coli guanine deaminase

Summary saving data could double productivity unit cell is not a good score lossy compression: rallying cry? backup vs archive metadata: what do we really know?

Brief Summary this is a lot of work. who is going to pay for it?

backblaze.com “pod” server backblaze.com offers “unlimited storage” data backup for $5/month.

backblaze offers “unlimited storage” data backup for $5/month.

backblaze does not sell these “pods”, but “protocase.com” will.

compresses 4.2x

compresses 337x

compresses 5x, but only one per dataset!

compresses 3.5x

compressed ~50x

compresses 5.2x

Lossy compression vs R/R free R factor compression ratio