1. Rome Navigation Innovations 2/7/06 1 Show By Example How Evaluation of Data Performance in General Will Be Carried out Showcase Geometry Data Alignment Techniques as A Solution to Many Problems. Evaluation of Geometry Data Error Performance on A Geometry Car Using Geometry Data Alignment Techniques H. James Rome Rome Navigation Innovations,Inc 27 Old County Rd, Gloucester, MA 978-281-5623 James_Rome@uml.edu Purpose of the Presentation

2. Rome Navigation Innovations 2/7/06 2 Presentation Concentrates on a case Study: Comparison of “Alternate” and Standard Gage Example of Performance Analysis Investigate Repeatability and stability of two measures of gage.

3. Rome Navigation Innovations 2/7/06 3 What’s This Geometry Data Alignment Package? Lines up data from several runs to data on Reference Run. Can align data to an Accuracy ~ 1 ft Used For: –Trend Analysis –Repeatability and Error Analysis Example Follows

4. Rome Navigation Innovations 2/7/06 4 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 Left Profile Lined up with GPS to about 2 meters 3.783.7813.7823.7833.7843.7853.7863.7873.7883.7893.79 x 10 4 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 Distance along track, ftX10 4 -> Profile, Inch,-> -12-10-8-6-4-20 -0.8 -0.7 -0.6 -0.5 -0.4 -0.3 -0.2 -0.1 0 0.1 Plot.vs.time at ft location37825 time back from reference run, months -2 0 2 Profile, Inch,-> Example …Before Data Alignment:

5. Rome Navigation Innovations 2/7/06 5 25 26 Plots after Data Alignment up with With Package, 3.783.7813.7823.7833.7843.7853.7863.7873.7883.7893.79 x 10 4 -0.8 -0.6 -0.4 -0.2 0 0.2 0.4 0.6 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 Profile, Inch,-> Distance along track, ftX10 4 -> -12-10-8-6-4-20 -0.8 -0.7 -0.6 -0.5 -0.4 -0.3 -0.2 -0.1 Plot.vs.time at ft location37825 time back from reference run, months -2 0 2 Profile, Inch,-> Trend Apparent

6. Rome Navigation Innovations 2/7/06 6 Use of Alignment for Error Analysis Approach can be used to Evaluate Repeatability Errors. –If Data is Taken Close Enough in time, Differences in Aligned Data imply the sum of the errors in Both measurements.. examples follow

7. Rome Navigation Innovations 2/7/06 7 NOTE! This alignment can be carried out over 10’s or even 100’s of miles with the click of a mouse. Thus no need to constrain evaluations to a several thousand ft “Test Track”. Occasional rare events, long term error error trends, and Data Reliability can be evaluated.

8. Rome Navigation Innovations 2/7/06 8 Example Comparison of Alternate and Standard Gage Both Measures were available on the Same Car Two Runs over the same 70 mi of track were used for the Study Each Is Analyzed as if the other did not exist From an FRA Car ~ 2006

9. Rome Navigation Innovations 2/7/06 9 Snippet Aligned Alternate Gage, and Standard Gage Alternate Gage Standard Gage “Standard” Gage Is Noisier! 1000 Pt mean subracted

10. Rome Navigation Innovations 2/7/06 10 x X+1000 Take Difference of Two Curves Find Root Mean Square of Difference,RMS Plot RMS vs. X What We Do Next

11. Rome Navigation Innovations 2/7/06 11 0.511.522.533.5 x 10 5 0 0.02 0.04 0.06 0.08 0.1 0.12 0.14 0.16 0.18 0.2 plot of 1000 pt rms alt gage differences standard gage differences Plot of Running 1000 Pt. RMS differences vs. Distance for Both Gages RMS’s ~ 40 % Less for Alternate Gage RMS (Units) Record # along track 

12. Rome Navigation Innovations 2/7/06 12 Note There is usually a Calibration Error in Gage Measurement Is the Calibration Stable During the Run?

13. Rome Navigation Innovations 2/7/06 13 Sample of Gage Aligned with ( 1000 pt) Bias Removed the Bias Distance along track,ft Gage, Inches

14. Rome Navigation Innovations 2/7/06 14 Sample of Gage Aligned gage..NOTE here Bias is not removed! Is this “Bias” stable? Distance along track,ft Gage, Inches

15. Rome Navigation Innovations 2/7/06 15 0.511.522.533.5 x 10 5 0.05 0.1 0.15 0.2 0.25 0.3 0.35 plot of 1000 pt mean vs distance alt gage standard gage Plot of 1000 pt Mean difference of same Paramter: for Alternate and Standard Gages Vs. Distance Typical Max Shift… Standard,.1” Alternative:.06” Record # along track 

16. Rome Navigation Innovations 2/7/06 16 00.050.10.150.20.25 0 0.1 0.2 0.3 0.4 0.5 0.6 0.7 0.8 0.9 1 FRACTION ACTUAL DIFFERENCES LESS THAN X, mean subtrated alt gage standard gage From Histogram of All Differences, Find Cumulative Distribution Alternative Gage: 70% of error<.05’’ Standard Gage: ~ 70% of errors <.08’’ Error Limits, (Units)  X

17. Rome Navigation Innovations 2/7/06 17 00.050.10.150.20.25 0 0.05 0.1 0.15 0.2 0.25 0.3 0.35 hisotragm of 1000 pt. RMS differences, mean subtrated alt gage standard gage Histogram of 1000 pt RMS errors For Both Gages. Most Likely Value Alternative ~.055 Noise Floor Most Likely Value Standard ~.075 Noise Floor Fraction in Bin Bin Value , Linear Units Less than ½ # Outliers!

18. Rome Navigation Innovations 2/7/06 18 00.050.10.150.20.250.3 0 0.02 0.04 0.06 0.08 0.1 0.12 00.050.10.150.20.250.3 0 0.05 0.1 0.15 0.2 Period ~39 units Frequency, 1/( Unit record)  Frequency, 1/ (Unit Record)  Lots of High Frequency Noise. Power Spectra, vs Frquency from Both Gages Alternative Gage Standard Gage Note error power is about Double for Standard Gage

19. Rome Navigation Innovations 2/7/06 19 Conclusions Comparing Standard and Alternative Gages Alternative Gage has significantly: –Lower RMS errors –Fewer large Errors –More Bias Stability –Less high Frequency Noise Bottom Line: From the Point of View of Repeatability,Alternative Gage is Just Better!

20. Rome Navigation Innovations 2/7/06 20

21. Rome Navigation Innovations 2/7/06 21 NOTE! Most of this Quality Information could not be obtained from a short stretch of Data With Automated Data Alignment, No test track required. Track of Opportunity can be used Simply Run over same ( say 20-50 mile) length of track twice within a few days or weeks.

22. Rome Navigation Innovations 2/7/06 22 Other Uses Compare Results of GRMS Vehicles without having them Coordinate their Runs..and over a long distance. Compare Geometry measurement Equipment Find Fraction of time when there are data outages

23. Rome Navigation Innovations 2/7/06 23 What About Other Parameters The Key is the the ability to Align Massive amounts of Geometry car Data. It puts an Entirely new spin on how extensive and how inexpensive Quality Evaluation can be! Similar studies can be carried out on Any measurement taken on the Geometry car And That includes GPS