Human Growth: From data to functions

Slides:



Advertisements
Similar presentations
What Could We Do better? Alternative Statistical Methods Jim Crooks and Xingye Qiao.
Advertisements

Week 10 Generalised functions, or distributions
Lecture 15 Orthogonal Functions Fourier Series. LGA mean daily temperature time series is there a global warming signal?
Ch11 Curve Fitting Dr. Deshi Ye
Introduction to Smoothing Splines
Data mining and statistical learning - lecture 6
MATH 685/ CSI 700/ OR 682 Lecture Notes
Selected from presentations by Jim Ramsay, McGill University, Hongliang Fei, and Brian Quanz Basis Basics.
Basis Expansion and Regularization Presenter: Hongliang Fei Brian Quanz Brian Quanz Date: July 03, 2008.
1 Curve-Fitting Spline Interpolation. 2 Curve Fitting Regression Linear Regression Polynomial Regression Multiple Linear Regression Non-linear Regression.
1Notes  Assignment 0 is due today!  To get better feel for splines, play with formulas in MATLAB!
An Introduction to Functional Data Analysis Jim Ramsay McGill University.
An Introduction to Functional Data Analysis Jim Ramsay McGill University.
Jim Ramsay McGill University Basis Basics. Overview  What are basis functions?  What properties should they have?  How are they usually constructed?
1cs426-winter-2008 Notes  Ian Mitchell is running a MATLAB tutorial, Tuesday January 15, 5pm-7pm, DMP 110 We won’t be directly using MATLAB in this course,
Lecture 3: Integration. Integration of discrete functions
Curve-Fitting Regression
Statistics.
Human Growth: From data to functions. Challenges to measuring growth We need repeated and regular access to subjects for up to 20 years. We need repeated.
Chapter 11 Multiple Regression.
Lecture 9 Interpolation and Splines. Lingo Interpolation – filling in gaps in data Find a function f(x) that 1) goes through all your data points 2) does.
Human Growth: From data to functions. Challenges to measuring growth We need repeated and regular access to subjects for up to 20 years. We need repeated.
Calculus With Tech I Instructor: Dr. Chekad Sarami.
1 Chapter 8 The Discrete Fourier Transform 2 Introduction  In Chapters 2 and 3 we discussed the representation of sequences and LTI systems in terms.
Physics 114: Lecture 15 Probability Tests & Linear Fitting Dale E. Gary NJIT Physics Department.
Time-Series Analysis and Forecasting – Part V To read at home.
Section Copyright © 2014, 2012, 2010 Pearson Education, Inc. Lecture Slides Elementary Statistics Twelfth Edition and the Triola Statistics Series.
V. Space Curves Types of curves Explicit Implicit Parametric.
Physics 114: Exam 2 Review Lectures 11-16
Today’s class Spline Interpolation Quadratic Spline Cubic Spline Fourier Approximation Numerical Methods Lecture 21 Prof. Jinbo Bi CSE, UConn 1.
Splines Vida Movahedi January 2007.
Curve-Fitting Regression
BIOSYST-MeBioSwww.biw.kuleuven.be The potential of Functional Data Analysis for Chemometrics Dirk De Becker, Wouter Saeys, Bart De Ketelaere and Paul Darius.
Boyce/DiPrima 9 th ed, Ch 3.2: Fundamental Solutions of Linear Homogeneous Equations Elementary Differential Equations and Boundary Value Problems, 9 th.
In this section, we will consider the derivative function rather than just at a point. We also begin looking at some of the basic derivative rules.
Splines IV – B-spline Curves based on: Michael Gleicher: Curves, chapter 15 in Fundamentals of Computer Graphics, 3 rd ed. (Shirley & Marschner) Slides.
Basis Expansions and Generalized Additive Models Basis expansion Piecewise polynomials Splines Generalized Additive Model MARS.
LECTURE 17: BEYOND LINEARITY PT. 2 March 30, 2016 SDS 293 Machine Learning.
Interpolation - Introduction
APPLICATIONS OF DIFFERENTIATION Antiderivatives In this section, we will learn about: Antiderivatives and how they are useful in solving certain.
1 CHAP 3 WEIGHTED RESIDUAL AND ENERGY METHOD FOR 1D PROBLEMS FINITE ELEMENT ANALYSIS AND DESIGN Nam-Ho Kim.
Lecture Slides Elementary Statistics Twelfth Edition
Physics 114: Lecture 13 Probability Tests & Linear Fitting
Chapter 7. Classification and Prediction
Precalculus V. J. Motto Polynomial Functions – Part One
Part 7 - Chapter 25.
Curve-Fitting Spline Interpolation
Polynomial + Fast Fourier Transform
Copyright © Cengage Learning. All rights reserved.
10701 / Machine Learning.
d-Fold Hermite-Gauss Quadrature and Computation of Special Functions
Physics 114: Exam 2 Review Material from Weeks 7-11
Lecture Slides Elementary Statistics Thirteenth Edition
© University of Wisconsin, CS559 Spring 2004
Modelling data and curve fitting
The Curve Merger (Dvir & Widgerson, 2008)
Discrete Event Simulation - 4
Part 7 - Chapter 25.
Fundamentals of Electric Circuits Chapter 18
The Fundamental Theorem of Calculus
Support Vector Machines
Basis Expansions and Generalized Additive Models (2)
Basis Expansions and Generalized Additive Models (1)
9.5 Least-Squares Digital Filters
SKTN 2393 Numerical Methods for Nuclear Engineers
Introduction to Parametric Curve and Surface Modeling
SKTN 2393 Numerical Methods for Nuclear Engineers
Differentiation and the Derivative
Continuous Random Variables: Basics
Presentation transcript:

Human Growth: From data to functions

Challenges to measuring growth We need repeated and regular access to subjects for up to 20 years. Height changes over the day, and must be measured at a fixed time. Height is measured in supine position in infancy, followed by standing height. The change involves an adjustment of about 1 cm. Measurement error is about 0.5 cm in later years, but is rather larger in infancy.

Challenges to functional modeling We want smooth curves that fit the data as well as is reasonable. We will want to look at velocity and acceleration, so we want to differentiate twice and still be smooth. In principle the curves should be monotone; i. e., have a positive derivative.

The monotonicity problem The tibia of a newborn measured daily shows us that over the short term growth takes places in spurts. This baby’s tibia grows as fast as 2 mm/day! How can we fit a smooth monotone function?

Weighted sums of basis functions We need a flexible method for constructing curves to fit the data. We begin with a set of basic functional building blocks φk(t), called basis functions. Our fitting function x(t) is a weighted sum of these:

What are the main choices for basis functions? Fourier series: a constant term, a sine/cosine pair of fixed frequency, and followed by a series of sine/cosine pairs with integer multiples of the base frequency. Fourier series are best for periodic data.

Five Fourier basis functions

B-splines These basis functions are piecewise polynomials defined by a set of discrete values called knots. The order of the polynomials (degree + 1) controls their smoothness. Each basis function is nonzero only over a number of contiguous inter-knot intervals equal to the order. Polynomials are a special type of B-spline, and are thus included within the system.

When should I use B-splines? B-splines are the basis of choice for most non-periodic. They give complete control over flexibility, allowing more flexibility where needed and less where not needed. Computing with B-splines is extremely efficient.

Five order 2 B-spline basis functions: A basis for polygonal lines

Eight order 4 B-spline basis functions A basis for twice-differentiable functions

B-splines for growth data We use order 6 B-splines because we want to differentiate the result at least twice. Order 4 splines look smooth, but their second derivatives are rough. We place a knot at each of the 31 ages. The total number of basis functions = order + number of interior knots. 35 in this case.

Isn’t using 35 basis functions to fit 31 observations a problem? Yes. We will fit each observation exactly. This will ignore the fact that the measurement error is typically about 0.5 cm. But we’ll fix this up later, when we look at roughness penalties.

Okay, let’s see what happens These two Matlab commands define the basis and fit the data: hgtbasis = create_bspline_basis([1,18], 35, 6, age); hgtfd = data2fd(hgtfmat, age, hgtbasis);

Why we need to smooth Noise in the data has a huge impact on derivative estimates.

Please let me smooth the data! This command sets up 12 B-spline basis functions defined by equally spaced knots. This gives us about the right amount of fitting power given the error level. hgtbasis = create_bspline_basis([1,18], 12, 6);

These are velocities are much better. They go negative on the right, though.

Let’s see some accelerations These acceleration curves are too unstable at the ends. We need something better.

A measure of roughness What do we mean by “smooth”? A function that is smooth has limited curvature. Curvature depends on the second derivative. A straight line is completely smooth.

Total curvature We can measure the roughness of a function x(t) by integrating its squared second derivative. The second derivative notation is D2x(t).

Total curvature of acceleration Since we want acceleration to be smooth, we measure roughness at the level of acceleration:

The penalized least squares criterion We strike a compromise between fitting the data and keeping the fit smooth.

How does this control roughness? Smoothing parameter λ controls roughness. When λ = 0, only fitting the data matters. But as λ increases, we place more and more emphasis on penalizing roughness. As λ  ∞, only roughness matters, and functions having zero roughness are used.

We can either smooth at the data fitting step, or smooth a rough function. This Matlab command smooths the fit to the data obtained using knots at ages. The roughness of the fourth derivative is controlled. lambda = 0.01; hgtfd = smooth_fd(hgtfd, lambda, 4);

Accelerations using a roughness penalty These accelerations are much less variable at the extremes.

The corresponding velocities

How did you choose λ? This is inevitably involves judgment. We smooth just enough to obtain tolerable roughness in the estimated curves (accelerations in this case), but not so much as to lose interesting variation. There are data-driven methods for choosing λ, but they offer only a reasonable place to begin exploring.

What about monotonicity? The growth curves should be monotonic. The velocities should be non-negative. It’s hard to prevent linear combinations of anything from breaking the rules. We need an indirect approach to constructing a monotonic model

A differential equation for monotonicity Any strictly monotonic function x(t) must satisfy a simple linear differential equation: The reason is simple: because of strict monotonicity, the first derivative Dx(t) will never be 0, and function w(t) is therefore simply D2x(t)/Dx(t).

The solution of the differential equation Consequently, any strictly monotonic function x(t) must be expressible in the form This suggests that we transform the monotone smoothing problem into one of estimating function w(t), and constants β0 and β1.

What we have learned B-spline bases are a good choice for fitting non-periodic functions; Fourier series are right for periodic situations. We can control smoothness by either using a restricted number of basis functions, or by imposing a roughness penalty. Roughness penalty methods generally work better. Differential equations can play a useful role when fitting constrained functions to data.

More information Ramsay & Silverman (1997), Chs. 3, 4, 13 The long-term growth data are from the Berkeley growth study. The infant growth data were collected by Michael Hermanussen.