1. PARAMETER OPTIMIZATION

2. ANALYSIS and SUPPORT TOOLS Currently Available Statistical and Graphical Analyses Rosenbrock Optimization Troutman Sensitivity Analysis Beta Testing Shuffle Complex Evolution Optimization Multi-Objective Generalized Sensitivity Analysis (MOGSA) Multi-Objective COMplex Evolution Algorithm (MOCOM) Generalized Likelihood Uncertainty Estimation (GLUE)

3. PARAMETER ESTIMATION (CALIBRATION) STRATEGY LEVELS Estimate all parameters from digital databases (GIS Weasel) and other regional relations Adjust ET parameter to match potential ET for area or region Apply XYZ method for precipitation and temperature distribution Calibrate parameters for hydrograph timing Calibrate all sensitive parameters

4. Optimization: Distributed Parameter Fitting Assume parameter values are spatially correct assume relative magnitudes of parameter values are correct Can fit all values of one parameter or subsets of a parameter All values of set or subset are moved in the same direction at the same time Values are moved either by the same fixed increment or as a percentage of their magnitude

5. MODEL CALIBRATION LIMITATIONS Ungauged basins (streamflow, meteorological data) Land-use change Climate change Over-parameterization Parameter equifinality

6. Rosenbrock Optimization Objective Functions | O i - P i | i  ( O i - P i ) 2 i  | ln(O i + 1) - ln( P i + 1) | i  ( ln(O i + 1) - ln( P i + 1) ) 2 i 

7. Multi-Objective COMplex Evolution Algorithm (MOCOM)

8. Pareto Optimality Pareto Solutions

9. Multi-Criteria Optimization X1X1 X2X2 X3X3 M(θ) Y 1 (θ) Y 2 (θ) Y 2 obs Y 1 obs F 2 (θ) F 1 (θ) + - + -   F 2 (θ) θ1θ1 θ2θ2 Pareto Solutions

10. Multi-Objective Uncertainty

11. Automatic Multicriteria Approach I.Identify several characteristic features each representing unique behavior of the watershed. II.Develop objective measures of the “closeness” of the model output to these features. III.Simultaneously minimize all of these measures with an optimization routine (MOCOM-UA).

12. Identifying Characteristic Behavior

13. Developing Objective Measures peaks/timing baseflow quick recession

14. Testing of Automatic Multicriteria Approach with SAC-SMA model Leaf River Watershed (1950 km 2 ) 11 years daily calibration data

15. MC: 500 Pareto Solutions

16. SAC-SMA Hydrograph Range

17. PARAMETER ESTIMATION and SENSITIVITY ANALYSIS

18. Objective Functions (measures of performance) | O i - P i | i  ( O i - P i ) 2 i  | ln(O i + 1) - ln( P i + 1) | i  ( ln(O i + 1) - ln( P i + 1) ) 2 i 

19. PRMS Sensitivity Analysis Sensitivity Matrix (relative sensitivity) Information Matrix Error Propagation Table –(5, 10, 20, 50% change in parameter value) Joint & Individual Standard Errors in Parameters –(measure of confidence) Correlation Matrix Hat Matrix –(diagonal elements are measure of influence a day is having on optimization, range 0-1)

20. Relative Sensitivity S R = ( Q PRED / P I ) * (P I / Q PRED ) 

26. Generalized Likelihood Uncertainty Estimation -- GLUE a methodology based on Monte Carlo simulation for estimating the predictive uncertainty associated with models

27. DOTTY PLOTS

28. Solar Radiation Transmission Coefficient (rad_trncf) vs Cover Density

29. Uncalibrated Estimate Parameter Equifinality (deg F) (inches) RockiesSierrasCascades

30. soil_moist_maxrad_trncf Objective Function Weasel Value Parameter Sensitivity and Weasel Determined Value Animas River (Rockies)

31. soil_moist_max rad_trncf Parameter Sensitivity and Weasel Determined Value EF Carson River (Sierras) Objective Function Weasel Value

32. soil_moist_maxrad_trncf Parameter Sensitivity and Weasel Determined Value CleElum River (Cascades) Objective Function Weasel Value

33. Multi-Objective Generalized Sensitivity Analysis (MOGSA)

34. Identifying Characteristic Behavior

35. Developing Objective Measures peaks/timing baseflow quick recession

36. MC: 500 Pareto Solutions

37. Parameter Sensitivity by Objective Function

39. 93