Field Validation Techniques Paul Fanner

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Overview What is validation? Why is it important? Validation Techniques System input meters Revenue meters –Accuracy –Stopped meters Data handling errors –Meter reading –Billing processes Unmetered consumption –Billed –Unbilled Unauthorized consumption

IDB NRW Workshop, Georgetown, Guyana 19th-21st May New Providence Water Balance With Error Margins

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Range of New Providence Performance Indicators After Validation

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Trinidad PI’s Before Validation

IDB NRW Workshop, Georgetown, Guyana 19th-21st May % Confidence Limits of Trinidad Real Losses Before Validation

IDB NRW Workshop, Georgetown, Guyana 19th-21st May % Confidence Limits of Trinidad Real Losses After Validation

IDB NRW Workshop, Georgetown, Guyana 19th-21st May System Input Volumes

IDB NRW Workshop, Georgetown, Guyana 19th-21st May System Input Meters Large diameter, expensive Installed when plant was constructed Often hard to find manufacturer’s specifications Not designed to be flow validated Rarely, if ever, flow validated But regular calibration of electronics normal Output often fed to SCADA Reported volumes often taken from SCADA SCADA systems can introduce errors in data Many different technologies: Electro-magnetic, Ultrasonic, Venturi, Dall tube, Orifice plate, Insertion meters, Vortex shedding, Turbine, Propeller etc. Errors in the accuracy of these meters result in much larger errors in estimates of real loss volumes Particularly if small number of inputs

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Large System Input Meter

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Factors Affecting Accuracy Changes to meter geometry Corrosion Corrosion products Other Deposits Debris Mechanical wear Installation problems Pipework configuration Alignment Not running full Signal processing Square root extraction Calibration factors Span errors

IDB NRW Workshop, Georgetown, Guyana 19th-21st May System Input Meter Validation Options Test in-situ! Volumetric tests – by far the best option, if practical Drawing down upstream tank / clear well Filling downstream tank Mass balances – useful first step If multiple sets of meters Test meter in series Insertion meter – better than ultrasonic –Insertion mag or turbine meter Clamp-on ultrasonic meter – least preferable option But be aware of potential swirl problems Portable test rig (small meters only)

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Swirl in a Long Straight Pipe Source: Dr. Richard Furness, 2008

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Common Issues Test across normal operating range of meter 3 flow rates, if operationally possible Record local (and remote) integrator readings at start and end of each test Log meter output (4-20mA / pulse) from primary sensor Obtain data for period of test from SCADA Calculate error range of test If meter is found to have a systematic error Correct system input volumes for error

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Data Chain Analysis Does the SCADA system read the same as the primary and secondary device?

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Volumetric Test Requires tank large enough to provide test accuracy required Must be able to isolate tank for period of test Requires accurate measurement of tank dimensions and water depth Ultrasonic or high accuracy pressure transducer level gauge Conduct static test on tank to check for leakage / valves passing

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Comparative Volume Test Understand the resolution we can measure to 1mm =? volume

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Mass Balances – Multiple Meters Typical meters Raw water meters Treatment process meters Production / system input meters Bulk purchases – dual meters Waste lines not normally metered Requires temporary metering for period of evaluation Insertion meter or ultrasonic If inconsistencies found, other tests required.

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Insertion Meters Do not put meters within 50D of pumps, fittings or bends Above DN600, distances should double Above DN1200 add additional lengths Be careful with probes: must have 2 plane data or a minimum of two pairs of ultrasonic meters above DN1200 Always determine velocity profile Undertake test with insertion meter at pipe centreline

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Tests using ABB Aquaprobe

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Velocity Profiling

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Velocity Profile

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Clamp-on Ultrasonic Meters Do not put meters within 50D of pumps, fittings or bends Above DN600, distances should double Above DN1200 add additional lengths Be careful to use a minimum of two pairs of ultrasonic meters above DN1200 Always measure pipewall thickness using ultrasonic tool Always use silicon grease to ensure good contact

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Clamp-on Ultrasonic Meter

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Revenue Meter Inaccuracies

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Small Revenue Meters Up to 25mm (1”) If regular random samples are removed for testing (recommended), analyze test data Otherwise select totally random sample of meters meters Either test in-situ or remove and replace and test on meter test bench. Test at 3 specified flow rates (AWWA M6) or 4 flow rates (ISO 4064) Ideally also log meters for use profiles to calculate average efficiency result from tests (very important with storage tanks)..Or use M6 recommended weightings (15/70/15% of time, 2.0/63.8/34.2% of volume) Determine average meter under-registration of small meters

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Hopefully Your Meters are Better!

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Medium and Large Revenue Meters Over 25mm (1”) If regular meter tests are undertaken (recommended), analyze test data Otherwise select totally random sample of meters 50 + meters Test in-situ using a portable or mobile test rig May require installation of test tappings and valves Test at 3 specified flow rates (AWWA M6) or 4 flow rates (ISO 4064) Ideally also log meters for use profiles to calculate average efficiency result from tests..Or use M6 recommended weightings (15/70/15% of time, 2.0/63.8/34.2% of volume) Determine average meter under-registration

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Testing Large Customer Meters With Portable Test Unit

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Data Handling Errors

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Data Handling Errors – Meter Reading Examine meter reading and checking processes How is data collected? What scope for manual errors –Validation and high / low / zero consumption checks Is there scope for “café” meter reading? Is there scope for meter reading fraud? How are readings transferred to billing system? What validation checks are run in the billing system? What follow-up is done with exception reports? What follow-up is done with meter reading error codes? How are zero consumptions checked? Check a sample of readings through these processes

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Review Meter Reading Process

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Data Handling Errors – Billing Processes How good is customer cadastral? Are customers located on GIS? How are estimates calculated? How are over-estimates reversed? What happens to consumption data when bills are adjusted? Customer complaints Leakage allowances Etc. How does the system manage meters “going round the clock” What happens to consumption of accounts that aren’t billed?

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Billing Extract Take full extract of data re. meter reading, meter, consumption, customer information, customer class, flags for estimated, no bill etc. Year of study, plus meter reading interval either side, based on meter reading date Check samples of records to confirm correct operation of processes Determine consumption by month from data, based on meter reading date. Apply reversals! Compare with reported consumption Adjust for meter reading lag time Evaluate average number of months for stopped meters Identify any systematic errors

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Check Against Reported Consumption Volumes

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Adjust for Meter Reading Lag Time

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Unauthorized Consumption (Fraud)

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Identify Key Types of Fraud Regular connection mis-coded Inactive connection reactivated Bypassed meter Tampered meter Illegal connection (urban and rural) Illegal use of hydrants or fill points for tankers Illegal use of fire lines Illegal use of new connections for construction water Others?

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Where there is power consumption there is usually water consumption…

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Illegal Connections (and poor materials!)

IDB NRW Workshop, Georgetown, Guyana 19th-21st May By-passed Meter The daily newspaper is used to prove the date the fraud was located

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Water Meter Tampered

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Water Meter Tampered

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Water Meter Seal Broken

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Tankers Often Fill in an Unauthorized Manner

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Unauthorized Hydrant Use

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Illegal Connections in Rural Areas

IDB NRW Workshop, Georgetown, Guyana 19th-21st May How to Identify Fraud? Cross reference power consumption with water consumption records Cross reference municipal land use records with water consumption records and rate types Plot active and inactive connections onto municipal parcels identify parcels with no apparent connection Utilize GIS and aerial photos or Google earth to have a first look Random field investigations to identify frequency Estimate number and frequency of tankers filling up at hydrants Road cleaning? Sewer and storm drain flushing? Water trucking? Others?

IDB NRW Workshop, Georgetown, Guyana 19th-21st May

IDB NRW Workshop, Georgetown, Guyana 19th-21st May February/07 Unidade de Negócio Centro – MC Estimation of volumes lost through fraud

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Mooca: 0.98% of the test sample had fraudulent activity Paulista: 0.65% of the test sample had fraudulent activity Jardim Sao Pedro: 4% of the test sample had fraudulent activity Simple average: 1.6% 1% adopted due to consensus of group Results from random inspections of active connections in three test zones

IDB NRW Workshop, Georgetown, Guyana 19th-21st May ) Active connections: 1% of active connections assumed to be fraudulent Category Nº of active connections 1% Recovery (m3/month) Estimated Volume (m3/month) Residencial 540,3075, , Comercial 123,7771, , Industrial 15, , Mixed 14, , Public 1, TOTAL 695,3766,940334,397 Estimate of volume lost for water balance

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Estimate of volume lost for water balance Nº of inactive conections 2% Recovered volume (m3/month) Volume (m3/month) 56,2641, ,617 2) Inactive connections: 2% were re-activated 3) Theft from hydrants: 9.3% (study from September 2002) Nº of hydrants9.3% Volume per hydrant (m3/month) Volume (m3/month) 3, ,151

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Estimate of volume lost for water balance Total Estimated (1+2+3): 460,164 m3/month Average monthly supply volume 36,711,358 m3/month Fraud  1,3 % 1.5% of supply volume adopted

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Billed Unmetered Consumption

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Trinidad & Tobago Customers 2007 UnmeteredMetered Stand Pipes54,953 Yard Taps38,232 Domestic248,4383,811 Charitable Organisations1,63848 Industrial Commercial2,8324,480 Cottage2, Agricultural Total348,8059,794

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Problem For Water Loss Assessment! System Input Volume? Authorized Consumption? Revenue Water? Non Revenue Water?? Billed Authorized Consumption? Unbilled Authorized Consumption Apparent Losses Real Losses??? Water Losses? Billed Metered ConsumptionUnbilled Unmetered Consumption Unauthorized Consumption Customer Meter Inaccuracies and Data Handling Errors Leakage on Transmission and Distribution Mains Billed Unmetered Consumption?Unbilled Metered Consumption Leakage on Service Connections up to point of Customer Meter Leakage and Overflows at Storage Tanks

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Trinidad Unvalidated Water Loss Assessment Performance IndicatorBest Estimate 95% Confidence Limit +/-% Lowest Estimate Highest Estimate NRW as % of System Input % NRW % of System Input by Value % Apparent Losses % of Water Supplied % Real Losses litres/connection/day 1, %5921,981 Real Losses ILI %

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Methods for Estimating Unmeasured Consumption Issue addressed in UK UKWIR Best Practice Report (1999), Best Practice for Unmeasured Per Capita Consumption Monitors Tynemarch Engineering (2007), Leakage Methodology Review: Variation in Per Capita Consumption Estimates, Final Report for Quinquepartite Group Small area consumption monitors Individual consumption monitors

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Comparison of Methods Individual Monitor Install meters on sample of customers But difficult to obtain representative sample Not charged on meter But presence of meter could still influence consumption Not influenced by distribution leakage Small Area Monitor Install meters feeding small representative areas of customers But difficult to obtain representative sample Growth of metering Must remove all leakage in area Background losses Cannot influence consumption

IDB NRW Workshop, Georgetown, Guyana 19th-21st May T&T Consumption Monitor Small area monitors not feasible Leak detection very difficult in intermittent supply areas Individual consumption monitors selected But intermittent supplies – air discharged through service lines Register air volumes Meter damage Smartmeter selected Data logged Tank overflows Consumption patterns Random sample of 270 unmeasured residential customers planned 95% confidence limit +/-5%

IDB NRW Workshop, Georgetown, Guyana 19th-21st May T&T Consumption Monitor Results Meters installed and read by WASA 200 meters installed within the project time frame Useable readings from 166 meters 95% confidence limit of +/-7.6% Data from 18/9/2008 and 12/2/2009 Spanning part rainy season / part dry season Believed to be representative But monitoring continuing Average consumption 1.29 m3/connection/day Occupancy rate 3.67 Per capita 351 litres/capita/day (lpcd)

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Estimating Other Unmeasured Consumption Classes Previous JICA study Stand pipes 36 lpcd Yard taps 305 lpcd Others based on corresponding metered consumption class Assumed that the meters installed included highest consumption users Based on lower 90%

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Trinidad Draft Water Loss Assessment Performance IndicatorBest Estimate 95% Confidence Limit +/-% Lowest Estimate Highest Estimate NRW as % of System Input % NRW % of System Input by Value % Apparent Losses % of Water Supplied % Real Losses litres/connection/day 1, %1,3521,734 Real Losses ILI %

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Impact of Scheduling in Trinidad Volume of real losses (102,005.8 Ml/year) is constrained by scheduling (intermittent supply) If there were sufficient water resource available to supply all customers 24/7 Government plans 5 new RO plants (360 Mld) Volume of real losses would increase to 191,380.5 Ml/year, an increase of 89,374.9 Ml/year (245 Mld) …But of course there is enough water to meet demand – by efficiently managing water losses!

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Scope of Water Efficiency Survey Telephone survey of 425 randomly selected unmetered residential customers In-house audit of 270 properties selected from the telephone survey (188 actually undertaken) Analysis of scope for efficiency improvements

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Water Efficiency Survey Findings Toilets 10.4 litres per flush – scope to reduce Showerheads 5.2 litres per minute – low Taps – litres per minute – low Laundry – 82% top loading machines – scope to reduce Dishwashing – only 2% had machines. 54% households wash in running water – average 15 litres/person/day – scope to reduce to 7 Leakage – 7 litres/person/day – mainly from taps and showers – scope to reduce Outdoor use – minimal 2 litres/person/day – low Storage Tanks – 83% households have tanks. 7% overflowing. 27% have no level control – scope to reduce!

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Water Efficiency Survey Results

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Unbilled Unmetered Consumption

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Typical Types of Unbilled Unmetered Consumption Fire fighting Fire training Unmetered fire lines Fire sprinkler tests Fire flow tests Mains chlorination / flushing / testing Reservoir emptying / cleaning Water quality flushing Community gardens / parks Etc.

IDB NRW Workshop, Georgetown, Guyana 19th-21st May Estimating Unbilled Unmetered Volumes Build up from estimates of individual use events Temporary metering to obtain estimates Good news – small component of water balance ~1.25% of system input +/- 100% So not worth spending too much time on

IDB NRW Workshop, Georgetown, Guyana 19th-21st May To Conclude: All that I have covered may be required To determine a water balance with a low margin of error However the most important thing it to get started! A totally unvalidated balance With honest assessments of margins of error Will help win support for validation work Will highlight where work is most important to reduce the margins of error Tackle the most important issues first Margins of error will quickly reduce

Thank You - Any Questions?