Presentation is loading. Please wait.

Presentation is loading. Please wait.

Measurement Methodology Proposal based on Approved Framework

Similar presentations


Presentation on theme: "Measurement Methodology Proposal based on Approved Framework"— Presentation transcript:

1 Measurement Methodology Proposal based on Approved Framework
October 2004 Measurement Methodology Proposal based on Approved Framework October 2004 Fahd Pirzada, Pratik Mehta <Dell> Paul Canaan <Intel> Amer Hassan <Microsoft> Dell

2 Abstract Background and Scope Proposal for Measurement Methodology
September 2004 doc.: IEEE /1009 October 2004 Abstract Background and Scope Proposal for Measurement Methodology Next Steps Dell Pratik Mehta (Dell), et al

3 Proposed Timeline for TGt
October 2004 Proposed Timeline for TGt Metrics/Sub-metrics, Methodology development Framework Adoption Pre-Berlin 9thSep’04 Framework Adoption Report In Berlin Sep’04 Usage Case #1 Nov’04 Usage Case #2 Usage Case #3 Jan’05 Letter Ballot Mar’05 Dell

4 October 2004 Scope This proposal is for Usage Case #1 – Data-oriented usages… IS IS NOT An effort to describe a methodology that conforms to the framework approved in Berlin. Designed to address issues outside the approved TGT framework. An effort to measure performance as observed in various deployment scenarios. Designed to provide functional or compliance tests for WLAN components. A discussion of metrics and sub-metrics that can be measured. A designation of acceptable performance for various metrics and sub-metrics. A discussion of the methodology to measure and analyze performance. Dell

5 Partitioning Approach for Usage Case #1
October 2004 Usage + Environment  Metrics  Methodology  … Partitioning Approach for Usage Case #1 Case1: C 1. Data Oriented Applications + Home, Corporate Environment Approved as part of TGT focus from Berlin Meeting Chariot Throughput + Indoor, Chamber Environment Metrics: Throughput, Range, Directionality Sub-Metrics Path loss, EVM measurements, Interference, Multipath, Noise, SNR, Receive sensitivity, Transmit power Methodology: ? Case1: B Web Downloads + Indoor Environment Metrics: Latency, Throughput, Range Sub-Metrics Path loss, EVM measurements, Interference, Multipath, Noise, SNR, Receive sensitivity, Transmit power Methodology: ? Case1: A File transfer, File sharing + Indoor Environment Metrics: Throughput, Range Sub-Metrics Path loss, EVM measurements, Interference, Multipath, Noise, SNR, Receive sensitivity, Transmit power Methodology: ? Dell

6 Case1: A – File Transfer + Indoor Environment
October 2004 Case1: A – File Transfer + Indoor Environment Metrics: Throughput (Mbps), Range (meters/feet) Sub-Metrics: SNR, Walls (material, number) Methodology: Equipment and Setup Single AP to single client (methodology for both APs and STAs) Turn table (for averaging over orientations) Minimal adjacent or co-channel interference Measurement Steps Timed file transfers: Upload and download Line of sight and Non-LOS Output to template Described on next page Concerns: Repeatability Dell

7 Case1: A – File Transfer + Indoor Environment
October 2004 Case1: A – File Transfer + Indoor Environment Output to template Range Upload Download LOS/NLOS If NLOS Throughput No. of Walls Material Run 1 1 m x Mbps LOS y Mbps z Mbps Run 2 Throughput Range Measurement Equipment & Setup Wireless Access Point Device under Test File Server Upload Obstruction (if any) Download Turn Table x meters y meters Dell

8 Case1: B – Web downloads + Indoor Environment
October 2004 Case1: B – Web downloads + Indoor Environment Upon further study, this can be collapsed onto Case-1A Dell

9 Case1: C – Throughput + Indoor, Chamber
October 2004 Case1: C – Throughput + Indoor, Chamber Over-the-air Testing Metrics: Throughput (Mbps), Range(dB) Sub-Metrics: EVM Measurements Interference, Multipath, Noise, SNR Total Isotropic Sensitivity, Total Radiated Power at various data rates (Foegelle) FRMOL (Forwarding rate under max. offered load) (Mandeville) MSDU loss rate (MAC service data unit) (Mandeville) Methodology: Equipment and Setup Foegelle - IEEE /675r1 Measurement Steps Output to template Dell

10 Case1: C – Throughput + Indoor, Chamber
October 2004 Case1: C – Throughput + Indoor, Chamber Conducted Testing + Antenna Radiation Pattern Metrics: Throughput (Mbps), Range(dB) Sub-Metrics: All the metrics mentioned on last slide + ARP Methodology: Equipment and Setup Measurement Steps Output to template Reference: Charles Wright et al /1157 Concerns: Multiple APs and impact on clients (roaming/switching/load balancing) Dell

11 Analysis & Correlation: Usage Case #1
October 2004 Analysis & Correlation: Usage Case #1 Case1: C 1. Data Oriented Applications + Home, Corporate Environment Throughput + Chamber Environment Case1: B Web Downloads + Indoor Environment MAC/ PHY Characteristics Case1: A Throughput + Indoor Environment Analysis & Validation Application layer characteristics Correlation Propagation models: Attenuation + Interference (multipath, fading etc.) = Range PHY Layer: Receiver Sensitivity + Antenna Radiation Pattern = Range MAC Layer: Forwarding Rate + Loss = Throughput …... Dell

12 Case1: D – Battery Usage + Indoor Environment
October 2004 Case1: D – Battery Usage + Indoor Environment Methodology for Battery-operated devices Metrics: Battery Life, Response Time Sub-Metrics: Power draw (mW), Throughput Methodology: Equipment and Setup Single AP to single client Minimal adjacent or co-channel interference Data + Multimedia workload downloaded to web browser application Measurement Steps Response Time (Latency) of workload on client Battery life at the end of run Output to template Concerns: Relationship of WLAN sub-system power draw with system battery life Dell

13 Partitioning Approach for Usage Case #2
October 2004 Partitioning Approach for Usage Case #2 Case2: C 2. Streaming Media Apps + Home, Corporate Environment AV streaming + Controlled Environment Metrics: Frames dropped, Image quality, Range. Sub-Metrics Multipath, Noise, SNR, Forwarding rate, loss rate. Methodology: ? Case2: B Multiple AV streams + Indoor Environment Metrics: Frames dropped, Image quality, Range, Bandwidth utilization. Sub-Metrics Interference, Multipath, Noise, SNR, Throughput Methodology: ? Case2: A SDTV/HDTV quality streaming + Indoor Environment Metrics: Frames dropped, Image quality, Range Sub-Metrics Interference, Multipath, Noise, SNR. Methodology: ? Dell

14 October 2004 Next Steps Get agreement on the methodology for Usage Case #1 based on the approved framework Align and approve in San Antonio meeting in TGT Develop the Usage Cases #2 and #3 further Sanitize and update the metrics and sub-metrics Hone in on the Methodology components, test environment, procedure, etc. Finalizing the test case templates for reporting and analysis Draft recommended practices specification Include definitions and terminology Dell

15 October 2004 Backup Dell

16 Parking Lot for Metrics and Sub-metrics
October 2004 Parking Lot for Metrics and Sub-metrics Proposing a “parking-lot” list of parameters – determine whether they are metrics or sub-metrics, or part of the methodology, and which of the usage cases they apply to … Performance metrics by OSI model layers Application Transport Data Link Physical Layer Dell


Download ppt "Measurement Methodology Proposal based on Approved Framework"

Similar presentations


Ads by Google