Presentation is loading. Please wait.

Presentation is loading. Please wait.

Framework, Usages, Metrics Proposal for TGT

Published byAmberlynn Hester Curtis Modified over 5 years ago

Similar presentations

Presentation on theme: "Framework, Usages, Metrics Proposal for TGT"— Presentation transcript:

1 Framework, Usages, Metrics Proposal for TGT
September 2004 Framework, Usages, Metrics Proposal for TGT September 8, 2004 Pratik Mehta, Fahd Pirzada – Dell Paul Canaan – Intel Amer Hassan, Don Berry – Microsoft Pratik Mehta (Dell), et al

2 Abstract Work progress to-date Framework, Usages, Metrics Proposal
September 2004 doc.: IEEE /1009 September 2004 Abstract Work progress to-date Framework, Usages, Metrics Proposal Next Steps Pratik Mehta (Dell), et al Pratik Mehta (Dell), et al

3 Excerpt from Nov 2003 Presentation – Schedule Plan
September 2004 Excerpt from Nov 2003 Presentation – Schedule Plan The milestones set out in Nov 2003 are on track … WPP/TGt have been meeting expectations … Work Plan / Timeline July 2003 Initial presentation to IEEE WNG committee. August 2003 Approved as study project by IEEE EMC Society SDCom Aug.-Nov. 2003 Conference calls surveying state-of-the-art & preparing for 2nd WNG presentation. Nov. 2003 Committee passes 40 participants, 27 orgs 2nd Presentation at WNG and request for approval as IEEE study project Presenter: Stephen Berger, Reference doc.: wng Pratik Mehta (Dell), et al

4 Excerpt from Nov 2003 Presentation – Schedule Plan
September 2004 Excerpt from Nov 2003 Presentation – Schedule Plan The milestones set out in Nov 2003 are on track … WPP/TGt have been meeting expectations … Work Plan / Timeline Nov.-Dec. 2003 Analysis of state-of-the-art Initial definition of tasks and deliverables Jan. 2004 1st direct meeting Feb.-June 2004 Development of study project report. Drafting of PAR & 5CRIT July 2004 Submission of PAR & 5CRIT Presentation of report March 2005 1st Letter Ballot Presenter: Stephen Berger, Reference doc.: wng Pratik Mehta (Dell), et al

5 Excerpt from Nov 2003 Presentation – Scope
September 2004 Excerpt from Nov 2003 Presentation – Scope WPP/TGt continues to focus on the scope set out in Nov 2003 … IS IS NOT Predicting coverage, throughput, directivity performance, latency, errors Measurements of radio component performance Asynchronous and isochronous channels Regulatory issues Measurement correlation, precision & repeatability Purely theoretical analysis Correlation to differing deployment scenarios Purely conducted tests Identify and comprehend the impact of variables like Antenna gain and pattern, radio specs, environmental and system noise, band crowding Designation of acceptable performance Presenter: Pratik Mehta, Reference doc.: wng Pratik Mehta (Dell), et al

6 Excerpt from Nov 2003 Presentation – Metrics
September 2004 Excerpt from Nov 2003 Presentation – Metrics WPP/TGt continues to discuss metrics highlighted in Nov 2003 by Broadcom… Deciding what parameters are to be considered is the challenge. How do we transform user perception of performance into a set of repeatably-measurable quantities? Throughput and Range Visibility of APs Delays in association Host CPU utilization Ability to roam without loss of connections Etc. Slides of that presentation delve further into metrics that are still relevant … … TGt can decide what makes sense … Presenter: Jason Trachewsky et al, Reference doc.: wng Pratik Mehta (Dell), et al

7 Excerpts from Presentations – Metrics
September 2004 Excerpts from Presentations – Metrics WPP/TGt continues to discuss usages and metrics, and make progress … Roaming is important to consider Roaming brings in many variables and causes that impact performance Presenter: Bob Mandeville, Reference doc.: wng More recent presentation on metrics by Bob … Maximum Forwarding Rate FWMOL (Fwd rate at max offered load) Frame Loss, Frame Loss Rate Latency Jitter Association Capacity, Association Rate Rate versus Range Presenter: Bob Mandeville, Reference doc.: wpp Pratik Mehta (Dell), et al

8 Excerpt from Recent WPP/TGt Presentation – Framework
September 2004 Excerpt from Recent WPP/TGt Presentation – Framework WPP/TGt has discussed the need for framework … below is as highlighted by Intel… Test Environment Come to consensus on environment types (NLOS, LOS, Conductive, etc) Develop a mechanism to characterize the environment Propose recommended practices for the environmental set up Metrics Define metrics relevant to characterize the environment Identify metrics that impact WLAN performance as well as corresponding methodology to obtain these metrics Devise a mechanism to predict the metric performance Test Case Template Come to consensus on the necessary metrics to characterize the environment that should be reported in a test template Define test case scenarios for each metric Determine recommended practice for reporting/analyzing of the results Usage Come to consensus on usage scenarios that represent the WLAN traffic pattern (file transfers, streaming media, connectivity, voice over IP, etc) Categorize which metrics have the greatest impact on the performance of those usage scenarios Presenter: Paul C. Canaan, Reference doc.: wpp Pratik Mehta (Dell), et al

9 Interim Summary TGt is focusing on the right approaches
September 2004 Interim Summary WPP/TGt has made good progress to date … continue to deliver … TGt is focusing on the right approaches TGt is also meeting deliveries that were highlighted 9 months ago TGt has the right constituencies and experts represented … In short, TGt is a healthy group, and can move forward and deliver There is a call for urgency in the short-term to address some key industry needs OEM needs during product development Reviewer/Publisher needs for product reviews Guidelines for system integrators The following slides provide a proposal to move forward Pratik Mehta (Dell), et al

10 Restatement of TGt Framework
September 2004 Restatement of TGt Framework Usage+Environment  Metrics  Methodology  Test Template …  Prediction Usage + Environment Metrics Sub-metrics Methodology Test Environment Test Procedure Test Template Use Measurements To Predict Pratik Mehta (Dell), et al

11 Definition of Terms in TGt Framework
September 2004 Usage+Environment  Metrics  Methodology  Test Template …  Prediction Definition of Terms in TGt Framework Usage + Environment Usage and environment of end-user Metrics Sub-metrics Metrics are the key performance indicators as perceived by users – for the usages they employ in their environments (above) Sub-metrics are drivers of those metrics Sub-metrics help understand what affects the metrics Methodology Test Environment Test Procedure Test Template Methodology is the way to measure metrics and sub-metrics Test Environment is a model of the user’s environment Test Procedure is the set of steps to perform measurements Test Template is the content and format used to report the measurements Use Measurements To Predict Output from Methodology and Measurements are used to predict performance Pratik Mehta (Dell), et al

12 Proposal – Focus on three Cases
September 2004 Usage + Environment  Metrics  Methodology  … Proposal – Focus on three Cases 1. Data Oriented Applications + Home, Corporate Environment Metrics: Throughput, Range, Directionality Sub-metrics: Path loss, EVM measurements, Interference, Multipath, Noise, SNR, Receive sensitivity, Transmit power Methodology: Chariot scripts – Chamber, Indoor Web-downloads – Indoor File-Transfers, File-Sharing – Indoor Rotating tables 2. Streaming Media Apps + Home, Corporate Environment Metrics: All of 1, Frames dropped, Image quality Sub-Metrics: TCP Re-transmissions, Packet errors, Latency, AV synchronization, Control Channel (Gaming, Multicast), Image quality (Jitter, Blockiness, Blur), Bandwidth stability, Buffering (pre-roll buffer, jitter buffer) Methodology: Unicast, Multicast, Real-time streaming, Stored content, Decoder/Encoder characteristics, Network protocols (TCP, UDP), Buffering Number of streams, Apps: Bobsled, VideoLAN, Real server. 3. Latency Sensitive Apps + Home, Corporate Environment Metrics: All of 1, Latency, Jitter Sub-Metrics: MOS/PESQ, PSQM, One-way delay, Packet loss Methodology: Decoder/Encoder characteristics, Network protocols (H.323, P2P, SIP) Apps: Netmeeting, Skype, Vonage Each of these Usage cases will need to be partitioned … (next slide shows example for #1) Attributes common to all three usages to consider: No. of Clients; No. of APs; Stationary/Roaming; Encryption/Authentication Pratik Mehta (Dell), et al

13 Partitioning Approach for Usage Case #1
September 2004 Usage + Environment  Metrics  Methodology  … Partitioning Approach for Usage Case #1 1. Data Oriented Applications + Home, Corporate Environment Chariot Throughput + Indoor, Chamber Environment Metrics: Throughput, Range, Directionality Sub-Metrics Path loss, EVM measurements, Interference, Multipath, Noise, SNR, Receive sensitivity, Transmit power Methodology: ? Web Downloads + Indoor Environment Metrics: Latency, Throughput, Range Sub-Metrics Path loss, EVM measurements, Interference, Multipath, Noise, SNR, Receive sensitivity, Transmit power Methodology: ? File transfer, File sharing + Indoor Environment Metrics: Throughput, Range Sub-Metrics Path loss, EVM measurements, Interference, Multipath, Noise, SNR, Receive sensitivity, Transmit power Methodology: ? Pratik Mehta (Dell), et al

14 Similar Partitioning is needed for #2 and #3
September 2004 Similar Partitioning is needed for #2 and #3 To be filled out Pratik Mehta (Dell), et al

15 Proposed Timeline for TGt
September 2004 Proposed Timeline for TGt Metrics/Sub-metrics, Methodology development Framework Adoption Pre-Berlin 9thSep’04 Framework Adoption Report In Berlin Sep’04 Usage Case #1 Nov’04 Usage Case #2 Usage Case #3 Jan’05 Letter Ballot Mar’05 Pratik Mehta (Dell), et al

16 Next Steps Get agreement on the framework and approach
September 2004 Next Steps Get agreement on the framework and approach Get agreement that the three usage cases presented are the one we can focus on Align in Berlin meeting with wider audience in TG Develop the three usage cases further Sanitize and update the metrics and sub-metrics Hone in on the Methodology components, test environment, procedure, etc. Finalizing the test case templates for reporting and analysis Usable outputs for Usages #1, #2, #3 (see timeline) Draft recommended practices specification Include definitions and terminology Pratik Mehta (Dell), et al

17 September 2004 Backup Pratik Mehta (Dell), et al

18 Parking Lot for Metrics and Sub-metrics
September 2004 Parking Lot for Metrics and Sub-metrics Proposing a “parking-lot” list of parameters – determine whether they are metrics or sub-metrics, or part of the methodology, and which of the usage cases they apply to … Performance metrics by OSI model layers Application Transport Data Link Physical Layer Pratik Mehta (Dell), et al

Download ppt "Framework, Usages, Metrics Proposal for TGT"

Similar presentations

Doc.: IEEE 802.11-14/0604r1 Submission May 2014 Slide 1 Modeling and Evaluating Variable Bit rate Video Steaming for 802.11ax Date: 2014-05-12 Authors:

Doc.: IEEE /0604r1 Submission May 2014 Slide 1 Modeling and Evaluating Variable Bit rate Video Steaming for ax Date: Authors:
Doc.: IEEE 802.11-05/0177r0 Submission March 2005 Pratik Mehta - DellSlide 1 Dell IEEE 802.11 TGT Output Notice: This document has been prepared to assist.

Doc.: IEEE /0177r0 Submission March 2005 Pratik Mehta - DellSlide 1 Dell IEEE TGT Output Notice: This document has been prepared to assist.
Submission doc.: IEEE 802.11 11-04-0802-00-0wpp July 2004 Paul C. Canaan, Intel Corporation.Slide 1 Wireless Performance Prediction – Development Milestones.

Submission doc.: IEEE wpp July 2004 Paul C. Canaan, Intel Corporation.Slide 1 Wireless Performance Prediction – Development Milestones.
Doc.: IEEE 802.11-05/1109r1 Submission November 2005 Fanny Mlinarsky, et alSlide 1 Framework for Testing Latency Sensitive Use Cases Notice: This document.

Doc.: IEEE /1109r1 Submission November 2005 Fanny Mlinarsky, et alSlide 1 Framework for Testing Latency Sensitive Use Cases Notice: This document.
March 2005 Tom AlexanderSlide 1 IEEE 802.11T Tom Alexander VeriWave, Inc. March 2005.

March 2005 Tom AlexanderSlide 1 IEEE T Tom Alexander VeriWave, Inc. March 2005.
Doc.: IEEE 802.11-00/1202r1 Submission October 2004 C. Wright, Azimuth SystemsSlide 1 Proposed Metrics for TGT and Call to Action Date: Oct 21, 2004 Author:

Doc.: IEEE /1202r1 Submission October 2004 C. Wright, Azimuth SystemsSlide 1 Proposed Metrics for TGT and Call to Action Date: Oct 21, 2004 Author:
Doc.: IEEE 802.11-06/tbd Submission March/2006 Pertti Visuri, Airgain, Inc. Over the Air Testing - Comparing Systems with Different Antennas Notice: This.

Doc.: IEEE /tbd Submission March/2006 Pertti Visuri, Airgain, Inc. Over the Air Testing - Comparing Systems with Different Antennas Notice: This.
Doc.: IEEE 802.11-04-1222-r1-0000t Submission November 2004 DellSlide 1 Measurement Methodology Proposal based on Approved Framework Liam Quinn, Fahd Pirzada,

Doc.: IEEE r1-0000t Submission November 2004 DellSlide 1 Measurement Methodology Proposal based on Approved Framework Liam Quinn, Fahd Pirzada,
Doc.: IEEE 802.15-04/0175-00 Submission March 2004 Larry Taylor (Staccato)Slide 1 Project: IEEE P802.15 Working Group for Wireless Personal Area Networks.

Doc.: IEEE / Submission March 2004 Larry Taylor (Staccato)Slide 1 Project: IEEE P Working Group for Wireless Personal Area Networks.
Doc.: IEEE 802.11-04/213r0 Submission February 2004 C. Wright, Azimuth Systems WPP SG Telecon Agenda for 26 Feb 2004 Charles R. Wright Azimuth Systems.

Doc.: IEEE /213r0 Submission February 2004 C. Wright, Azimuth Systems WPP SG Telecon Agenda for 26 Feb 2004 Charles R. Wright Azimuth Systems.
Doc.: IEEE 11-04/0319r0 Submission March 2004 W. Steven Conner, Intel Corporation Slide 1 Architectural Considerations and Requirements for 802.11 ESS.

Doc.: IEEE 11-04/0319r0 Submission March 2004 W. Steven Conner, Intel Corporation Slide 1 Architectural Considerations and Requirements for ESS.
Doc.: 11-03-0617-00-0wng Submission - Study Project Proposal WPP – Simulating Field Performance Jerry Carr, News IQ Inc. Test LaboratorySlide 1 November.

Doc.: wng Submission - Study Project Proposal WPP – Simulating Field Performance Jerry Carr, News IQ Inc. Test LaboratorySlide 1 November.
Doc.: IEEE 802.11-05/0178r0 Submission March 2005 Fahd Pirzada - DellSlide 1 IEEE 802.11 TGT Streaming Media Apps Notice: This document has been prepared.

Doc.: IEEE /0178r0 Submission March 2005 Fahd Pirzada - DellSlide 1 IEEE TGT Streaming Media Apps Notice: This document has been prepared.
Doc.: IEEE 802.11-00/1131r1 Submission September 2004 Charles Wright, Azimuth SystemsSlide 1 A Metrics and Methodology Starting Point for TGT Date: Sept.

Doc.: IEEE /1131r1 Submission September 2004 Charles Wright, Azimuth SystemsSlide 1 A Metrics and Methodology Starting Point for TGT Date: Sept.
Framework, Usages, Metrics Proposal for TGt Pratik Mehta, Fahd Pirzada – Dell Paul Canaan – Intel Amer Hassan, Don Berry – Microsoft September 2004.

Framework, Usages, Metrics Proposal for TGt Pratik Mehta, Fahd Pirzada – Dell Paul Canaan – Intel Amer Hassan, Don Berry – Microsoft September 2004.
Doc.: IEEE 802.11-11/0341r2 Submission March 2011 MediaTek, Inc Slide 1 Usage Cases for 802.11ah Date: 2011-03-14 Authors:

Doc.: IEEE /0341r2 Submission March 2011 MediaTek, Inc Slide 1 Usage Cases for ah Date: Authors:
Doc.: IEEE 802.11-04/0091r1 Submission January 2004 Stephen Berger, TEM ConsultingSlide 1 IEEE 802.11 Wireless Performance Prediction (WPP) - Background.

Doc.: IEEE /0091r1 Submission January 2004 Stephen Berger, TEM ConsultingSlide 1 IEEE Wireless Performance Prediction (WPP) - Background.
Doc.: IEEE 802.11-05/0723r0 Submission July 2005 Fahd Pirzada - DellSlide 1 Data-oriented Usages Proposal for TGT Notice: This document has been prepared.

Doc.: IEEE /0723r0 Submission July 2005 Fahd Pirzada - DellSlide 1 Data-oriented Usages Proposal for TGT Notice: This document has been prepared.
Doc.: 11-03-0929-00-0wng Submission - Study Project Proposal WPP - Summary November 2003 H. Stephen Berger, TEM Consulting, LPSlide 1 Wireless Performance.

Doc.: wng Submission - Study Project Proposal WPP - Summary November 2003 H. Stephen Berger, TEM Consulting, LPSlide 1 Wireless Performance.
Doc.: IEEE 802.15-02/360r0 Submission September 2002 Stan Bottoms, ConsultantSlide 1 Project: IEEE 802.15 Working Group for Wireless Personal Area Networks.

Doc.: IEEE /360r0 Submission September 2002 Stan Bottoms, ConsultantSlide 1 Project: IEEE Working Group for Wireless Personal Area Networks.

Similar presentations

Ads by Google