Inktomi Confidential and Proprietary The Inktomi Climate Lab: An Integrated Environment for Analyzing and Simulating Customer Network Traffic Stephane.

Slides:



Advertisements
Similar presentations
Module 13: Implementing ISA Server 2004 Enterprise Edition: Site-to-Site VPN Scenario.
Advertisements

Topics to be discussed Introduction Performance Factors Methodology Test Process Tools Conclusion Abu Bakr Siddiq.
WEB DESIGN TABLES, PAGE LAYOUT AND FORMS. Page Layout Page Layout is an important part of web design Why do you think your page layout is important?
Testing Web Applications. Applications Architecture Client Server Architecture.
TCP/IP Protocol Suite 1 Copyright © The McGraw-Hill Companies, Inc. Permission required for reproduction or display. Chapter 22 World Wide Web and HTTP.
Design and Implementation of HTTP-Gnutella Gateway Baoning Wu (baw4) Wei Zhang (wez5) CSE Department Lehigh University.
Dave Krause ANRCS Web Action Team.  Data is collected from a web site based on what the user does during the visit.
1 Content Delivery Networks iBAND2 May 24, 1999 Dave Farber CTO Sandpiper Networks, Inc.
1 Internet Protocols and Network Performance Issues Carey Williamson iCORE Professor Department of Computer Science University of Calgary.
OCT1 Principles From Chapter One of “Distributed Systems Concepts and Design”
CDNs & Replication Prof. Vern Paxson EE122 Fall 2007 TAs: Lisa Fowler, Daniel Killebrew, Jorge Ortiz.
12/11/01 Matt Bridges Advisor: Ralph Morelli. What is Web Analytics? In traditional commerce, store owners can observe their customers habits: What time.
Implementing ISA Server Caching. Caching Overview ISA Server supports caching as a way to improve the speed of retrieving information from the Internet.
Web Development Using ASP.NET CA – 240 Kashif Jalal Welcome to week – 1 of…
1 Web Content Delivery Reading: Section and COS 461: Computer Networks Spring 2007 (MW 1:30-2:50 in Friend 004) Ioannis Avramopoulos Instructor:
Capacity planning for web sites. Promoting a web site Thoughts on increasing web site traffic but… Two possible scenarios…
The Medusa Proxy A Tool For Exploring User- Perceived Web Performance Mimika Koletsou and Geoffrey M. Voelker University of California, San Diego Proceeding.
Introduction to eValid Presentation Outline What is eValid? About eValid, Inc. eValid Features System Architecture eValid Functional Design Script Log.
 Proxy Servers are software that act as intermediaries between client and servers on the Internet.  They help users on private networks get information.
COMPUTER TERMS PART 1. COOKIE A cookie is a small amount of data generated by a website and saved by your web browser. Its purpose is to remember information.
Microsoft ® Official Course Monitoring and Troubleshooting Custom SharePoint Solutions SharePoint Practice Microsoft SharePoint 2013.
Christopher M. Pascucci Basic Structural Concepts of.NET Browser – Server Interaction.
WEB ANALYTICS Prof Sunil Wattal. Business questions How are people finding your website? What pages are the customers most interested in? Is your website.
Computer Concepts 2014 Chapter 7 The Web and .
LinuxUNIX Red HatSUSECentOSUbuntuDebianOracleAIXHP-UXSolaris Configuration Manager * * * * * * Endpoint Protection No Plans.
Threat Management Gateway 2010 Questo sconosciuto? …ancora per poco! Manuela Polcaro Security Advisor.
CP476 Internet Computing Lecture 5 : HTTP, WWW and URL 1 Lecture 5. WWW, HTTP and URL Objective: to review the concepts of WWW to understand how HTTP works.
Tutorial 1: Getting Started with Adobe Dreamweaver CS4.
1 Chapter 6: Proxy Server in Internet and Intranet Designs Designs That Include Proxy Server Essential Proxy Server Design Concepts Data Protection in.
Conditions and Terms of Use
11/16/2012ISC329 Isabelle Bichindaritz1 Web Database Application Development.
Module 10: Monitoring ISA Server Overview Monitoring Overview Configuring Alerts Configuring Session Monitoring Configuring Logging Configuring.
©2010 John Wiley and Sons Chapter 12 Research Methods in Human-Computer Interaction Chapter 12- Automated Data Collection.
GIS On The Web: An Overview of ArcIMS. *The easy flow of geographic data can offer real-life solutions in many societal sectors, including municipal government,
Module 11: Implementing ISA Server 2004 Enterprise Edition.
Computer Emergency Notification System (CENS)
Sustainability: Web Site Statistics Marieke Napier UKOLN University of Bath Bath, BA2 7AY UKOLN is supported by: URL
Module 6: Managing Client Access. Overview Implementing Client Access Servers Implementing Client Access Features Implementing Outlook Web Access Introduction.
® IBM Software Group © 2007 IBM Corporation Best Practices for Session Management
Apache JMeter By Lamiya Qasim. Apache JMeter Tool for load test functional behavior and measure performance. Questions: Does JMeter offers support for.
Module 7: Advanced Application and Web Filtering.
World Wide Web “WWW”, "Web" or "W3". World Wide Web “WWW”, "Web" or "W3"
Ó 1998 Menascé & Almeida. All Rights Reserved.1 Part V Workload Characterization for the Web.
ITGS Network Architecture. ITGS Network architecture –The way computers are logically organized on a network, and the role each takes. Client/server network.
Web Server.
Module 9 Planning and Implementing Monitoring and Maintenance.
MiddleMan: A Video Caching Proxy Server NOSSDAV 2000 Brian Smith Department of Computer Science Cornell University Ithaca, NY Soam Acharya Inktomi Corporation.
ASP-2-1 SERVER AND CLIENT SIDE SCRITPING Colorado Technical University IT420 Tim Peterson.
Web Browsing *TAKE NOTES*. Millions of people browse the Web every day for research, shopping, job duties and entertainment. Installing a web browser.
Web Measurement. The Web is Different from other Commuication Media More precise measurement of activity on Web sites is available More precise measurement.
1 Object-Oriented Analysis and Design with the Unified Process Figure 13-1 Implementation discipline activities.
JavaScript and Ajax (Internet Background) Week 1 Web site:
Microsoft Cloud Solution.  What is the cloud?  Windows Azure  What services does it offer?  How does it all work?  How to go about using it  Further.
Overview on Web Caching COSC 513 Class Presentation Instructor: Prof. M. Anvari Student name: Wei Wei ID:
1 The World Wide Web Architectural Overview Static Web Documents Dynamic Web Documents HTTP – The HyperText Transfer Protocol Performance Enhancements.
1 Evaluation of Cooperative Web Caching with Web Polygraph Ping Du and Jaspal Subhlok Department of Computer Science University of Houston presented at.
Regan Little. Definition Methods of Screening Types of Firewall Network-Level Firewalls Circuit-Level Firewalls Application-Level Firewalls Stateful Multi-Level.
Discovering Computers Fundamentals, 2011 Edition Living in a Digital World.
Module 4: Troubleshooting Web Servers. Overview Use IIS 7.0 troubleshooting features to gather troubleshooting information Use the Runtime Control and.
Distributed OS.
Module 3: Enabling Access to Internet Resources
Enabling Secure Internet Access with TMG
Affinity Depending on the application and client requirements of your Network Load Balancing cluster, you can be required to select an Affinity setting.
Netscape Application Server
性能测试那些事儿 刘博 ..
Ad-blocker circumvention System
Chapter 12: Automated data collection methods
IS 4506 Server Configuration (HTTP Server)
Evaluating Transaction System Performance
CT 1306 Communication Networks Management Lab
Presentation transcript:

Inktomi Confidential and Proprietary The Inktomi Climate Lab: An Integrated Environment for Analyzing and Simulating Customer Network Traffic Stephane Gigandet, Ashok Sudarsanam, and Anshu Aggarwal Inktomi Corporation Foster City, CA ACM SIGCOMM Internet Measurement Workshop 2001

Inktomi Confidential and Proprietary Motivation Inktomi Traffic Server is our web-caching product. Some software issues occurring at customer sites are difficult to reproduce in-house. The traffic is different at every customer site. Software issues take longer to reproduce and fix.

Inktomi Confidential and Proprietary Solution: The Inktomi Climate Lab An environment to analyze and simulate the HTTP traffic of customer deployments. Used for: Stress-testing our product before it is deployed Reproducing software issues that occur in the field Estimating performance Consists of 3 components: A log analysis tool : Loggen A load generation tool : Loadgen Dedicated hardware Named after agricultural laboratories that can replicate any climate in the world to test seeds.

Inktomi Confidential and Proprietary Inktomi Climate Lab Inktomi Traffic Servers Loadgen servers Loadgen clients Customer Deployment Internet Inktomi Traffic Servers Users Design Loggen logs Loadgen test plan

Inktomi Confidential and Proprietary Log Analysis Tool: Loggen Analyzes customers logs Logs are collected using Traffic Server Logs include IP addresses, methods, URLs, all headers, status codes, numbers of bytes transferred and timing information. Outputs a test plan containing distributions XML file used to configure the Load Generation Tool Example of distributions : document size, site popularity, number of clicks per session, requests per click etc.

Inktomi Confidential and Proprietary Load Generation Tool: Loadgen Simulates both clients and servers Uses test plans generated manually or with Loggen Models individual client sessions realistically Implements all the HTTP/1.1 features Supports every request method, header and response status code Keeps state (cookies) Simulates network conditions at the application level

Inktomi Confidential and Proprietary Experimental results Deployments: - Customer A: 3 million ops during 2 hours. - Customer B: 2 million ops during 24 hours. - Customer C: 330,000 ops during 24 hours Resulting test plans are currently used to help stress test our product. Customer A Customer B Customer C

Inktomi Confidential and Proprietary Validation of the simulation Reproduction of old bugs first reported by customers Quantification of code coverage Logs collected during the simulation should result in a test plan similar to the test plan used during the simulation. Inktomi Traffic Servers Loadgen servers Loadgen clients Initial Loadgen test plan Loggen logs Resulting Loadgen test plan

Inktomi Confidential and Proprietary Conclusion The Climate Lab reproduces customer environments Loggen converts logs to test plans Loadgen uses test plans to reproduce traffic Next: evaluation of the accuracy of the simulation The Climate Lab is used in-house to uncover software issues and test the stability of our web caching proxy