Нагрузочное тестирование в облаке #almsummit Нагрузочное тестирование в облаке Ефимцева Наталия natale@microsoft.com Докладчик

Содержание Подходы к нагрузочному тестированию 9/21/2018 3:45 AM Содержание Подходы к нагрузочному тестированию Нагрузочное тестирование в облаке С помощью «чистого» Windows Azure С помощью Visual Studio Online! Вопросы © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

9/21/2018 Итак… Load testing is a key phase in the lifecycle of any solutions as it can be used to check if a application can sustain the expected load. Being able to run high volume, effective performance tests against a cloud or on-premises app requires more than a single workstation simply executing multiple requests concurrently. When dealing with high loads, using a single workstation is not sufficient to generate the expected traffic as it will soon run out of system resources, whether memory, processor power, or network throughput. A test rig needs to provide the ability to capture KPI during test runs and configure aspects like user load profiles, distribution of tests, etc. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Типичная схема нагрузочного тестирования 9/21/2018 Типичная схема нагрузочного тестирования Workstation: can be used to define, configure, launch and control load tests. Test Controller: coordinates the execution of the tests across multiple test agent machines, and manage the collection of results from all the test agents. Test Agent: each test agent machine is responsible for executing the performance tests against the system under test while collecting KPIs and then reporting results back to the controller for storage and analysis. Load Test Repository: is a SQL Server database used as the repository for performance test results. Note: the workstation can also act as the controller. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Сложности нагрузочного тестирования Microsoft Consumer Channels and Central Marketing Group 9/21/2018 Сложности нагрузочного тестирования Подготовка\настройка машин: непросто и долго Цена: не дешево (дорого) Приложения в Windows Azure: есть нюансы © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Microsoft Consumer Channels and Central Marketing Group 9/21/2018 Решение Использовать облачные Windows Azure Скорость провиженинга Неограниченные ресурсы Экономия Windows Azure and Visual Studio provide the ability to build a large, distributed test rig in a fast and automated way. Virtualization of computing resources eliminates the need for dedicated hardware for load testing. Different approaches and topologies can be used to provision a load test rig in Windows Azure in an automated way. ---------------------------------------------- Entry Cost: The cost of doing load tests decreases greatly after the initial investment. Your first costs are for Visual Studio Ultimate. Once deployed, the cost of the test rig depends on Windows Azure Pay-As- You-Go pricing model. Maintenance Cost: you can create an easily maintain a test harness in Windows Azure. Elasticity: The load test can be easily modified to accommodate different scenarios and conditions. For example, you can configure the Azure hosted test rig with a larger number of test agents. Repeatability: After the initial investment, you can use the same artifacts (VS cloud project or VM images) to deploy a new test rig in Windows Azure, run a load test for the necessary time and undeploy it. © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Экономия. Поминутная тарификация. 9/21/2018 Экономия. Поминутная тарификация. $ 60 45 30 15 © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

$ 50 100 150 В МЕСЯЦ 3 VMs, работающие 24x7 весь месяц 9/21/2018 50 100 150 В МЕСЯЦ 3 VMs, работающие 24x7 весь месяц $ 80 VMs для нагрузочного тестирования Скидка от 33% © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Интеграция с корпоративной средой 9/21/2018 Интеграция с корпоративной средой Windows Azure Виртуальная сеть <subnet 1> <subnet 2> <subnet 3> DNS сервер Site-to-Site VPN Корпоративная среда VPN Gateway VPN шлюз Point-to-Site VPN Windows Server 2012 RRAS Ваш ЦОД Машины за Корпоративным брандмауэром Remote workers © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Нагрузочное тестирование в облаке

Нагрузочное тестирование в облаке Топологии тестовой среды в Windows Azure

Tech Ready 15 9/21/2018 Пример реализации (1\2) Автоматизация шагов, необходимых для провижининга контроллеров и агентов для теста Их включение в виртуальную сеть и в домен (где развернута система) Копирование дистрибутивов Test Controller и Test Agent в BLOB хранилище Сам облачный проект состоит из 2х worker-ролей: Controller Agent © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Пример реализации (1\2)

Топология 1: IaaS + PaaS + hosts файл+ виртуальная сеть TechReady 16 9/21/2018 Топология 1: IaaS + PaaS + hosts файл+ виртуальная сеть IaaS Cloud Service 1: Visual Studio и SQL Server (Load Test DB) PaaS Cloud Service 2: контроллер и агенты IaaS\PaaS: тестируемая система Виртуальная сеть Безопасность: Pass-through authentication Адресация: IPv4 и/или hosts файл http://habrahabr.ru/post/200446/ © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Масштабирование Настройка Через портал управления Windows Azure 9/21/2018 Масштабирование Настройка Через портал управления Windows Azure Через PowerShell Set-AzureRole -ServiceName $serviceName ` -Slot $slot ` -RoleName $roleName ` -Count $count © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Топология 2: IaaS + PaaS + DC\DNS + виртуальная сеть IaaS Cloud Service 1: домен + DNS IaaS Cloud Service 2: Visual Studio и SQL Server (Load Test DB) PaaS Cloud Service 3: контроллер и агенты PaaS Cloud Service 4: тестируемая система Виртуальная сеть Security: Windows аутентификация+ pass-through authentication Адресация: DNS

Топология 3: локальная Visual Studio + PaaS + hosts файл + виртуальная сеть + Point-to-Site VPN IaaS Cloud Service 1: SQL Server (Load Test DB) PaaS Cloud Service 3: контроллер и агенты PaaS Cloud Service 4: тестируемая система Виртуальная сеть или VPN (Point to Site VPN) Безопасность: Pass-through authentication Адресация: IPv4 и/или hosts файл

Демонстрация Тестирование с помощью виртуальных машин в Windows Azure 9/21/2018 Демонстрация Тестирование с помощью виртуальных машин в Windows Azure © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Нагрузочное тестирование в облаке Все может быть еще проще! Visual Studio Online!

Демонстрация Тестирование с помощью Visual Studio Online 9/21/2018 © 2012 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Предоставляемые ресурсы Нагрузочное тестирование Бесплатно: 15,000 минут (Virtual User) в месяц Можно купить: $0.001\минута Требуется Visual Studio Ultimate Сборка Бесплатно: 60 минут в месяц Можно купить дополнительно: $0.025\минута Also available are pay as you use services for hosted builds and load testing. Azure is the billing platform for VS Online Our services are purchased via the Azure Management Portal (credit card or Azure commitment only) An Azure subscription is required to buy VS Online services Free use of VS Online does not require an Azure subscription Azure is the infrastructure running VS Online services But no separate charges for storage, databases, VMs, etc. since VS Online is a finished service Management of VS Online is at visualstudio.com After you buy a user plan in the Azure Management Portal, you go to visualstudio.com to assign the plan to a user

Архитектура Visual Studio Пул агентов - динамически TechEd 2013 9/21/2018 3:45 AM Архитектура Пул агентов - динамически Load Test Web Service Worker Azure Tables Visual Studio Results database Azure Blobs © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Проверено! 12 внутренних команд разработки Внешние 10 клиенты и MVP TechEd 2013 9/21/2018 3:45 AM Проверено! 12 внутренних команд разработки Включая Visual Studio Online команду и Skype Внешние 10 клиенты и MVP Система для выборов в штате Флорида (приложение на Windows Azure) © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Выводы Облако Windows Azure дополняет традиционные ALM сценарии 9/21/2018 3:45 AM Выводы Облако Windows Azure дополняет традиционные ALM сценарии Преимущества: Экономия Быстрота развертывания Неограниченные ресурсы © 2007 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.

Спасибо за внимание! 9/21/2018 3:45 AM © 2013 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION. © 2010 Microsoft Corporation. All rights reserved. Microsoft, Windows, Windows Vista and other product names are or may be registered trademarks and/or trademarks in the U.S. and/or other countries. The information herein is for informational purposes only and represents the current view of Microsoft Corporation as of the date of this presentation. Because Microsoft must respond to changing market conditions, it should not be interpreted to be a commitment on the part of Microsoft, and Microsoft cannot guarantee the accuracy of any information provided after the date of this presentation. MICROSOFT MAKES NO WARRANTIES, EXPRESS, IMPLIED OR STATUTORY, AS TO THE INFORMATION IN THIS PRESENTATION.