Cross Platform UI testing using Sikuli -Amit Dixit -Dipesh Bhatewara

Objective Testing of mobile based application Current platform specific tools Challenges Generic Solution For All The Platforms

Mobile Platforms And Testing Tools Android Android Instrumentation Robotium Seleniumdroid iOS UI Automation FoneMonkey Frank Symbian CTS (Compatibility Test Suite)

Android Android Instrumentation Robotium Selenium droid Paid Tool Instrumentation framework based on JUINT3 Framework supports activities , toasts , context menus etc. Robotium Extends Android Instrumentation Framework Can develop powerful test cases  Can handle multiple activities  Blazing fast test execution Runs on a device Selenium droid Runs in android browser Use native touch events to emulate user interaction Paid Tool See Test

iOS UI Automation FoneMoneky Frank Tests in JavaScript Allows you to write test scripts to exercise your application’s user interface elements Runs on a connected device / simulator FoneMoneky FoneMonkey is a functional testing tool for the iPhone providing for the interactive creation, editing and playback of automation scripts Easily incorporated into continuous integration Frank Provide support for automating functional testing of an iOS app. Integrate with BDD tools like cucumber Works on device and simulator

Challenges Generic Challenge Technical Challenge Diversity of devices /platforms Application complexity Technical Challenge Large no of test cases Verification of UI

Solution Test Automation Benefits Generic Way for Test Automation on multiple platforms(Use tools like Sikuli). This will solve maintenance problem. Build Reliable and comprehensive test framework Benefits Cost Reduction Increased productivity Better application Quality

Nature of Mobile Applications (xcode – objective C) Calculator(XCODE – Objective C) (webos – JS/CSS) Application (Calculator) (java – android SDK) Calculator (webos – JS/CSS) Calculator (java- android SDK)

Approach to solve the problem Image based test automation Automate user operations eg. Click, type, drag- drop, mouse actions etc. Visual verification of the expected output Not dependent on platform underneath Can be used to automate emulator as well as device. 9

Advantages of the approach Can accurately test GUI and rendering of applications. Write test outside the device Can be used to automate multiple devices without getting into details of each platform technology Can perform actions on Emulator (Virtual Boxes) Easy to automate.

Limitations of the approach Highly depends on the Resolution. Can not run in background. Dynamic paths are tricky to automate.

What is Sikuli? Visual technology to automate GUI using images. MIT research project. Open Source license. Sikuli IDE Sikuli Script API Automates anything on screen without internal API's support Works on Windows, Mac, Linux.

Sample Sikuli Script 13

DEMO

Solution proposed in demo to test Calculator Use Java for test Project, Use Junit Import Sikuli Script API Write single test which will use an interface for calculator operations Implement interface for Android and Iphone with different set of images required for automation Run same test by changing the configuration on multiple emulators/devices Can see the device on your machine using VNC and use that view to run your test on.

Q & A 16