1. Mobile Application Test Case Automation

2. Mobile Challenge Manual Processes Can Not Keep Up
Delivering Quality In An Ever Changing Mobile Landscape
Shear Number of Devices (953M Smartphones)
Different Operating Systems
Scale of Global Customers (6B)
Dynamic Content (Video, Animation)
Rapid development driven by demand
Manual Processes Can Not Keep Up

3. Mobile Testing is Still in the Past
Automation approaches haven’t evolved beyond unit testing
Pace and Scale of Mobile Development
Fingers and Eyeballs
VS.

4. Testing Processes Remain Core to Success
Test Management
Test Automation
Continuous Integration
SDLC tasks are a constant. Pace Isn’t

5. Why does Continuous Integration matter?
Find bugs faster
Make merging suck less
Faster feedback loops
Less lag time
x 2 for Mobile

6. If you’re going to fail, fail fast!
All of this is a really long way of saying that if your code is going to fail for any reason, we want to discover that failure as fast as possible so we can address it right away.
(CLICK)

7. Challenges with Mobile App testing
Transitional testing team
Seasonal testers
Globally distributed teams
Huge testing footprint
Wide variety of platforms, devices, OS, languages, browser versions, MODS, carriers
Dealing with multiple marketplaces / ecosystems / product catalogs
Can’t write and manually execute separate tests
Keeping track of what’s going on …
Hard to know where you are in your testing
Constant updates needed for the Business, Executives, PMs, etc.

8. Consequences if left unaddressed
Lack of organized, re-useable systems:
Missed Deadlines
App certification process - rejection
Re-inventing the wheel
Lack of Coverage
Quality issues
Low ratings, Poor reviews
Lack of visibility
Lose track of where you are in your testing
QA = black hole

9. Continuous Integration for Mobile (iOS)To
or Beta Users
Devs
Check in
☐ Pass
☐ Fail ✓
Source Code Repository
Test Results
Check out
CI Server
Run Tests
CI Agent
Execute on devices
Push to devices
In parallel
Real Devices

10. iOS testing Android testing No jailbreak required
No tethering required
iOS 5.0, 5.1, 6.0
iPhone 3GS, 4, 4S, and 5
iPad 1, 2, 3, 4
iPad mini
Simulators
No “rooting” required
No tethering required
Android (Gingerbread) and later
Phones, tablets, and emulators

11. Try it for free! Download CloudTest Lite (http://www.soasta.com)
Includes TouchTest technology
Free for a single device
No expiration
Free support via CloudLink forums

12. Test Automation Success Criteria
Reliable
Issue detection and recovery
Accurate verification
Unattended execution
Maintainable
Minimum sensitivity to application and test case changes
Test cases separate from automation code
Scalable
Test coverage expanded efficiently
Automated test cases created by non-technical resources

13. Test Automation Approach
Test Definition
Non-technical / Test Analysts & Subject Matter Experts
Automated Test Cases
Test Results
To support these characteristics for success we create a solution that separates the test definition (actions, data, expected results) from the test execution (tool code that interacts with the application under test)
This allows test analysts and application SMEs to define and analyze tests without the additional requirement of being automation engineers
Automation engineer(s) have to focus only on creating/maintaining the test automation framework
Automation Framework
Technical / Automation Engineers
Test Execution

14. Handling Device Diversity
Mobile Test Automation Framework
Business / Application Testing Components
Login
Add to Cart
Logout …
Search
Verify Cart
Get Status
Verify Search
Check Out
Verify Order
Assuming that the app functionality is the same across all mobile platforms, the automation framework will consist of a single set of business components – these are functions that perform the high-level business processes (actions and verifications) required to meet testing goals
The business process components are built using a library of functions that handle object interaction. Differences in mobile platforms are handled at this level either via code inside the functions or having multiple function sets (depends on mobile test automation tool)
Object Exists
Click
Get Image …
Set Value
Get Items
Get Text
Get Value
Select Item
Send Key
Object Interaction Methods