Fear of competing with the Crowd? Here is your key to unlock it Pushpa Raj Kandasamy – Test Consultant An Independent Tester

Testing based on use cases Abstract Traditional Testing Testing based on use cases Bugs against use cases or requirements Uses cases are equally distributed within the team Crowd Testing Testing by crowd of testers No use cases or requirements Test before the other tester reports any discrepancies Vs

Will I submit a duplicate bug? Introduction of Fear Crowd Testers need Quick Understanding To be accurate Quick turn around Kindling of Fear Will I submit a duplicate bug? Can I identify potential bugs faster? Should I compete with crowd of testers? Will that wont affect my credibility?

Lack of knowledge about crowd testing No proper guidance Misconceptions about Crowd Testing Lack of knowledge about crowd testing No proper guidance Not willing to compete with the crowd Time Management problems Reward systems

Testers Vs Bug Counts in Crowd Testing Portal 1

Testers Vs Bug Counts in Crowd Testing Portal 2

They joined without any interest in the project - No What did we observe? They were impotent! - No They joined without any interest in the project - No They don’t find any bugs - No As the application becomes bug free - No

Crowd Testers are Quick in understanding the requirement Characteristics of experienced Crowd Testers Crowd Testers are Quick in understanding the requirement Fast in identifying and reporting bugs Accurate in providing information upfront Test the complete functionalities within shorter time frame Rich in domain expertise

Outstanding challenge to Crowd Testing TEST COVERAGE

Coverage results from Crowd Testing Portal 1

Coverage results from Crowd Testing Portal 2

What do we infer? Inferences are Defect seems to be clustered only in few areas of the application Majority of the features remain less impacted by the bugs

Where to look for bugs?

Must have Good to have Must have Vs Good to have Things that will impact the conversion rate of your application Things which will impact your brand reputation Things that will attract your customers Good to have Things that will impact your customers journey within your application Things that will have minimal impact on User experience Things which will not impact your completion but interrupts your normal feature

What is the expectation from end user? How it is intended to work? Example…Email settings What is the expectation from end user? How it is intended to work? What will be the loss? Is it Good to have or Must to have?

Let us consider my experiences with crowd testing Case Study Let us consider my experiences with crowd testing Started with very minimum knowledge on Crowd Testing Struggled initially Learned during each of my failures Corrected those failures to keep moving forward Explored new ways to move forward

Working towards a newer strategy Change in Strategy Working towards a newer strategy Keeping coverage in mind Quality over quantity Employing different techniques at new dimensions Reporting the bugs with its impact to the application Ensuring that your bug speaks for self

Coverage results using new strategy with CT Portal 1

Coverage results using new strategy with CT Portal 2

Individual Performance based on New Approach

Testers Application confidence level will be improved Benefits of new approach Testers confidence level will be improved motivated to participate in more crowd testing cycles quality levels will be improved Application coverage will be improved bug density will be reduced stability index will be higher

https://en.wikipedia.org/wiki/Crowdsourced_testing References & Appendix Testing Experience. The Magazine for Professional Testers. Special Issue on "Crowd Testing". March 2014. http://www.testingexperience.com/ https://en.wikipedia.org/wiki/Crowdsourced_testing Howe, J. 2008. Crowdsourcing: Why the Power of the Crowd is Driving the Future of Business, 1Ed. Crown Publishing Group, New York, NY, USA. Mukesh Sharma and Rajini Padmanaban. 2014. Leveraging the Wisdom of the Crowd in Software Testing (1st ed.). Auerbach Publications, Boston, MA, USA.

Author Biography Pushpa Raj Kandasamy is a Software Tester with close to 10 years of experience in Software Testing. He has served major customers in the Banking and Financial Services industry. He is an expert with Insurance Domain and its Products. He is one of the active crowd tester in most renowned Crowd testing platforms. He provides his service as a crowd tester to improve the quality of the products before releasing into the market. He had been a successful Crowd Tester since 2010. His specialisation includes E-Commerce, Insurance, Social websites, Mobile Applications and Gaming. He has an M.B.A in IT Systems from Madras University and a Bachelor of Engineering from Anna University. He holds Associate in General Insurance (AINS) designation from AICPCU.

Thank You!!!