1. Regulators Evaluation of Technology
GRAF
April 2017

2. GLI by the Numbers Over 25 years of industry experience
1,000+ employees
6 continents
More than 475 jurisdictions served
Exclusive markets encompass over 100 casinos, operating over 200,000 gaming devices
More than 120,000 equipment certifications issued annually
ISO 17025, and accredited
Services available 24/7

3. We Test and Advise Class II and Class III Gaming systems
Player tracking
Ticketing
Cashless
Server-based and downloadable
Bonusing
Any other piece of technology that requires integrity testing
Video lottery devices and systems
Lottery equipment
Automatic draw machines
Scratch ticket systems
Other lottery-style equipment

4. How can GLI assist Regulators?
Verification & Validation Testing
Inspections & Control

5. Types of Testing - Modular
GLI performs gaming testing on many levels, The first is “modular testing” whereby we test a specific piece of software or module to determine if specific functions work properly.
Black Box Testing – Test the program or software against specified requirements or functionality.
White Box Testing – Examines paths of logic or the structure inside a program.
Grey Box Testing – Focuses on the internal structure of the program,

6. Types of Testing - Integration
Integration Testing
We test a set of logically related modules to ensure that they function properly together.

7. Test Procedure Overview
General Tests
Supervised Build of Code and Install
Source Code Review/Comparison
Base/Game Platform
RNG test
Math Analysis
Artwork Review
Emulation
Error and Event Handling
Metering and Reporting

8. Supervised Build & Install
Performed at the start of a project and may happen multiple times during a project.
Purpose:
To create traceability between software and source code
Benefits:
Incremental testing when issues are fixed
Process:
GLI observes code being checked out, compiled and deployed
GLI the knows that the code that is reviewed is actually what is being compiled into Gaming software,
There is NO disconnect.

9. Source Code Review / Comparison
Source code is the heart, veins and the brains of any software,
The purpose is to understand how software functions and define critical files which are then listed on certification / evaluation reports,
Review is usually done at start of project
Source Code Comparison
In the case of software being “updated” or “modified” rather than created from scratch, source code comparisons can be done.
Purpose is to identify changes in order to minimize test scope.

10. Software Functionality
General functionality
Transactional behavior
Game-play histories
Jurisdictional specific requirements

11. RNG Testing Activities involved
RNG is short for “Random Number Generator”
The Purpose of the RNG is to ensure that gambling devices are Random in nature so that gameplay is fair to players and operators.
Review, verification and Statistical analysis is done on the RNG algorithms, associated source code as well as game parameters.
Collection of data with respect to game types are also collected and fed into “smart” simulators in order to achieve a reasonable confidence level.

12. Artwork Review Activities involved
Artwork is the “self service” mechanism available to a player on a gambling device.
Review of game instructions, terms and conditions and user interface against relevant jurisdictional regulations are conducted,
This is to ensure that game instructions accurately reflect game behavior as understood from Source Code Review, Math Analysis and Emulation.
Ensure accurate translations, if necessary

13. Math Analysis Activities involved Other considerations
Verify that game RTP% conforms to jurisdictional requirements.
Other considerations
RTP% is calculated based on supplied materials (PAR sheets, game specifications, etc.) along with GLI’s own test results (Source Code Review, Artwork Review and Emulation)

14. Emulation What is the purpose of emulation? Activities involved
Purpose of emulation is to selectively confirm behavior identified during Source Code Review, Artwork Review and Math Analysis.
GLI is able to force certain pays and plays in order to check correctness.
Generally, the process of emulation will involve some degree of debugging.
Activities involved
Verify elements (i.e. reels, cards, balls, etc.) used to generate game outcomes
Verify winning outcomes
Verify other behavior as necessary (line wins, bonus features, etc.)

15. Event Handling Activities involved Other considerations
Verify behavior during error states (i.e. disconnection, timeouts, etc.)
Any other regulated events, as necessary
Other considerations
Activities and conformity results can vary widely by jurisdiction
Event handling testing is a process to verify behaviour of a device or software.
Example, what happens if you cut the power to a machine in the middle of a game? Does it behave as expected?
Special requirements may apply depending on the Jurisdiction tested.

16. Metering and Reporting
Activities involved
Verify game history and accounting of funds won/lost
Verify accounting of deposits and withdrawals
Verify accurate reporting to customer and/or regulator of the above + any other jurisdictionally required reports (i.e. accounts created, closed, locked, etc.) typically done with access to back office support tools

17. Jurisdiction Specific Testing
Activities include (non-exhaustive list)
Monitoring and Control System testing
Interoperability testing
Any other Jurisdictional requirements.

18. Inspections Why is there a need for Inspections?
To ensure that hardware and software that was tested and certified is actually what has been deployed at a Gambling venue.
To ensure that product is installed and configured correctly.

19. Signature Verification
What is signature verification?
Signature Verification is a method to extract a unique signature for any file or storage media.
It is a foolproof way to check if you have correct software installed as per certification or approval documents.

20. Software Media EPROMS Compact Flash Hard Drive
Verification Method Verification Method Verification Method

21. Gaming Cabinets Where does Software media reside?
Software media has to reside in a secure location within a gaming cabinet.
This area is referred to as the “Logic Box”, because it houses the critical gaming software.
This logic area is Typically sealed by Regulators with “Tamper resistant tape” and need Regulator approval to remove and reseal.

22. Monitoring and Control System

23. General Manager – GLI Africa
Thank you!
Devon Dalbock
General Manager – GLI Africa
+27 (0)