1. Pilot Pioneer Operation Guide v9.6

2. Contents 1. Software Installation 2. Main Interface
3. General Operation
4. Main Functions’ Operation

3. Software Installation
Pilot Pioneer is based on .net Framework 4.0. If it is not installed, please go to Microsoft Download Center to download and install it properly before Pilot Pioneer installation.
Data
display
Data
analysis

4. Contents 1. Software Installation 2. Main Interface
3. General Operation
4. Main Functions’ Operation

5. Main Interface
Menu Bar
Tool Bar
Workspace
Navigation Pane

6. Contents 1. Software Installation 2. Main Interface
3. General Operation
4. Main Functions’ Operation

7. Test Procedure Note: The steps with dashed arrow are optional.
Import Map
Import Site Database
Configure system
Connect devices
Configure test plans
Export data files
Record data files and execute test tasks
Replay data files
Check data files
Perform statistics and analysis
Note: The steps with dashed arrow are optional.

8. Create/Open a Project
Users may create a new project or import a saved project. By importing a project, users may import the saved configuration, such as device and test plans.
Create a project
Open a project

9. Import Site
When checking the test route on the Map window, users may import sites to check the site linking.
Import site database

10. System Configuration—Parameter Settings
Users may check the message settings in the Parameter Settings window.
Parameter Settings
Select required parameter in the navigation pane.
Select a parameter to modify its name and color.

11. System Configuration—Event Settings
Users may check the event settings in the Event Settings window.
Event Settings
Select required event in the navigation pane.
Select an event to modify its name and color.

12. System Configuration—Message Settings
Users may check the parameter settings in the Message Settings window.
Parameter Settings
Select a network.
Select a parameter to modify its name and color.

13. System Configuration—Record Settings
Users may perform data division configuration by time or size in the General and Advanced tab pages.
Record settings

14. Connect Devices
Device configuration includes the configuration about handset, GPS, and scanner. There are two kinds of device configuration: manual and automatic configuration.
Double-click a device for manual device configuration.
Users need to manually configure the device and port information for manual configuration.
Note: Users need to install the device driver before connecting the device. Otherwise, the device cannot be detected and device configuration cannot be performed.

15. Connect Devices
Click the automatic detect for automatic device configuration.
Pilot Pioneer may automatically perform device and port configuration.

16. Configure Test Plans
The following figure shows the FTP service test plan configuration.
Users may click Test Plan in the device control window to configure its test plan.
Users may click a test service and configure its test plan as required.

17. Record Data Files Click this button to start recording data files.
In the Device Control page, click Start All to execute the test plan.

18. Record Data Files The recorded data files are saved in this path.
If data files are not recorded, the files will be saved as temporary files in the TempLogFiles directory.

19. Check Data Files
Users may enter letters in the search box for fuzzy search as required.
Click this button to filter messages (Layer 1, Layer 2, and Layer 3 as required.

20. Check Data Files Double-click a message to check the message details.
During test, users may click this button to freeze the message or event screen to check data details as required.

21. Replay Data Files
After test stops, users may click this button and select data files to replay.
Users may click these buttons to replay forward, backward, or drag the speed button to replay at any arbitrary position.

22. Export Data Files
Users may right-click a data file and select Export Logfile to export the file.
Click Settings to enter the Template Settings window to select parameters for export.
After selecting parameters, click Save to save the template and then click Export to export the data file.

23. Perform Data Statistics
Users may perform KPI, voice, and data statistics and analysis, and generate multiple reports as required.

24. Perform Data Statistics
Take KPI statistics as an example, after selecting a data file, users may set parameters, event, chart, coverage map, etc, and generate statistics report based on the settings.

25. Merge/ Partition Data Files
Users may partition logfiles by time, region, device ID as required.
Users may choose Tools > Merge/Partition Logfiles to merge or partition logfiles as required.
Click Add to add data files, select data files to be partitioned/merged, and click Divide/Merge.

26. Contents 1. Software Installation 2. Main Interface
3. General Operation
4. Main Functions’ Operation

27. Manual MOS Test
The Voice Quality and Benchmarking Device is used for Manual MOS test, where PESQ and POLQA algorithms are supported. In a voice quality test, users may manually call a terminal, and Pilot Pioneer may initiate the PESQ or POLQA MOS test to obtain the relevant MOS score. This function is provided for traditional Circuit Switched (CS) voice call tests and other Internet Protocol (IP) based call tests such as VoLTE.
To conduct Manual MOS test, choose Manual MOS under Test Plan, and then conduct settings on the page that appears as required.

28. VSNR Algorithm for Manual MOS Test
The Video Stream Non-Reference (VSNR) algorithm is added in this version. This is a non-reference based algorithm for video streaming quality measurement. This function is only for Manual MOS tests.
Users may select Calc VSNR in the Manual MOS window to enable this function.

29. Data Partition for .ddib Format
The data in the .ddib format can be partitioned in this version.
Users may choose Tools > Merge/Partition Logfiles, click Add, and then select .ddib logfiles for partition.

30. Report Task Monitor
The Report Task Monitor function is added to check the progress and completion of each statistics report task.
Users may choose Configuration > Report Task Monitor to check the report progress.

31. Grey Background in the Map Window
In the Map window, users may render the background map in grey to highlight the test route.
To render the background map in grey, click the drop-down arrow beside Google maps, and select Gray Background.

32. TCP/IP Sniffer for PBM Service Test
TCP/IP sniffer is supported during PBM service test, to facilitate data analysis.
There are three kinds of TCP/IP modes:
All: to sniff the entire data.
Headers only: to sniff only the frame header and the last ten bytes all services.
Optimized: to sniff the entire protocol packet and the first data packet for FTP and PBM service tests.
Users may select TCP/IP Monitor in the PBM test settings window and set Monitor mode as required.

33. Parameter Categorization Based on QCI
Parameters are categorized based on QoS Class Identifier (QCI), which help users to check KPIs based on different services.

34. Project Wizard
Users may enable the project wizard function for easy configuration (e.g. collection protocol, display mode) based on test scenarios when they need to create a new project.
On the Tool bar, click the New project button to display the dialog box.
Select a project type, select Show Project Wizard, and click OK. The Project Wizard will facilitate users to complete the new project creation

35. Online Version Update and Online Bug Feedback
Users may choose Help > Check Version to check the latest software version and perform online update as required.
Users may choose Help > Feedback to submit any detected software bugs to Dingli, which will help us to effectively collect and prioritize bug fixes in a timely manner.

36. Data Insight (Pilot Pioneer Expert)
Based on test data and cell site files, Data Insight is used to locate problems in the tested networks by analyzing sampling points, events, parameters, etc. Users may set different analysis conditions for different network technologies and filter analysis results to locate problems on cell coverage, interference, events, handover, parameters, etc.
Users may choose Analysis > Data Insight, and set analysis conditions to conduct corresponding analysis.
The results can be viewed in the Map, Table windows and can be exported to the txt and excel formats.

37. MO/MT Union Analysis (Pilot Pioneer Expert)
MO/MT Union analysis is added in this version to analyze the complete call details between MOC and MTC calls.
This function is used to analyze:
key call processes
Parameters
Messages
Events
Message/Event Delay
as well as to locate potential network problems (e.g. blocked call, dropped call, etc.).
Users may choose Analysis > MO/MT Union Analysis and set analysis conditions to conduct corresponding analysis.

38. Delay Analysis (Pilot Pioneer Expert)
Delay Analysis is added in this version to analyze the service test based on reported events or messages' sequence. For example, a Call Delay means the actual duration between the call request and call connection has exceeded the specified time. This may affect users' experience, so it is an important reference for network quality verification. Users may define the conditions for the analysis, such as message or event order, counts, threshold, and filter conditions.
Users may choose Analysis > Delay Analysis and set analysis conditions to conduct corresponding analysis.

39. Extended Coverage Analysis(Pilot Pioneer Expert)
Extended Coverage analysis is used to analyze and locate cells that exceed the pre-defined distance, optimize network planning and overlapping coverage issues.
Users may choose Analysis > Extended Coverage Analysis and set analysis conditions to conduct corresponding analysis.

40. Overshooting Analysis (Pilot Pioneer Expert)
Overshooting Analysis is used to analyze the cells that exceed the predefined areas which may lead to problems such as handover failure, pilot pollution, no dominant cell, handover, etc. Users may filter and analyze the sampling points that is outside the pre-defined conditions, to identify network problem areas and provide information for optimization activities.
Users may choose Analysis > Overshooting Coverage Analysis and set analysis conditions to conduct corresponding analysis.

41. Antenna Feeder Reversed Analysis (Pilot Pioneer Expert)
Based on cell site database and sampling points, Antenna Feeder Reversed Analysis is used to check if the antenna has been connected inversely, including unidirectional, bidirectional, and multidirectional inverse.
Users may choose Analysis > Antenna Feeder Reversed Analysis and set analysis conditions to conduct corresponding analysis.