1. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER TotalView on the T3E and IBM SP Systems NERSC User Services June 12, 2000

2. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems Contents Compiling for, and executing TotalView Startup windows Basic controls and user interface Breakpoints –Setting them –Running to them –Viewing processor states and changing processors –Viewing variable values –Setting Eval points Attaching to running jobs On-line help

3. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems How to Compile & Run On the T3E: f90 {-G0 or -G1} source.f G0 Will give debugging symbols at all executable statements G1 Will keep some of the optimization (faster runs, fewer breakpoint locations) totalview -X 3 -grayscale -bg white On the SP: mpxlf -g source.f module load totalview totalview poe -a./a.out -nodes 2 -procs 4 -rmpool 1

4. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Initial TotalView window

5. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: With the left mouse button choose File With the left mouse button choose Load New Program

6. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Enter Executable Name (“a.out”), then click Apply

7. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Process_window will appear.

8. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: Initial TotalView windows 2 windows will open, one with poe in its title bar, and the other with TotalView and its version number.

9. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: With the left mouse button choose File in the process window

10. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: With the left mouse button choose Control

11. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: With the left mouse button choose Events

12. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: With the left mouse button choose Source

13. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: In the poe window, click the middle mouse button. A small menu window will appear, which contains many options.

14. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, select: Arguments/Create/Signal SP: While holding the middle mouse button in the poe window, select: Arguments/Create/Signal

15. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, choose: Go/Halt/Step/Next/Hold SP: While holding the middle mouse button in the poe window, choose: Go/Halt/Step/Next/Hold

16. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, choose: Function/File/Variable SP: While holding the middle mouse button in the poe window, choose: Function/File/Variable

17. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, choose: Current/Update/Relatives SP: While holding the middle mouse button in the poe window, choose: Current/Update/Relatives

18. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, choose: Display/Directory/Edit SP: While holding the middle mouse button in the poe window, choose: Display/Directory/Edit

19. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, choose: STOP/BARR/EVAL/ELOG SP: While holding the middle mouse button in the poe window, choose: STOP/BARR/EVAL/ELOG

20. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, choose: Process State Info SP: While holding the middle mouse button in the poe window, choose: Process State Info

21. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, choose: Search for String SP: While holding the middle mouse button in the poe window, choose: Search for String

22. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, choose: Save Window to File SP: While holding the middle mouse button in the poe window, choose: Save Window to File

23. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: While holding the middle mouse button in the poe window, choose: Go/Halt/Step/Next/Hold then choose Go Group SP: While holding the middle mouse button in the poe window, choose: Go/Halt/Step/Next/Hold then choose Go Group This starts the code running, and produces the window shown in the next slide

24. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: It is good to answer yes, here, so you can add some breakpoints.

25. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: In the AIX window you will see the 4 processors are ready. The poe window will show the source code

26. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Setting a breakpoint: Left-click on the box at line 12 T3E: Setting a breakpoint: Left-click on the box at line 12

27. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Left- click on Run

28. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: The program stopped at line 12 Notice we are looking at PE 0 T3E: The program stopped at line 12 Notice we are looking at PE 0

29. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Click on the PE button. Now we are looking at PE 2. T3E: Click on the PE button. Now we are looking at PE 2.

30. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: Click the left mouse button on the rectangle at line 9, to set a breakpoint In the poe window click on the “P^” button, to see the code at processor 1

31. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: Notice the different color in lower panes, and that I changed the breakpoint from line 9 to line 10.

32. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Displaying a variable’s value: Left-click on the variable, “x5” and a data object window will open. This action is called “diving” on a variable. T3E: Displaying a variable’s value: Left-click on the variable, “x5” and a data object window will open. This action is called “diving” on a variable.

33. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Click the “Continue” button, and notice the value of “X2” changes to “NaN”

34. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: Choose Go/Halt/Step/Next/Hold then Go Group SP: Choose Go/Halt/Step/Next/Hold then Go Group

35. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: The code ran up to the breakpoint. If we right- click on the box at the left of line 12, we get an eval window.

36. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Using EVAL: Right -click on the box at line 15, to get the breakpoint window shown in the next slide T3E: Using EVAL: Right -click on the box at line 15, to get the breakpoint window shown in the next slide

37. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: In the breakpoint window we can use a C or Fortran expression to control action at a breakpoint

38. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: After clicking on “Cont”, the code will stop at line 15 when the expression becomes true

39. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Verify the EVAL point worked, by left-clicking on I, to check its value

40. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: If we right- click on the box at the left of line 12, we get an Eval window.

41. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: In the eval window we can select a type of “Breakpoint”, or specify expression evauation, as shown in the next slide

42. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: In the Evaluate Expression box, specify a condition (in Fortran or C syntax) which will make the code stop; in this case stop when i = 10.

43. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: Notice that the box at the left of line 12 says “eval”. I have also added a breakpoint on line 19. SP: Notice that the box at the left of line 12 says “eval”. I have also added a breakpoint on line 19.

44. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: Here’s what happens when we continue executon - one processor stops at line 12, when the condition becomes true.

45. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: In the stack trace window we click on “.test” so we can go back to the source code. We can see the code is stopped at the “eval” point. SP: In the stack trace window we click on “.test” so we can go back to the source code. We can see the code is stopped at the “eval” point.

46. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: To view the value of variable “I”, right-click on that variable in line 12. Another window will show up which shows the values. SP: To view the value of variable “I”, right-click on that variable in line 12. Another window will show up which shows the values. To view the values of variable “x”, click on it.

47. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: Middle-click on the “Static in.test” window, and another window shows up which has many options.

48. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: By choosing “Visualize” we can get the following graph: It shows a plot of the element values of the array “x”. SP: By choosing “Visualize” we can get the following graph: It shows a plot of the element values of the array “x”.

49. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: How to attach TotalView to a running job: Run TotalView, then in the File Menu, choose “Unattached Processes” T3E: How to attach TotalView to a running job: Run TotalView, then in the File Menu, choose “Unattached Processes”

50. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Left-click on the desired process (“a.out”)

51. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: The program should appear in a process window.

52. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: How to attach TotalView to a running job: Run TotalView, then click the midle mouse button in the AIX TotalView window. Choose Show All Unattached Processes SP: How to attach TotalView to a running job: Run TotalView, then click the midle mouse button in the AIX TotalView window. Choose Show All Unattached Processes

53. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: A Processes window will show. Choose the poe job which is running and we are trying to attach using TotalView.

54. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: A query window will appear; you should say yes.

55. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: Now the program is attached.

56. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems T3E: Online help can be used using the Help button.

57. N ATIONAL E NERGY R ESEARCH S CIENTIFIC C OMPUTING C ENTER June, 2000TotalView on the T3E and SP Systems SP: For Help click on the middle button in the AIX TotalView window and choose Help