1. Retrieving and Analyzing Data Using the QVR System Scientific Program Staff

2. 2 QVR—Major Features Extensive capabilities for searching and selecting Grants and Grant applications Extensive capabilities for generating standard reports and downloading into Excel for custom reports Added in the past year: –Person Search (NIH or Op/Div) –History Search (back to ~1970) –Link to PubMed (publications related to applicant or grantee) –Budget Reports –Accommodations for NIH RoadMap –Extensive Training and online Tutorials

3. 3 Management Approach Agile Project Management (Very suitable for reporting systems, consensus building and obtaining buy-in) Small team with low turnover Monthly rollout of significant new functions or enhancements –Even quicker when feasible Problems typically resolved within one day (including software fixes) Promote design change during all pre-production phases Daily interaction with customers (as partners) Careful and complete testing (three stages)

4. 4 Usage of the QVR System The number of Logons System to the QVR and the number of searches has increased dramatically. Currently 6,000–7,000 Queries/Drill-downs per workday! Searches/MonthLogons/Month (November) 60,000 30,000 0 2002200320042002200320042001 10,000 20,000 0

5. 5 The QVR Principle: The system must be USER-FRIENDLY and USER-DEFINED

6. 6 NIH Staff Person Schematic of QVR System IMPAC II OLTP DATA WAREHOUSE QVR APPLICATION Internet Browser IMPAC II IRDB Intramural Database

7. 7 Logon QVR Search Capability of the QVR System QVR (1) (2) (3) (Original/New/Quick) Search Screens (5) QVR Person Search Screen (4) QVR History Search Screen Allows for searches in IMPAC data back to 1970 Standard Hitlist and Record Count Allows for searches for all persons in the in IMPAC database (applicants/grantees/c ommittees) for last 12 years.

8. 8 Program-Related Functions in QVR Search Capabilities All Specific groups of projects can easily be identified via QVR. Data is staged for QVR on a nightly basis from the IRDB, OLTP and Central Accounting System (CAS). Users can search on a variety of search criteria including: Centers, training, fellowships, RFAs/PAs, council round, awarded status, Program Official name, etc. Search Screen has specific Program/Review Section

9. 9 Program-Related Functions in QVR Select

10. 10 Program-Related Functions in QVR

11. 11 Program-Related Functions in QVR Select

12. 12 Program-Related Functions in QVR

13. 13 Program-Related Functions in QVR Search Capabilities It has two “Public Queries" specifically designed to retrieve projects relating to Scientific Programs. eSNAP Available Pending Review Pending Council Pending Award A series of Population Tracking Reports

14. 14 Search Capabilities Select “Retrieve Query” then “Public Query” to access “Program” Public Queries

15. 15 HTML Excel® Access® PivotTables® Search Screen Logon QVR Functionality of the QVR System Hit List LINKS Snapshot PI/Grant History Publication history Abstract Summary NGA Sub-Projects Application image LINKS Snapshot PI/Grant History Publication history Abstract Summary NGA Sub-Projects Application image Basic Hit list (Detailed) Summary Hit list Enter Output Format Enter Search Criteria Print Central PDF Zip File Résumé Hit list Custom Download Standard Reports Excel® MS Word®

16. 16 “Program-Related” Functions in QVR Hitlist Features The hitlist has a series of links: Application snapshot, summary statement, abstract, NGA, grant history, application image grant related publication and PI publications. Snapshot: The hitlists generated in QVR have a link to a Snapshot of every record. For training grants the Snapshot has a section that details the current appointees (see next slides).

17. 17 QVR Hitlist Features Select Click on envelope to send email to Program Official Click on envelope to send email to PI. Click on PI name to retrieve PI Information— Committee service Publication history, etc Click to retrieve application image Search Criteria

18. 18 Snapshot Features This section lists all trainees on the training grant This is a Grant Snapshot of a T32. This section lists budget allocations

19. 19 Program-Related Data Features Custom Download Capabilities The Custom Download allows the user to download a variety of data items Over 250 Downloadable Data Items Abstract Text Training/Fellowships—many data items. NIH Staff Contacts Application/Grant Data

20. 20 Custom Download Capabilities Select Note: Search criteria

21. 21 User may download data in HTML format, to an Excel spreadsheet or as a *.CSV file (Access) Custom Download Capabilities These are a few of over 250 data items that may be downloaded Select To view a full list of the downloadable data items click on “Column Glossary”

22. 22 Custom Download—HTML Format

23. 23 The following slides illustrate how to access these Standard Reports QVR has 33 Standard Reports. Many of these specifically relate to Scientific Programs. Program-Related Standard Reports

24. 24 The following slides illustrate how to access these Standard Reports QVR Has 33 Standard Reports

25. 25 Standard Reports Select

26. 26 Standard Reports Select These are the Standard Reports that provide specific Program-related information

27. 27 Standard Reports Note: Options to customize Standard Report Select

28. 28 Review Meeting Information Standard Reports—PivotTable Note: PivotTable format allows the user to easily manipulate the data and incorporate additional data items

29. 29 Review Meeting Information Standard Reports—PivotTable Note: PivotTable is manipulated to provide convenient summary table

30. 30 Standard Reports Grant Snapshot User may select any combination of snapshot sections Select

31. 31 Standard Reports Grant Snapshot Scroll to Bottom of Snapshot

32. 32 Standard Reports Grant Snapshot Note: Training Information

33. 33 Potential Areas where QVR could be enhanced to meet the needs of Scientific Programs Additional Program-related items on search screen Additional Public Queries useful to Program Officials Additional Hitlist formats Program-related items added to custom download Creation of Public “Lists” of downloadable data items Modification of existing Standard Reports Additional Program-related Standard Reports

34. 34 Development Process Used by QVR Team QVR team will work with ePUG to develop concept for additional information QVR team will develop prototype feature in close collaboration with staff Prototype of feature will be quickly developed Prototype version of feature will be tested by extramural staff Feature will be refined as needed in close collaboration with staff New feature will be moved into production version of QVR as soon as acceptable by staff Feature may be further refined even though it is in production