1. 1 NTL Internal IA Analysis Sept 09

2. 2 NTL Internal Internal Audits Observations : Base data for analysis increased 525 audits in last analysis vs 247 audits in this analysis 1210wtd NCs in last analysis vs 935wtd NCs in this analysis No of wtd NCs/Audit increases 2.30 from last analysis to 3.79 this time Over all no of NCs decreases in every area from last period Major contributor are still LCA, PMC, CM and PM areas. Except Kolkata LCA is the major contributor among all Wtd NCs decrease in all areas at org level. NCHK has decreased to 34%, lowest in last 3 period. Audit effectiveness Increased, over last period.

3. 3 NTL Internal IA Analysis – All locations

4. 4 NTL Internal IA Analysis – at locations

5. 5 NTL Internal IA Analysis -

6. 6 NTL Internal Base data analysis No. of NCs per audit increases significantly from last period (2.3 to 3.79), Perform Pareto analysis to find the most common problem area (attached in next slide) Most of NCs are coming from LCA, PP,PMC and CM area NCs from same areas are repeating and has major contribution, for example 4.1 or 4.2 in PMC or 7.1 or 7.23 in LCA These 4 covers 75% of total audit NCs PMC and LCA are among the top in these 4. LCA has most no of NCs in all location except Kolkata NCs from same areas are repeating and has major contribution, for example 7.1 or 7.23 in LCA has the most no of audits Alternative approach does not have any NCs. No. of NCs are very low on Metrics analysis and Causal such as (7.6 to 7.9, 7.16, 7.17) PMC is the second contributor in all location except Kolkata In PMC too most of the NCs are coming from some specific area which are repeated from last analysis such as 4.1, 4.2, 4.9 and 4.12 4.17(revision of QPM goals) and 4.18(reusable component) has least no of NCs.

7. 7 NTL Internal Base Data Analysis CM also has major contributor The audit –NC ratio does not improve much in CM, but the Coverage at CM level has improved (most of the NC’s in last period are distributed in 3 major area whereas this time it is 6 areas 5.1 and 5.10 are the are from where most of the NCs are coming. The Audit coverage and audit effectiveness has improved from last period.

8. 8 NTL Internal Causal for IA data Improvement on metrics analysis at organization in respect of CMMI L4&5 PAs, which is a problem identified during internal CMMI assessment held in. First level of data analysis -Pareto analysis of NC data

9. 9 NTL Internal Causal for IA data Next level of data analysis PPPMCLCA Checked 244128882881 Not Checked 172217753597 Sum 416346636478 Coverage 58.64%61.93%44.47% LCAPPPMC Overall Total Frequency 129077810343102 NCHK+NA 6373733981408 49.38%47.94%38.49%45.39% Looking the coverage of checklist point for these area Looking coverage of Metric related points during audit PPPMCLCA NC+C 2246361586 NC 2123126 9.38%3.62%7.94% Percentage of NC reported for the metrics related data

10. 10 NTL Internal Causal Fish Bone Improve Metrics analysis for L 4&5 Coverage Awareness of Project team Awareness of IA Less more than 60% points are not checked in each audit Repeated checklist points are covered in each audit Lack of analysis on audit findings and using any SPC tool to prevent the same. Lack of supporting guidelines for using right kind of analysis tool Auditors awareness on high maturity areas Understanding of SPC tools and lack of guidelines to validate the same Variance of NC areas in case of SEPG audit or some specific IAs Metrics analysis points checked only 0.065% time.

11. 11 NTL Internal Action points from the analysis Conduct awareness session for auditors, QMs, PMs for audit coverate, high maturity areas and SPC tools Create/modify supportive documents and release the same in QMS for analysis and IA Release SPC template which can be used by projects for various kind of analysis Focus on CM audit area Best auditor of the quarter to be published on Awareness

12. 12 NTL Internal IA Analysis -

13. 13 NTL Internal IA Analysis -

14. 14 NTL Internal Action points from current analysis Workshop for all executing auditors Value-add from audit process.. More focus on delivery IA analys

15. 15 NTL Internal Thank You