Civil/Structural Engineering GTSTRUDL Software QA/QC as an Example of Conformance to the U.S.A. Nuclear Regulatory Commission’s Rigorous Quality Assurance and Quality Control Requirements for Safety Critical Structural Engineering Software (Beginning in 1983) Leroy Z. Emkin , Ph.D., P.E., F.ASCE Founder and Co-Director Computer Aided Structural Engineering Center Georgia Institute of Technology Atlanta, Georgia 30332-0355 U.S.A. Tel: +1-404-8942260 Fax: +1-404-8948014 email: casec@ce.gatech.edu Web Page: www.gtstrudl.gatech.edu July 6, 2019 Civil/Structural Engineering

Conformance to applicable provisions of the: GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable provisions of the: United States Nuclear Regulatory Commission (U.S. NRC) Rules and Regulations, Volume 10, Code of Federal Regulations, Part 50, Appendix B, Quality Assurance Criteria for Nuclear Power Plants and Fuel Reprocessing Plants (NRC 10CFR50, Appendix B). United States Nuclear Regulatory Commission ("U.S. NRC") Rules and Regulations, Volume 10, Chapter 1, Code of Federal Regulations - Energy, Part 21, Reporting of Defects and Noncompliance (NRC 10CFR21). American Society of Mechanical Engineers for the American National Standards Institute "Quality Assurance Requirements for Nuclear Facility Applications“ (ASME NQA-1-2000). International Standards Organization (ISO) "Guidelines for the Application of ISO 9001 to the Development, Supply and Maintenance of Software“, ISO 9000-31991 (ISO 9000-3).

GTSTRUDL QA/QC Requirements of the U. S. A GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set)

GTSTRUDL User Reference Manual 16 Volume Set (over 8,000 pages)

GTSTRUDL QA/QC Requirements of the U. S. A GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document)

Conformance to applicable NRC requirements GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Education Experience Knowledge and areas of specialization Programming skills Awareness of, and commitment to, QA/QC procedures

Conformance to applicable NRC requirements GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software: (Approximately 1.8 Million Lines of Code & 9,000 Subprograms) Why was the change made Who made the change When was the change made Where in the program was the change made Who developed the test problems When were the test problems run What was the result of the test problems What Manager signed and verified that the change process was conducted in accordance with NRC quality regulations and the GTSTRUDL QA/QC Procedures Manual

Civil/Structural Engineering GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software Base Verification Manual published for each new version of software (3 Volumes, 2,150 pages) July 6, 2019 Civil/Structural Engineering

Civil/Structural Engineering GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software Base Verification Manual published for each new version of software (3 Volumes, 2,150 pages, 303 test problems) July 6, 2019 Civil/Structural Engineering

GTSTRUDL Base Verification Manual Volumes 1, 2, & 3 (2,150 pages)

GTSTRUDL QA/QC Requirements of the U. S. A GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software Base Verification Manual published for each new version of software (3 Volumes, 2,150 pages, 303 test problems) General QA/Validation Test Problems

Civil/Structural Engineering GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software Base Verification Manual published for each new version of software (3 Volumes, 2,150 pages, 303 test problems) General QA/Validation Test Problems (more than 3,100 test problems) July 6, 2019 Civil/Structural Engineering

GTSTRUDL QA/QC Requirements of the U. S. A GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software Base Verification Manual published for each new version of software (3 Volumes, 2,150 pages, 303 test problems) General QA (more than 3,100 test problems) Archive each new version of software

Civil/Structural Engineering GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software Base Verification Manual published for each new version of software (3 Volumes, 2,150 pages, 303 test problems) General QA (more than 3,100 test problems) Archive each new version of software (40 Years) July 6, 2019 Civil/Structural Engineering

GTSTRUDL QA/QC Requirements of the U. S. A GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software Base Verification Manual published for each new version of software (3 Volumes, 2,150 pages, 303 test problems) General QA (more than 3,100 test problems) 40 Year Archive for each new version of software Audits by end-users regulated by the NRC

Civil/Structural Engineering GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Audits by end-users regulated by the NRC It is the responsibility of the design company that is regulated by the U.S. NRC to pass the responsibility for conformance to NRC's quality standards to the vendor (i.e., supplier) of the structural analysis and design software. Each such regulated company must perform all necessary audits of the structural software vendor and report the results of such audit to both the software vendor and the U.S. NRC. The audit report identifies any deficiencies found, and requires that all deficiencies be corrected. If any identified deficiencies are not corrected within the required period of time, then the software which is the subject of the audit is removed from the list of approved safety related software products. July 6, 2019 Civil/Structural Engineering

Civil/Structural Engineering GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software Base Verification Manual published for each new version of software (3 Volumes, 2,150 pages, 303 test problems) General QA (more than 3,100 test problems) 40 Year Archive for each new version of software Audits by end-users regulated by the NRC (4 to 6 times per year!) July 6, 2019 Civil/Structural Engineering

GTSTRUDL QA/QC Requirements of the U. S. A GTSTRUDL QA/QC Requirements of the U.S.A. Nuclear Regulatory Commission’s Safety Critical Structural Engineering Software Conformance to applicable NRC requirements Comprehensive User Documentation (16 Volume Set) QA/QC Procedures Manual (123 page document) Proof of developer qualifications Detailed records of changes to software Base Verification Manual published for each new version of software (3 Volumes, 2,150 pages, 303 test problems) General QA (more than 3,100 test problems) 40 Year Archive for each new version of software Audits by end-users regulated by the NRC (4 to 6 times per year!)

GTSTRUDL Quality Assurance Agreement QA Agreement Between an NRC Regulated End-User Company and the Georgia Tech Research Corporation US$12,000 for the first year of the QA Agreement US$6,600 per year thereafter July 6, 2019 Civil/Structural Engineering