OpenSG and Conformity Bruce Muschlitz EnerNex Corporation Knoxville October 2009

UCAIug Org Chart 2009

IEC (Edition 1) Part 4 : System and Project Management –Clause 7 : Quality Assurance : Conformance Test Part 10 : Conformance Testing –Clause 5 Conceptual test model Use of SCL files –Clause 6 : Abstract server tests –Clause 7 : Performance tests –Annex A : Detailed test procedure templates

IEC 61850ug Committee TISSUE database Maintain portion of the Quality Assurance Program (QAP) –Test Architecture (network based) –Conformance Building Blocks (CBBs) –Test report requirments Recommend extensions to standards Write “application notes”

Testing Committee Maintain lists : –Accredited testers –Conformance tested devices Maintain documents –Quality Assurance Program (basic) –Accreditation Procedure –Platform testing –Detailed Test procedures (ex: servers) Resolve interoperability disputes Accredit (and annually re-accredit) testers

Testing Procedures sub-committee Collect testing needs from users/vendors Assist with abstract tests creation – has basic server abstract tests –Ex : “Verify can extract data dictionary” Create detailed tests from abstract tests – provides a template Name and purpose of test References to standard clause(s) Expected results Test description

61850 Testing – What’s missing? Performance Testing : timing, accuracy, etc Inter-operability testing Plug-fests: but what is the purpose? –Technology demonstrations (this stuff works) –Vendor marketing (our stuff works) System (end-to-end) testing Environmental testing (EMC, etc.) Regulatory tests (ex: FCC emission tests)

Conformance vs. Inter-operabilty testing Definitions –Conformance : Does it meet every item in spec? –Inter-operability : Can it work with ANY Conformance Certified device? Conformance != Inter-operability

Conformance vs. Inter-op testing (cont.) Conformance Closed test Negative Test 1 “synthetic” others Environmental testing (EMC, temp, etc.) Easy to prove result Interoperabilty Open test Negative test Many “real” others Human environment Result dependent on “when” test was run Both Conformance and Inter-op are needed –First verify each device Conformance

How can help OpenSG has already paved the path Templates –QAP addendum for exists –Abstract Conformance test procedures –Detailed Conformance test procedures –Distribute “the good word on tested products” Unfortunately, no interop testing done –UCAIug can assist with plug-fests –Virtual plug-fests?

Next Steps We are not starting from scratch Abstract / detailed tests already exists Re-organized to fit UCAIug mold? –Synergies between OpenSG and exist –This will involve additional work –Industry will see as a positive move –If we move, CIM may follow (good for UCAIug)

Questions? Contact information: Bruce Muschlitz - Kay Clinnard - Testing documents: Testing/default.aspx -UCAI Testing Quality Assurance Program -Current IEC Testing Procedures