Teaching Functional Verification: Lab Mechanics Design Automation Conference Sunday, June 9, 2002.

Slides:



Advertisements
Similar presentations
Test Yaodong Bi.
Advertisements

Lecture 8: Testing, Verification and Validation
1 State of Connecticut Core-CT Project Projects/Contracts Subject Matter Expert (SME) Kickoff March 7, 2007.
Annoucements  Next labs 9 and 10 are paired for everyone. So don’t miss the lab.  There is a review session for the quiz on Monday, November 4, at 8:00.
Copyright © The OWASP Foundation Permission is granted to copy, distribute and/or modify this document under the terms of the OWASP License. The OWASP.
IBM Haifa Research Lab IBM Haifa Labs An Open Source Simulation Model of Software Testing Shmuel Ur Elad Yom-Tov Paul Wernick
Minor program 1 Aerospace Systems Design & Technology Goals: To introduce the student to the relationships between physical processes and their numerical.
EE694v-Verification-Lect5-1- Lecture 5 - Verification Tools Automation improves the efficiency and reliability of the verification process Some tools,
Slide 1. Slide 2 Administrivia Nate's office hours are Wed, 2-4, in 329 Soda! TA Clint will be handing out a paper survey in class sometime this week.
1 CIS 100 Winter 2005 Week 10 Lecture Dr. David Gadish.
Design, Implementation and Maintenance
Software Testing Test Design and Implementation. Agenda Test Design Test Implementation Test Design Sources Automated Testing 2.
1 TCSS 360, Spring 2005 Lecture Notes Testing Relevant Reading: Object-Oriented Software Engineering, Ch. 9 B. Bruegge, A. Dutoit.
Nyhoff, ADTs, Data Structures and Problem Solving with C++, Second Edition, © 2005 Pearson Education, Inc. All rights reserved Software.
Software Quality Assurance and Testing prof. A. C. (Alex) Telea Course description.
Software Testing. Recap Software testing – Why do we do testing? – When it is done? – Who does it? Software testing process / phases in software testing.
1 Software Testing (Part-II) Lecture Software Testing Software Testing is the process of finding the bugs in a software. It helps in Verifying and.
Module CC3002 Post Implementation Issues Lecture for Week 6 AY 2013 Spring.
© 2012 IBM Corporation Rational Insight | Back to Basis Series Chao Zhang Unit Testing.
CPIS 357 Software Quality & Testing
Software Systems Verification and Validation Laboratory Assignment 3 Integration, System, Regression, Acceptance Testing Assignment date: Lab 3 Delivery.
Software testing basic. Main contents  Why is testing necessary?  What is testing?  Test Design techniques  Test level  Test type  How to write.
Software Testing Testing principles. Testing Testing involves operation of a system or application under controlled conditions & evaluating the results.
1 Agenda Administration Background Our first C program Working environment Exercise Memory and Variables.
SOFTWARE TESTING Scope of Testing  The dynamic Indian IT industry has always lured the brightest minds with challenging career.
ECEN 301Discussion #1 – Syllabus1 All Sections MWF 1:00 – 1:50 PM 256 CB Lecture: MW Recitation: F Labs: M or Th Instructor: Prof. David Long Office: CB.
Testing Basics of Testing Presented by: Vijay.C.G – Glister Tech.
Teaching Functional Verification – Course Organization Design Automation Conference Sunday, June 9, 2002.
1 Life Cycle of Software Specification Design –Risk Analysis –Verification Coding Testing –Refining –Production Maintenance.
PowerPoint Presentation for Dennis, Wixom, & Tegarden Systems Analysis and Design with UML, 3rd Edition Copyright © 2009 John Wiley & Sons, Inc. All rights.
Teaching Software Testing as a Problem-based Learning Course Stephanie Ludi Software Engineering Dept. Rochester Institute of Technology
Week 9 Data structures / collections. Vladimir Misic Week 9 Monday, 4:20:52 PM2 Data structures (informally:) By size: –Static (e.g. arrays)
Test Plan Objectives of Test Plan Product –May need to sell test plan Military mil spec FDA specs Phone company (need to support after your company.
Verification and Validation Assuring that a software system meets a user's needs.
What is Testing? Testing is the process of finding errors in the system implementation. –The intent of testing is to find problems with the system.
SPAM Student Payroll And Management. SPAM Overview " Project Plans " Student functions " Administrator functions " Detailed Design " Technical Specifications.
Verification – The importance
Software Testing and Software Quality Assurance Process.
Lab Exercise Management Steven P. Levitan, University of Pittsburgh Design Automation Conference Sunday, June 9, 2002.
CSI 1340 Introduction to Computer Science II Chapter 1 Software Engineering Principles.
Lecture 1 – Overview (rSp06) ©2008 Joanne DeGroat, ECE, OSU -1- Functional Verification of Hardware Designs EE764 – Functional Verification of Hardware.
1 Software Testing Strategies: Approaches, Issues, Testing Tools.
HNDIT23082 Lecture 09:Software Testing. Validations and Verification Validation and verification ( V & V ) is the name given to the checking and analysis.
Teaching Functional Verification – Course Organization Design Automation Conference Sunday, June 9, 2002.
Lecture 1 – Overview (rSp06) ©2008 Joanne DeGroat, ECE, OSU -1- Functional Verification of Hardware Designs EE764 – Functional Verification of Hardware.
Manual Testing Concepts Instructor: Surender. Agenda  Content: 1. Testing Overview I. What is testing II. Who does testing III. When to Start Testing.
Test Automation Steffen Goerlitz Barry Lange Mitchell Meerman Harry Schultz Trevor Spees.
 Software reliability is the probability that software will work properly in a specified environment and for a given amount of time. Using the following.
1 March 12, Testing William Cohen NCSU CSC 591W March 12, 2008.
Cs498dm Software Testing Darko Marinov January 26, 2012.
Advanced Software Engineering Dr. Cheng
Software Testing Strategies for building test group
Regression Testing with its types
SOFTWARE TESTING OVERVIEW
Testing in CS1 Lennie Cooper Kevin Lawrence LeAndrew Davis
Software testing strategies 2
Lecture 09:Software Testing
RTL Design Methodology
Testing and Test-Driven Development CSC 4700 Software Engineering
IMPORTANT NOTICE TO STUDENTS:
Teaching Functional Verification – Course Organization
EECS150 Fall 2007 – Lab Lecture #4 Shah Bawany
Workshop.
ECE 554 Digital Engineering Laboratory Nam Sung Kim (Chunhua Yao –TA)
Summary.
Mathematical Reasoning
Chapter 13: Construction
RTL Design Methodology
Digital Engineering Laboratory
Software Development Chapter 1.
Presentation transcript:

Teaching Functional Verification: Lab Mechanics Design Automation Conference Sunday, June 9, 2002

Agenda Administration Lab 1 Lab 2 Lab 3 Grading

Administration Length of labs Lab 1 – 1 week Lab 2 – 4 weeks Lab 3 – 4-6 weeks Instructor/TA Availability Lab 1 – /office hours Lab 2 – /office hours/1-2 lab days Lab 3 – /office hours/3-4 lab days

Administration (continued) Website with lab specifications Student Message Board Students helping students Monitored/Administrated by Instructor Student Team Sizes Lab 1 – Individual Lab 2 – Individual Lab 3 – Individual or groups of 2 Individual requires more time

Lab 1 Focused on directed type testing Black box approach No visibility into RTL Input to output type tests Bus Functional Models (BFM) provided Students need only to use the BFM ’ s Bugs fixed by setting “ error ” input signal Students hand in bug analysis

Post Lab 1 exercise Discuss deficiencies of lab 1 Specification Directed nature Discuss better approach Pseudo-random stimulus Self-checking Discuss nature of bugs

Lab 2 Build upon lab 1 and lecture material Given starting point reference from solution (better approach) of lab 1 Introduce High Level Verification Languages (HVL ’ s) Grey box approach Provide a testplan from lab 1 Introduce students to debug

Lab 2 (continued) Bug fixes are done by “ forcing ” internal nets If using VHDL, use procedures with FLI calls This reduces instructors maintenance work load on design If using Verilog/HVL, force nets directly Introduce students to “ regression ” Provide ability for students to regress Students hand in testplan and bug analysis

Post Lab 2 exercise Discuss deficiencies of lab 2 When are we done? Coverage Maintenance of code in environment Lab 1 solution not well commented Reuse Discuss nature of bugs Establish Coding guidelines for regression purposes (pass, fail, etc)

Lab 3 Builds upon lab 2 and lecture material Provide lab 2 solution Coverage oriented Provide mechanism for code coverage Provide functional coverage goals Testplan becomes more of a functional coverage plan Same approach as lab 2 for bug fixes and debug Students hand in testplan

Grading Lab 1 Bug analysis Lab 2 Testplan and bug analysis Lab 3 Perform “ escape analysis ” for each group “ Panel ” session What bugs were found What techniques were used Poke holes in environment Ensure environment followed testplan

Grading (continued) Complete bug discovery isn ’ t necessary for “ A ” Testplan Environment Methodology

Summary Each lab builds upon itself Emphasizes reuse and maintenance Labs emphasize lecture material Testplan Pseudo-random Self-checking Regressions Coverage

Summary (continued) Labs are time intensive Students time Instructors time May opt to have some classes as “ lab sessions ” depending on schedule and syllabus