1. A Quantitative Completeness Analysis for Property-Sets
Martin Oberkönig
Martin Schickel, Hans Eveking
Computer Systems
Group
A Quantitative Completeness Analysis for Property-Sets, November 2007

2. A Quantitative Completeness Analysis for Property-Sets, November 2007
Overview
Introduction
Completeness Metric
Normalization & Dependencies
Experimental Results
Conclusions
basic environment is clear after the recent presentations
giving the motivation leading to the metric
analysis flow
result & conclusion
A Quantitative Completeness Analysis for Property-Sets, November 2007

3. A Quantitative Completeness Analysis for Property-Sets, November 2007
Motivation
how many?
Properties
sufficient?
major advantage: no design needed
IP properties
A Quantitative Completeness Analysis for Property-Sets, November 2007

4. A Quantitative Completeness Analysis for Property-Sets, November 2007
Gap
Complete
Properties
X% complete
A Quantitative Completeness Analysis for Property-Sets, November 2007

5. A Quantitative Completeness Analysis for Property-Sets, November 2007
Completeness Metric + c a 1
a  c
ab  c
Consistent example: b
Example:
a  c
b  c ?
No inconsistencies allowed
During verification only one prop holds
CMOS
drivers
A Quantitative Completeness Analysis for Property-Sets, November 2007

6. A Quantitative Completeness Analysis for Property-Sets, November 2007
Completeness Metric + c a
a  b
undetermined cases
determined cases
(a  b)
a  b
full symbolic representation of the gap
a  c
a  b  c
A Quantitative Completeness Analysis for Property-Sets, November 2007

7. Completeness Metric + a degree of determination = c = = 75 % v1 out v0
a  b v1 v0
out
degree of determination = =
= 75 %
A Quantitative Completeness Analysis for Property-Sets, November 2007

8. A Quantitative Completeness Analysis for Property-Sets, November 2007
1. Problem:
Required: Properties constraining only one single signal
Real World: Arbitrarily written properties
property amba_address_increment is
assume:
at t: HTRANS=cSEQ or HTRANS=cNONSEQ; -- beat performed
at t: isINCBURST; INCR burst
at t: HREADY='1'; transfer complete
prove:
at t+1: HADDR = (PREV(HADDR) +
shift_left(" ",HSIZE))(31 downto 0)
or HTRANS=cNONSEQ or HTRANS=cIDLE;
end property; or burst finished
complete MV360 language supported
Solution: Normalization Algorithm
A Quantitative Completeness Analysis for Property-Sets, November 2007

9. A Quantitative Completeness Analysis for Property-Sets, November 2007
2. Problem:
true  a  b
a  b b  a
a  b b  a ?
100% determination for b
100% determination for a
Solution:  Property dependency graph
 Fixpoint iteration
A Quantitative Completeness Analysis for Property-Sets, November 2007

10. A Quantitative Completeness Analysis for Property-Sets, November 2007
Experimental Results (Overview)
Component
Prop.
normal. Prop.
Analysis Time
ATM Error Controller 5 7
0.1 s
AMBA Slave 8
497
0.69 s
AMBA Master 20
3290
7.3 s
A Quantitative Completeness Analysis for Property-Sets, November 2007

11. A Quantitative Completeness Analysis for Property-Sets, November 2007
Results (Detailed)
Component
Signal
Output / Internal
Determi-nation
ATM Error Controller
reject_it
correct_it
out
100%
AMBA Slave
act_master(3..0)
split_master(15..0)
selected
hsplit(15..0)
hresp(1..0)
hready
hrdata(31..0)
int
49%
21% 0%
A Quantitative Completeness Analysis for Property-Sets, November 2007

12. A Quantitative Completeness Analysis for Property-Sets, November 2007
Conclusion
Property-set analysis leading to a metric
Full symbolic representation of the gap
No design needed
100% complete ≠ error-free
Ongoing work:
Degree of freedom
Interpretation of the metric
A Quantitative Completeness Analysis for Property-Sets, November 2007

13. Thanks for your attention!
Any Questions?
A Quantitative Completeness Analysis for Property-Sets, November 2007

14. A Quantitative Completeness Analysis for Property-Sets, November 2007
more Results
Component
Prop.
normal. Prop.
Analysis Time
FIFO
(K. Claessen) 6
120
0.26 s
Component
Signal
Output / Internal
Determi-nation
FIFO
(K. Claessen)
err
num(1..0)
num(3..2)
first(15..0)
out
75%
70%
37%
46%
A Quantitative Completeness Analysis for Property-Sets, November 2007