By: Farzad H. Eskafi feskafi@sparcIt.com

SparcIt Overview Key Accomplishments Summary Large-scale automated creativity assessment Open-ended Exercises Semantic-based Psychometric Model Machine Learning, Data Mining, Comp Linguistics Funded by National Science Foundation San Francisco, CA Key Accomplishments Over 30,000 assessments Benchmark 161 different countries 16 industries 12 departments 11 positions & roles Farzad H. Eskafi Co-founder, CEO Kenes Beketayev, PhD Co-founder, CTO Machine Learning

Creativity Quotient (CQ) (Semantic based Psychometric Approach) How to Measure Creativity? Creativity Quotient (CQ) (Semantic based Psychometric Approach) Flexibility Originality Elaboration Fluency # of unique & relevant responses # of distinct categories represented Measure of statistical infrequency of responses Measure of details per each idea 50+ years of academic research 30+ years of operational research Measuring abilities (not personalities) No survey type questions Game-like open-ended exercises to measure and enhance

What do participants see? Open-ended Exercises 2-page report

Research Summary Overview Assessments: Partnership with: N = 15,000+ users 30,000+ assessments were administered 30+ studies Internal Reliability Concurrent Validity Test-Retest 300+ verified item Assessments: Minimum of 5 items (can be 3 items) At least 3 min per each item Partnership with: SUNY Buffalo University of Georgia at Athens Princeton University Stanford University Private Pilots

Internal Reliability Across Studies Originality Flexibility Fluency Elaboration BuffaloS15 (n=7,434) 0.73 0.70 0.82 0.89 IntStudy14 (n=7,228) 0.84 0.79 0.71 0.81 Coefficient of Internal Consistency: Analysis must be done per index per exercise. α ≥ 0.9 : Excellent (High-Stakes testing) 0.7 ≤ α < 0.9: Good (Low-Stakes testing) 0.6 ≤ α < 0.7: Acceptable 0.5 ≤ α < 0.6: Poor α < 0.5: Unacceptable Average result is above 0.7 which is ideal for assessment tests. Exercise Originality Flexibility Fluency Elaboration LoopIt 0.76 0.70 0.79 0.82 MapIt 0.73 0.78 0.80 TieIt 0.86 -- 0.87 ResqueIt 0.81 OddIt 0.75

Concurrent Validity, Test-Retest rCAB Fluency rCAB Flexibility rCAB Originality GPA Mood Time Fluency 0.98 -- 0.13 0.10 0.51 Flexibility 0.74 0.12 0.08 0.46 Originality 0.36 0.06 0.07 Test-Retest GPA GPA < 3.0 correlates to low score GPA > 3.0 has insignificant correlation. Time Time < 187 sec correlates to low score Time > 187 sec has insignificant correlation BuffaloS15 Originality Flexibility Fluency Treatment (n=7,434) 0.34 0.31 0.42 Control (n=353) 0.72 0.83 0.90

Internal Reliability Across Studies Originality Flexibility Fluency Elaboration BuffaloS15 (n=7,434) 0.73 0.70 0.82 0.89 IntStudy14 (n=7,228) 0.84 0.79 0.71 0.81 Coefficient of Internal Consistency: Analysis must be done per index per exercise. α ≥ 0.9 : Excellent (High-Stakes testing) 0.7 ≤ α < 0.9: Good (Low-Stakes testing) 0.6 ≤ α < 0.7: Acceptable 0.5 ≤ α < 0.6: Poor α < 0.5: Unacceptable Average result is above 0.7 which is ideal for assessment tests. Exercise Originality Flexibility Fluency Elaboration LoopIt 0.76 0.70 0.79 0.82 MapIt 0.73 0.78 0.80 TieIt 0.86 -- 0.87 ResqueIt 0.81 OddIt 0.75

Test-Retest Correlation Test-Retest Analysis: Conduct the same set of assessment within a short time period: Range is (-1,1). +1 if perfect direct increasing relationship -1 if perfect inverse decreasing relationship 0 if independent Given the same condition, the correlation would be high. BuffaloS15 Originality Flexibility Fluency Treatment (n=7,434) 0.34 0.31 0.42 Control (n=353) 0.72 0.83 0.90

Concurrent Validity n = 351 rCAB Fluency rCAB Flexibility rCAB Originality GPA Mood Time Fluency 0.98 -- 0.13 0.10 0.51 Flexibility 0.74 0.12 0.08 0.46 Originality 0.36 0.06 0.07 Comparison of SparcIt’s engine against external factors Range is (-1,1). +1 if perfect direct increasing relationship -1 if perfect inverse decreasing relationship 0 if independent Note: Coefficient of 0.35 is considered a strong correlation. GPA GPA < 3.0 correlates to low score GPA > 3.0 has insignificant correlation. Time Time < 187 sec correlates to low score Time > 187 sec has insignificant correlation

Questions?