1. Core Methods in Educational Data Mining
HUDK4050 Fall 2014

2. Assignment 3B
Any questions?

3. Textbook

4. Any questions about cross-validation?

5. What are the advantages and disadvantages?
Flat CV
Stratified CV

6. What are the advantages and disadvantages?
Flat CV
Student-Level CV

7. Validity

8. What is…
Generalizability?

9. What is…
Ecological Validity?

10. What is…
Construct Validity?

11. What is…
Predictive Validity?

12. What is…
Substantive Validity?

13. What is…
Conclusion Validity?

14. What are…
Some other validity concerns?

15. Exercise
In groups of 3
Write the abstract of the worst behavior detector paper ever

16. Any group want to share?

17. Exercise #2 In different groups of 3
Now write the abstract of the best behavior detector paper ever

18. Any group want to share?

19. How many of these were actually feasible?

20. Real-world EDM involves tradeoffs

21. Real-world EDM involves tradeoffs
Which types of validity do you want to optimize?
Which types of validity do you want to satisfice?
Can any be safely ignored completely? (at least in some cases)

22. Other comments or questions
About validity issues?

23. Other questions, comments, concerns about textbook?

24. Next Class Wednesday, October 15 B3: Bayesian Knowledge Tracing
Baker, R.S. (2014) Big Data and Education. Ch. 4, V1, V2.
Corbett, A.T., Anderson, J.R. (1995) Knowledge Tracing: Modeling the Acquisition of Procedural Knowledge. User Modeling and User-Adapted Interaction, 4,

25. The End