Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Constructive Alignment Claus Brabrand, Ph.D. ((( ))) Associate Professor,

Slides:



Advertisements
Similar presentations
Teaching for Higher Order Outcomes Peter Ling June 2012.
Advertisements

Claus Brabrand Reykjavik UniversitySeptember 22, 2009 How to make sure your students learn what you want them to Claus Brabrand ((( )))
1 The INNOMET taxonomy of competencies and skills I N N O M E T II Integrated human resources development and monitoring system for adding innovation capacity.
Designing and Planning a Teaching Session This document is licensed under the Attribution-NonCommercial-ShareAlike 2.0 UK: England & Wales license, available.
ORIC – Open Educational Resources for the Inclusive Curriculum 1 This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike.
Outcomes-based Teaching and Learning Pre-workshop 1 Designing Intended Learning Outcomes Designing Intended Learning Outcomes.
Consistency of Assessment
Claus Brabrand “ITU Seminar on Teaching & Learning”Oct 31, 2008 “ITU Seminar on Teaching & Learning” IT University of Copenhagen ((( Oct 31, 2008 )))
Music teacher training in Denmark Sven-Erik Holgersen Danish School of Education University of Aarhus Denmark.
Undergraduate Students’ Laboratory Practice Illuminated by The Philosophy of Science TheoryVs. Experimental Evidence. Rachel Havdala Guy Ashkenazi Dept.
Claus Brabrand ITiCSE 2009 – KeynoteParis, France (July 06, 2009) Analyzing CS Competencies using The SOLO Taxonomy Claus Brabrand (((
Seminar /workshop on cognitive attainment ppt Dr Charles C. Chan 28 Sept 2001 Dr Charles C. Chan 28 Sept 2001 Assessing APSS Students Learning.
Claus Brabrand TeaConc 2007 – invited talkJune 25, 2007 Constructive Alignment for Teaching Model-Based Design for Concurrency Claus Brabrand (((
1 Angela Ho, EDC Chan Chi Hung, Learning to Learn Project.
Claus Brabrand “Department Seminar on Teaching & Learning”May 28, 2008 “Department Seminar on Teaching & Learning” IT University of Copenhagen ((( May.
Claus Brabrand May 19, 2010Dies Academicus 2010 – Universität Bielefeld How to Improve the Quality of Teaching & Learning Claus Brabrand (((
Claus Brabrand Aug 03, 2010Universidade Federal de Pernambuco, Recife, Brazil How to make sure your students learn what you want them to Claus Brabrand.
ITU Seminar on Teaching & Learning Claus Brabrand ((( ))) ((( ))) Associate Professor, IT University.
Introduction to Student Learning Outcomes in the Major
Video Roadshop 2007, AU C. Brabrand: "Video i Undervisning"JUN 07, 2007 On the Use of Video and Humour in Teaching Claus Brabrand DAIMI, Dept. of Computer.
Assessment IT Sligo Nov Concerns about assessment Both new and experienced lecturers can be worried about how best to assess students! What.
OBTL for SCM Linda Lai November Shifts Teacher-centred Education to Student-Centred Education Constructive Alignment attributes of an ideal graduate.
Claus Brabrand Koli’2007 – KeynoteNovember 16, 2007 Constructive Alignment for Teaching Computer Science Claus Brabrand ((( ))) (((
Learning Goals and Alignment: What, Why, How Joshua Caulkins Department of Geosciences University of Rhode Island.
+ Teaching psychological research methods through a pragmatic and programmatic approach. Patrick Rosenkranz, Amy Fielden, Efstathia Tzemou.
Science Inquiry Minds-on Hands-on.
UNIT 9. CLIL THINKING SKILLS
Aligning Course Competencies using Text Analytics
Student Centered Learning
Stages of Second Language Acquisition
Formulating objectives, general and specific
Learning Outcomes at the University of North Alabama Dr. Andrew L. Luna Institutional Research, Planning, and Assessment.
6 th semester Course Instructor: Kia Karavas.  What is educational evaluation? Why, what and how can we evaluate? How do we evaluate student learning?
Module design Setting aims and learning outcomes Dr. John Milliken School of Education Queens University Belfast.
ITU Seminar on Teaching & Learning Claus Brabrand ((( ))) ((( ))) Associate Professor, IT University.
Dr. MaLinda Hill Advanced English C1-A Designing Essays, Research Papers, Business Reports and Reflective Statements.
Click to edit Master title style  Click to edit Master text styles  Second level  Third level  Fourth level  Fifth level  Click to edit Master text.
Thinking Actively in a Social Context T A S C.
GOOD MORNING. 2 Objectives of Learning VANAJA.M Assistant Professor Department of Education Acharya Nagarjuna University.
Lecture 3 THE KEY SKILLS TESTED IN A DISSERTATION.
1 Issues in Assessment in Higher Education: Science Higher Education Forum on Scientific Competencies Medellin-Colombia Nov 2-4, 2005 Dr Hans Wagemaker.
Chapter 1 Defining Social Studies. Chapter 1: Defining Social Studies Thinking Ahead What do you associate with or think of when you hear the words social.
Roles and types of examination ITU, October 8, 2010 Hanne Leth Andersen, RUC.
How to make sure your Students Learn what you want them to Claus Brabrand ((( ))) ((( ))) Associate.
1 Ideas of Problem-based Learning As a learner-centred process, problem- based learning meets the learners' interests and as such gives room for developing.
Writing Student-Centered Learning Objectives Please see Reference Document for references used in this presentation.
1 Setting Appropriate Assessment and Grading Criteria.
Selected Teaching-Learning Terms: Working Definitions...
From Intended Learning Outcomes to Teaching/Learning Activities Claus Brabrand ((( ))) ((( ))) Associate.
Researching and Writing Dissertations Roy Horn Researching and Writing Dissertations.
 There must be a coherent set of links between techniques and principles.  The actions are the techniques and the thoughts are the principles.
Unit 5 Seminar D ESCRIBING Y OUR L EARNING. Agenda Unit Objectives Bloom’s Taxonomy Learning Statements Questions.
Constructing a Syllabus and Writing Good Learning Outcomes.
Classroom Strategies That Work. Questions, Cues, and Advance Organizers Helping Students Activate Prior Knowledge.
ITU Seminar on Teaching & Learning Claus Brabrand ((( ))) ((( ))) Associate Professor, IT University.
National Science Education Standards. Outline what students need to know, understand, and be able to do to be scientifically literate at different grade.
SOLO Taxonomy SOLO Taxonomy. What level is your understanding of SOLO taxonomy.
Grading based on student centred and transparent assessment of learning outcomes Tommi Haapaniemi
Dr. Carol Rubel. Agenda  Class Share  Discussion Questions  Questions and Answers 2.
Implementation Training
Goals and Objectives  Why Use Questioning Strategies?  Effective Questioning Techniques  Levels of Questioning…Increasing Understanding, Models for.
Workshop 2014 Cam Xuyen, October 14, 2014 Testing/ assessment/ evaluation BLOOM’S TAXONOMY.
Then Now  Teaching as Art  Teachers and Teaching  Great teachers are born  How did I do?  Scholarship informs Teaching  Culture of Unexamined assumptions.
Relating Foreign Language Curricula to the CEFR in the Maltese context
Learning Assessment Techniques
How to make sure your Students Learn what you want them to?
Theories of Language Acquisition
EDU704 – Assessment and Evaluation
The Concept of INTERDISCIPLINARY TEACHING
Simple, Multiple, Related, Extended
Presentation transcript:

Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Constructive Alignment Claus Brabrand, Ph.D. ((( ))) Associate Professor, IT-University of Copenhagen Denmark DMLF'07 – Invited Talk

[ 2 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Outline Warm up exercise: Post-It focus exercise... Constructive Alignment: The Theory of Constructive Alignment "From Theory to Practice": 'From content to competence' Tips'n'Tricks: Tips'n'Tricks for teaching Q'n'A: Questions (and possibly even answers...)

[ 3 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Warm up exercise Post-It exercise: T 1) Write down answer to: "what is good teaching?" 2) Swap Post-Its...

[ 4 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Outline Warm up exercise: "What is good teaching?" The Theory of Constructive Alignment: FILM: " Teaching Teaching & Understanding Understanding " "From Theory to Practice": 'From content to competence' Tips'n'Tricks: Tips'n'Tricks for teaching Q'n'A: Questions (and possibly even answers...)

[ 5 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Let's watch the short-film... Teaching & Understanding Teaching & Understanding ((( ))) Available on DVD through Aarhus University Press:Aarhus University Press ((( ))) Features Epilogue by John Biggs, DVD menu, and subtitles in English, French, Spanish, Portuguese, Italian, German, and Danish Inspired by: "Teaching for Quality Learning at University", John Biggs

[ 6 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Outline Warm up exercise: "What is good teaching?" The Theory of Constructive Alignment: FILM: " Teaching Teaching & Understanding Understanding " "From Theory to Practice": 'From content to competence' Tips'n'Tricks: Tips'n'Tricks for teaching Q'n'A: Questions (and possibly even answers...)

[ 7 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 From Content to Competence (Concurrency ) course aims: Given in terms of a 'content description': Essentially: This is a bad idea for 2 reasons...! The goal is...: To understand: deadlock interference synchronization...

[ 8 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Problem with 'content' as aim Problem with 'content' as learning objectives?! Objective: To understand: deadlock interference synchronization... analyze... theorize... circa-explain... circa-describe... name solutions recite conditons Stud. C Stud. A Stud. B analyze systems explain causes Censor Teacher BUT, even if it were possible to agree, we know that the exam will dictate the learning anyways.  agreement analyze systems explain causes tacit knowledge from research-based tradition (not known by stud.)

[ 9 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Problem with 'understanding' Problem with 'understanding' as learning objectives?! The answer is simple : concept of deadlock ?!  Objective: To understand: deadlock interference synchronization... It cannot be measured (!)

[ 10 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 'Competence' as objectives ! 'Competence' as learning objectives ! Evaluation = Have the student do something, and then measure product and/or process 'SOLO' = Structure of the Observed Learning Outcome Note': inherently operational (~ verbs) Objective ! To learn to: analyze systems for... explain cause/effects... prove properties of... compare methods of Note: 'understanding' is (of course) pre-requisitional (!) [ Competence := knowledge + capacity to act upon it ]

[ 11 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Neighbour Discussion Discuss with neighbour: "does this make sense ?!?" (content  competence) T

[ 12 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 'Competence' as objectives ! 'Competence' as learning objectives ! Evaluation = Have the student do something, and then measure product and/or process 'SOLO' = Structure of the Observed Learning Outcome Note': inherently operational (~ verbs) Objective ! To learn to: analyze systems for... explain cause/effects... prove properties of... compare methods of Note: 'understanding' is (of course) pre-requisitional (!) [ Competence := knowledge + capacity to act upon it ]

[ 13 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Advantages of 'SOLO' S OLO 1  no understanding  irrelevant information  misses point ... S OLO 2 S OLO 3 S OLO 4 S OLO 5 "pre-structural"  to identify  to do procedure  to recite ... "uni-structural"  to classify  to combine  to enumerate ... "multi-structural"  to relate  to compare  to analyze ... "relational"  to generalize  to hypothesize  to theorize ... "extended abstract" depth (qualitative levels) surface (quantitative levels) Advantages of 'SOLO': Constructed for research-based (university) teaching Converges on research (at SOLO 5) Strong correspondence to Piaget's learning stages From cognitive psychology

[ 14 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 SOLO (elaborated) to theorize to generalize to hypothesize to predict to analyze to relate to compare to explain causes to describe to combine to classify to perform algorithm to do simple procedure to define to identify to recite extended abstract relational multi structural SOLO 5 SOLO 4 SOLO 3 R R2R2 R3R3 R1R1 R x x Graphic Illustration Legend immediately relevant aspects – given! related or hypothetical – not given! irrellevant or inappropriate student response x R R SOLO 2 uni structural R x R' R'' x R X

[ 15 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 SOLO (more verbs) "extended abstract" "relational" "multi structural" & "uni structural" to theorize to hypothesize to generalize to critize to predict to apply theory (to 'near' problems) to reason about (reach conclusion) to explain (cause-effect) to explain (similarities-differences) to explain (strengths-weaknesses) to describe to structure at collate to combine to classify to perform algorithm to apply theory (to 'distant' problems) to put-into-perspective to reflect to judge to discuss S OLO S OLO 4 S OLO 5 to analyze to argue to relate to compare to integrate to enumerate to paraphrase to do simple procedure to define to identify / name to recite Note: the list is non-exhaustive

[ 16 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Concrete Example and Concrete Recommendations (4x) Intended Learning Outcomes [Genetics 101] After the course, the students are expected to be able to: locate genes on chromosomes do simple calculations : (e.g., recombination frequencies, in-breeding coefficients, Hardy-Weinberg, evolutionary equilibria). describe and perform connexion-analysis describe fundamental genetic concepts: (e.g., mutation variation, in-breeding, natural selection). describe and analyze simple inheritancies analyze inheritance of multiple genes simultaneously 2) List sub-goals as 'bullets': Clearer than text 1) Use 'standard formulation': put learning focus on student (Note: competence formulation "to be able to") 3) Use 'Verb + Noun' formulation: What the student is expected to do with a given matter. V N V V VV V V V V N N N N 4) Avoid 'understanding-goals': "To understand X", "Be familiar with Y", "Have a notion of Z",...! N

[ 17 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Post-It exercise Write down 1-2 key competences (i.e., verbs) (for your course) T

[ 18 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Outline Warm up exercise: "What is good teaching?" The Theory of Constructive Alignment: FILM: " Teaching Teaching & Understanding Understanding " "From Theory to Practice": 'From content to competence' Tips'n'Tricks: Tips'n'Tricks for teaching Q'n'A: Questions (and possibly even answers...)

Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, ' Break Please put the Post-Its on the wall "What is good teaching?" Key competences (in your course)

[ 20 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Outline Warm up exercise: "What is good teaching?" The Theory of Constructive Alignment: FILM: " Teaching Teaching & Understanding Understanding " "From Theory to Practice": 'From content to competence' Tips'n'Tricks: Tips'n'Tricks for teaching Q'n'A: Questions & answers

[ 21 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Definition: “Good Teaching” Definition: Good news; we now know how to do this: "Good teaching is getting most students to use the higher cognitive level processes that the more academic students use spontaneously" -- “Teaching for Quality Learning at University”, John Biggs, 2003 Alignment:  Explicitly define: intended learning outcomes &  Exam measure  intended learning outcomes  Teaching form  intended learning outcomes

[ 22 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Implementation Process Process (course specific): 1) Think carefully about: overall goal of course (what are the stud. to learn?) 2) Operationalize these goals: and express them as intended learning outcomes 3) Choose carefully the form(s) of examination (  intended learning outcomes ) 4) Choose carefully the form(s) of teaching (  intended learning outcomes ) alignment operationalization

[ 23 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 A Case-Study on Implementing Alignment "Constructive Alignment for Teaching Model-Based Design for Concurrency" -- a case-study on implementing alignment Claus Brabrand In Proc. Workshop on Teaching Concurrency, June 2007, (aka., "TeaConc'07"), pp ((( Invited Paper for Invited Talk for TeaConc'07 ))) For more information about the implementation of alignment...: Available on my homepage: ((( )))

[ 24 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 "The Learning Pyramid" Average retention rate 5% 10% 20% 30% 50% 75% 80% Lecture Reading Audiovisual Demonstration Discussion group Practice by doing Teaching others [Kilde: NTL Institute for Applied Behavioral Science, Bethel, Maine] passive active student activation level of engagement

[ 25 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Tips'n'Tricks (activation) Neighbour discussions: Frequent breaks: Post-It exercise: properties:  anonymous (!)  swap'able  everyone will engage usages:  focus: warm up / zoom in  empathetic control  shared knowledge pool pulse reader measurements:  more questions (students dare ask them)  better questions (students had a chance to discuss) 1-2 min timeout [Phil Race] Form variation: lecturing blended with in-class activation exercises

[ 26 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Tips'n'Tricks (cont'd) "Less-is-more": Use many examples: (build on student pre-knowledge) Explicit structure:  analyze  compare  relate common deadlock, uncommon deadlock, A-synchronization, B- synchronization, hand-shake, multi-party synchronization, multi-party hand-shake, binary semaphores, generalized semaphores, blocking semaphores, recursive locks,... vs. Emphasize depth over breadth (coverage) NEW OLD 1. xxxxxxxxxx 2. yyyyyyyyyy 3. zzzzzzzzzz 4. wwwwwww 1. xxxxxxxxxx 2. yyyyyyyyyy 3. zzzzzzzzzz 4. wwwwwww 1. xxxxxxxxxx 2. yyyyyyyyyy 3. zzzzzzzzzz 4. wwwwwww 1. xxxxxxxxxx 2. yyyyyyyyyy 3. zzzzzzzzzz 4. wwwwwww  self evident to you [ teacher ]  not to a learner [ student ] (esp. during learning process)  Student 'recap' at end: after 1 day after 1 week after 3 weeks after 2 weeks now

[ 27 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Outline Warm up exercise: "What is good teaching?" The Theory of Constructive Alignment: FILM: " Teaching Teaching & Understanding Understanding " "From Theory to Practice": 'From content to competence' Tips'n'Tricks: Tips'n'Tricks for teaching Q'n'A: Questions (and possibly even answers...)

[ 28 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Questions... "What is good teaching?" R’ x R R’’ x The Short-Film Cognition & structures The SOLO Taxonomy Association new ~ old analyze explain 'The Book' John Biggs "understanding" content  competence Student activation Student models Susan & Robert Teacher models levels Intended learning outcomes (ILO) Constructive Alignment Exam Satisfaction Experiences Pre vs. Post Students at Uni Model-based design for Concurrency... My research and teaching 'TLA' Teaching/Learning Activities Tips'n'Tricks S M I ?

[ 29 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Now, please: "3-minute recap" Please spend 3' on thinking about and writing down the most important points from the talk – now!: After 1 day After 1 week After 3 weeks After 2 weeks Immediately

Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Thank You! ((( ))) Film homepage:

Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 BONUS SLIDES

[ 32 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Background (~ this talk) Concurrency : "Pre-alignment" Learned about teaching/learning theories In particular: Constructive Alignment, The SOLO Taxonomy, Constructivism,... Concurrency : "Post-alignment"

[ 33 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Disclaimer  not to exhibit a perfectly aligned course;  but to show how the principles of alignment can be put to use (in particular, how it may serve as guidelines for the exam and TLA). [ TLA := Teaching/Learning Activities ] The point of this part is:

[ 34 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Implementation Process Process (course specific): 1) Think carefully about: overall goal of course (what are the stud. to learn?) 2) Operationalize these goals: and express them as intended learning outcomes 3) Choose carefully the form(s) of examination (~ intended learning outcomes ) 4) Choose carefully the form(s) of teaching (~ intended learning outcomes ) alignment

[ 35 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Starting Point Content description (Concurrency '04+'05): What is the overall goal of the course...? (what are the students to learn)

[ 36 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Overall Course Philosophy Model-Based Design for Concurrency:

[ 37 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Thoroughly Motivate (what can they do, if they 'bother' learning this?)

[ 38 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Implementation Process Process (course specific): 1) Think carefully about: overall goal of course (what are the stud. to learn?) 2) Operationalize these goals: and express them as intended learning outcomes 3) Choose carefully the form(s) of examination (~ intended learning outcomes ) 4) Choose carefully the form(s) of teaching (~ intended learning outcomes ) alignment

[ 39 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 #1 #2 #3 Intended Learning Outcomes Model-based design for Concurrency... SM I #1 #2 #3 Intended Learning Outcomes (based on The SOLO Taxonomy): Note: explicitly included as a non-goal  T

[ 40 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Implementation Process Process (course specific): 1) Think carefully about: overall goal of course (what are the stud. to learn?) 2) Operationalize these goals: and express them as intended learning outcomes 3) Choose carefully the form(s) of examination (~ intended learning outcomes ) 4) Choose carefully the form(s) of teaching (~ intended learning outcomes ) alignment

[ 41 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 On Aligning the Exam (~ ILOs) Pre-alignment (Concurrency ): Group Project (50%) Individual Multiple-Choice Test (50%) Post-alignment (Concurrency ): Group Project (50%) Individual Multiple-Choice Test (50%) However; BIG differences...!  Coincidentally: 'Inherited' from pre-2004: Because it seemed like a good idea to do a project Carefully designed (~ILOs): Project good for evaluating model-based design process Added in 2005: Politically motivated: exam must have individual part! Carefully designed (~ILOs): MC-test good for evaluating analytical skills (~problem): to analyze/compare models

[ 42 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Project (pre- vs. post-alignment) 2004 Project: "The Beer Factory": 2006 Project: "The Banana Republic":   Some student projects with no appearant model  impl. relationship (at least, to me)!  No explicit learning objectives (only 'list of contents')  No explicit project grading criteria  result

[ 43 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 The Banana Republic Project designed (~ ILO's): (a) Construct unsafe model (w/o controller); (b) Test model - observe that collisions with 'El Presidente' can occur; (c) Define safety property NO_CRASH; (d) Verify that collisions can occur; (e) Construct a controller (such that collisions can no longer occur); (f) Verify that collisions can no longer occur; (g) Define liveness property ('El Presidente' can eventually leave); (h) Implement model in Java. Grading (of the report):  construct models...  apply common solutions...  relate spec  model...  test model...  define properties...  verify model wrt. properties...  implement model...  relate model  impl... All ILO's except:  analyze models  compare models Better evaluated on MC-test

[ 44 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, MC-test: 2006 Project: MC-test (pre- vs. post-alignment)  analyze models (and programs) wrt. behavior (a bunch of seemingly reasonable questions): Carefully designed (~ ILO's):  Bad Alignment  compare models (and program) wrt. behavior

[ 45 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Example: analyze models Good Alignment

[ 46 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Example: compare models Good Alignment

[ 47 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Implementation Process Process (course specific): 1) Think carefully about: overall goal of course (what are the stud. to learn?) 2) Operationalize these goals: and express them as intended learning outcomes 3) Choose carefully the form(s) of examination (~ intended learning outcomes ) 4) Choose carefully the form(s) of teaching (~ intended learning outcomes ) alignment

[ 48 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 On Aligning the TLA (~ ILOs) Pre-alignment (Concurrency ): Lectures (2-3 hrs/week) 'Theoretical Exercise Classes' (2 hrs/week) 'Programming Lab' (2 hrs/week) Post-alignment (Concurrency ): Lectures (2-3 hrs/week) with activation exercises 'Theoretical Exercise Classes' (2h/w) apply common solutions 'Programming Lab' (2 hrs/week) hands-on training for project Weekly hand-ins (every week) train for project (w/ feedback!) MC-test sample questions (given early) train for MC-test  [ Idea due to colleague Thomas Hildebrandt at ITU ] essentially teacher-centric "monologues" student-centric

[ 49 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 TLA's (post-alignment) Student-centric: 'Theoretical Exercise Classes' (2h/w) apply common solutions 'Programming Lab' (2 hrs/week) hands-on training for project Weekly hand-ins (every week) train for project (w/ feedback!) MC-test sample questions (given early) train for MC-test Teacher-centric: Lectures (2-3 hrs/week) with activation exercises { apply common solutions } { construct, implement, test, verify, define, apply } { construct, implement, relate } { analyze, compare } introduce fundamental concepts/problems/solutions (in terms of models & impl)

[ 50 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Implementation Process Process (course specific): 1) Think carefully about: overall goal of course (what are the stud. to learn?) 2) Operationalize these goals: and express them as intended learning outcomes 3) Choose carefully the form(s) of examination (~ intended learning outcomes ) 4) Choose carefully the form(s) of teaching (~ intended learning outcomes ) alignment ? ?

[ 51 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Conclusions (pre vs. post) Subjectively: Constructive Alignment (!!!): To the point that I bothered making a film about it :) Own behavior changed: From 'intuition' to conscious choices; awareness of alternatives and of consequences of choices (~ student learning) My students' behavior (from my perspective): More focusses on learning the objectives (esp. 'to relate')  Student background and prerequisites;  The "Susan/Robert ratio";  Teacher's experience gain; Disclaimer: (many factors involved that vary from-year-to-year)......and many more

[ 52 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Objectively (I/III): (Questionnaire at end, 7-step scale) Student satisfaction: "slightly more satisfied"..or "constructive alignment doesn't compromize student satisfaction" Student proficiency: More useful figures (~learning) ! However: I only have post-alignment data :( Thus: "inconclusive" :( self-reported Pre ('04-'05) Post ('06-'07) Pre ('04+'05) Post ('06+'07)

[ 53 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Objectively (II/III): (Competences explicitly tested & trained) Competences explicitly tested and trained for: Conclusion: "Substantial SOLO-level increase" (~ good teaching) ! Much better projects (esp. 'model  impl' relationship) !

[ 54 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Objectively (III/III): (Qualitative data from 2006 eval) Anonymous student in 2006 evaluation: “This course has been awesome! It took me a while to be able to think in models, but I saw the light along the way.” “Lectures have been great, the theoretical exercise classes have been rewarding and the feedback has been immense and insightful” “I did not have a lot of time to do the exercises, but they seemed relevant from week to week.” “The mini project was a good and solid exercise in analyzing a problem, making a model and implementing it. A very good exercise!” Overall: Teaching: Exercises: Project:

[ 55 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 The Role of the Exam Alignment: A theory of planning (over the course of a course) A theory of motivation (and incentive) The exam as a...: "Necessary evil" Motivational and learning-guiding pedagogical tool for the teacher(!) application of alignment "The exam does not come after, but before the course!"

[ 56 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Motivation Beyond the Exam Motivational problem: “Why bother learn the course material?”: Tell them why it is important to learn these things: How could these skills benefit them in their work/life/… (focus on advantages) [ Example… ]

[ 57 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Program world Model world Concrete Abstract P M abstraction concretization Programs and Models

[ 58 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 On Program Equivalence Program world Model world Concrete Abstract ~ P P’ M M’ 1. P ~ P’ ? 2. abstract 3. M ~ M’ ? 4. relate 5. M ~ M’ ! 6. concretize 7. P ~ P’ ! What discerns a really good programmer from one that is not so good is the capability of moving (consciously or unconsciously) between the concrete world of programs and the abstract world of models (via abstraction and concretization). Specifically, such a programmer is capable of (consciously or unconsciously): - 1) abstracting programs into models - 2) reasoning about the models - 3) concretizing the insights back into the world of programs

[ 59 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 On Property Satisfaction What discerns a really good programmer from one that is not so good is the capability of moving (consciously or unconsciously) between the concrete world of programs and the abstract world of models (via abstraction and concretization). Specifically, such a programmer is capable of (consciously or unconsciously): - 1) abstracting programs into models - 2) reasoning about the models - 3) concretizing the insights back into the world of programs

[ 60 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Notes on Skill Acquisition From the world of psychoanalysis: Skill acquisition progresses according to the following stages of learning: 1. Unconscious incompetence 2. Conscious incompetence 3. Conscious competence 4. Unconscious competence 5. Capacity for moving consciously between stages 3. and 4.: [ required by a teacher ]

[ 61 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 A taxonomy / language for teaching impersonalizes teaching Emotional detachment (aka. “dissociation”) The teacher is good/bad identity: good/bad teacher The methods are good/bad behavior: good/bad method knowledge: good/bad method With dissociation: more capable of dealing with critique  better to listen to constructive advice (…just like with our research) Impersonalization identity moral knowledge behavior “Neutological levels” [model of the mind, “NLP”] ethics experience reactions convictions capabilities interaction

[ 62 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Based on John Biggs' Theories 2nd edition (3rd edition expected this fall) "Teaching for Quality Learning at University", John Biggs

[ 63 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Teacher’s intention Student’s activity Exam’s assessment  e.g. - explain - relate - prove - apply e.g. - memorize - describe U NALIGNED C OURSE e.g. - memorize - describe "Dealing with the test"

[ 64 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Teacher’s intention Student’s activity Exam’s assessment e.g. - explain - relate - prove - apply A LIGNED C OURSE e.g. - explain - relate - prove - apply e.g. - explain - relate - prove - apply e.g. - explain - relate - prove - apply e.g. - explain - relate - prove - apply

[ 65 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Kommunikation (af fag-viden) Speak- Listen: Write- Read: Personal knowledge Official knowledge Personal knowledge Officialization Personalization Personal knowledge Official knowledge Personalization tion Personal knowledge Officializa

[ 66 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Personlig vs. Officiel Viden Personlig viden: "connaissance" (fransk) individuel uformel implicit subjektiv (kan være) ustabil (mht) specifikke situationer Officiel viden: "savoir" (fransk) delt (med andre) formel eksplicit objektiv stabil (især NAT-videnskab) generel To (modsat rettede) processer: Personlig viden Officiel viden Officialization Personalization [ ~MBTI: "S" vs. "N" ]

[ 67 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Undervisningsformer [kilde: Torben K. Jensen] problem-orienteret disciplin-orienteret lærer-styret elev-styret Forelæsning Projekt-arbejde Øvelser Case-undervisning

[ 68 ] Claus Brabrand (ITU) DMLF Årsmøde 2007 – keynoteSep 20, 2007 Undervisningsforløb: Deduktion vs. Induktion Deduktivt forløb: Induktivt forløb: Introduktion Teori Øvelse Opsamling Introduktion Øvelse Analyse Teori