TAS in Chemistry (AL & ASL Chemistry Practical) EDB & HKEAA 18 October 2007

Programme 2:15 Registration 2:15 Registration 2:30 Learning and Teaching of TAS Mr WH FONG, EDB 2:30 Learning and Teaching of TAS Mr WH FONG, EDB 3:00 Assessment Aspects of TAS 3:00 Assessment Aspects of TAS Mr CW Pau, HKEAA Mr CW Pau, HKEAA 3:30 Break 3:30 Break 3:45 Making Assessment Mr WH FONG, EDB and Mr CW PAU, HKEAA 3:45 Making Assessment Mr WH FONG, EDB and Mr CW PAU, HKEAA 4:15 Experience Sharing Mr KB NG, Fukien Secondary School (Siu Sai Wan) 4:15 Experience Sharing Mr KB NG, Fukien Secondary School (Siu Sai Wan) 5:00 Questions and Answers 5:00 Questions and Answers

Learning & Teaching in TAS

Improve Learning through Assessment Key factors identified by research: Key factors identified by research: the provision of effective feedback to pupils; the provision of effective feedback to pupils; the active involvement of pupils in their own learning; the active involvement of pupils in their own learning; adjusting teaching to take account of the results of assessment; adjusting teaching to take account of the results of assessment; a recognition of the profound influence assessment has on the motivation and self-esteem of pupils, both of which are crucial influences on learning; a recognition of the profound influence assessment has on the motivation and self-esteem of pupils, both of which are crucial influences on learning; the need for pupils to be able to assess themselves and understand how to improve. the need for pupils to be able to assess themselves and understand how to improve. Assessment for Learning: Beyond the Black Box Assessment Reform Group, UK

Why TAS? Limitations of practical examinations Limitations of practical examinations Success depends on the methodical use of a limited number of well-practised skills. Success depends on the methodical use of a limited number of well-practised skills. Practical work in schools is usually geared to the nature of the practical examination, and hence may be limited in scope. Practical work in schools is usually geared to the nature of the practical examination, and hence may be limited in scope. The full range of practical objectives is not tested. The full range of practical objectives is not tested. A once-only examination may not measure true ability. A once-only examination may not measure true ability. Teachers are not involved in the assessment procedure. Teachers are not involved in the assessment procedure. The examination does not provide feedback to the students, and thus has very little educational value. The examination does not provide feedback to the students, and thus has very little educational value.

Why TAS? Advantages of TAS Advantages of TAS Educational objectives are more directly and efficiently achieved by the necessary laboratory experiences and their associated assessments, through a better link between theory and practical work, and by encouraging a greater diversity in experimentation. Educational objectives are more directly and efficiently achieved by the necessary laboratory experiences and their associated assessments, through a better link between theory and practical work, and by encouraging a greater diversity in experimentation. Examination pressures are reduced. Examination pressures are reduced. It is possible to assess the full range of practical abilities. It is possible to assess the full range of practical abilities. It provides frequent feedback to students. It provides frequent feedback to students. It increases the professionalism and experience of teachers. It increases the professionalism and experience of teachers.

Purpose of Assessment Assessment for Learning 促進學習的評估 Assessment for Learning 促進學習的評估 Provide information about the progress of students in relation to knowledge and understanding, and various skills (continuous assessment) Provide information about the progress of students in relation to knowledge and understanding, and various skills (continuous assessment) Identify where emphasis needs to be made to the next stage of learning (feedback) Identify where emphasis needs to be made to the next stage of learning (feedback) LearningTeaching Assessment

Practical Skills Required / Optional in TAS? 1. Collection of gases 2. Crystallisation 3. Determination of melting and boiling points 4. Distillation and reflux 5. Filtration 6. Handling of colorimeter, pH meter and datalogging system 7. Flame test 8. Handling of simple electrical devices 9. Liquid-liquid extraction 10. Simple chromatography 11. Use of electronic balance

Practical Activities Required / Optional in TAS? 1. Students have to do a pre-laboratory quiz on theory and procedure. 2. Students have to do a risk assessment before they can start their own experiment. 3. Students have to planning one or two experiments, in TAS by writing formal proposals 4. Students have to carry out one preparative experiment. 5. Students have to write five detailed reports. 6. Students have to present experimental findings orally in class, and in a written form.

Learning, Teaching and Assessment Which goes first? Which goes first? Learning, Teaching and Assessment Learning, Teaching and Assessment Learning / teaching goes before assessment Learning / teaching goes before assessment provide sufficient instructions and practice provide sufficient instructions and practice relate practical to theory relate practical to theory arrange practical as and when appropriate arrange practical as and when appropriate provide feedback for learning e.g post hoc discussions on experimental results, procedures, sources of error, etc. provide feedback for learning e.g post hoc discussions on experimental results, procedures, sources of error, etc. TAS should be deployed for learning and teaching as well as assessment. TAS should be deployed for learning and teaching as well as assessment.

Teacher Assessment Scheme CW PAU, HKEAA

Break for 15 minutes

Making Assessment

Criteria in Assessing Area A Manipulative and observation skills, general bench performance 1. Methodical Working 有條不紊的工作 correct sequence of operations, efficient use of time, etc. correct sequence of operations, efficient use of time, etc. 2. Experimental Technique 實驗技巧 correct & safe handling of apparatus & chemicals, and carrying out operations (observe students directly or based on comparison with target values) correct & safe handling of apparatus & chemicals, and carrying out operations (observe students directly or based on comparison with target values)

Criteria in Assessing Area A Manipulative and observation skills, general bench performance 3. Skills in Observation read scales on instrument to the correct degree of accuracy read scales on instrument to the correct degree of accuracy correct observations (dichotomous judgement) correct observations (dichotomous judgement) recognise relevant and irrelevant observations recognise relevant and irrelevant observations use a control to tell whether a change has occurred (oral questions/written record) use a control to tell whether a change has occurred (oral questions/written record) 4. Manual dexterity 手法熟練程度 5. Orderliness

Criteria for Assessing Area A 5 major areas 5 major areas 5 major areas 5 major areas Operation of a single piece of apparatus Operation of a single piece of apparatus Carrying out experimental procedures Carrying out experimental procedures Reading and measurements of different instruments / apparatus Reading and measurements of different instruments / apparatus Observational skills Observational skills General bench performance General bench performance depends on the experimental situations (e.g. Acid based titration, kinetics experiment and preparative experiment are all very different in nature and involve quite different skills, hence different assessment criteria should be ued) depends on the experimental situations (e.g. Acid based titration, kinetics experiment and preparative experiment are all very different in nature and involve quite different skills, hence different assessment criteria should be ued)

Example 1: Acid-base Titration Marks may be allocated by taking into account of the following: Rinses out burette taking care to rinse jet Rinses out burette taking care to rinse jet Clamps burette vertically Clamps burette vertically Fills jet of burette up before starting titration Fills jet of burette up before starting titration Uses pipette filler correctly Uses pipette filler correctly Pipettes exactly 25 cm 3 of dilute sodium hydroxide Pipettes exactly 25 cm 3 of dilute sodium hydroxide Transfers exactly 25 cm 3 of dilute sodium hydroxide to conical flask without spillage Transfers exactly 25 cm 3 of dilute sodium hydroxide to conical flask without spillage Adds dilute sulphuric acid in suitable amounts from burette Adds dilute sulphuric acid in suitable amounts from burette Continually swirls the flask during the addition of the acid Continually swirls the flask during the addition of the acid Works safely Works safely Works tidily Works tidily (Earl & Wilford, Practical Assessment in Advanced Chemistry)

Example 2: Comparison of the rates of hydrolysis of haloalkanes Experiment Instructions: Devise a small scale experiment to compare the rates of hydrolysis of the bromoalkanes given. Devise a small scale experiment to compare the rates of hydrolysis of the bromoalkanes given. Write a brief plan of the experiment you intend to carry out and hand this to your teacher. Write a brief plan of the experiment you intend to carry out and hand this to your teacher. Carry out the experiment and using the evidence you obtain place the three compounds in order of increasing rate of reaction. Carry out the experiment and using the evidence you obtain place the three compounds in order of increasing rate of reaction. At the conclusion of your experiment note any modifications you made while carrying it out and hand these to your teacher along with your derived order of reaction. At the conclusion of your experiment note any modifications you made while carrying it out and hand these to your teacher along with your derived order of reaction. (Earl & Wilford, Practical Assessment in Advanced Chemistry)

Example 2: Comparison of the rates of hydrolysis of haloalkanes Assessment Criteria: Assessment Criteria: Eye protection Eye protection Ethanol is used as a common solvent Ethanol is used as a common solvent Equal quantities of ethanol, haloalkanes, silver nitrate solution Equal quantities of ethanol, haloalkanes, silver nitrate solution Correct order of addition of reagents Correct order of addition of reagents Time from first addition of silver nitrate solution or haloalkane Time from first addition of silver nitrate solution or haloalkane Time for first precipitate to appear Time for first precipitate to appear Correct relative order of hydrolysis Correct relative order of hydrolysis Suitable modifications Suitable modifications

Criteria for Assessing Area B Presentation of data, interpretation of results, planning of expts 1. Accurate recording of observations 2. Present results properly and systematically 3. Use correct units and appropriate no. of sig. fig. 4. Understand principles; efficient calculations; & aware of sources of errors in quantitative work 5. Recognise the reactions involved & draw relevant conclusions in qualitative work 6. Student ’ s ability to plan and carry out experiment

Assessing Area B Presentation of data, interpretation of results, planning of expts Assessed by Assessed by written reports, questioning, pre-lab quiz, post-lab quiz etc. written reports, questioning, pre-lab quiz, post-lab quiz etc. Train students to organise and present their ideas in a logical and systematic manner Train students to organise and present their ideas in a logical and systematic manner Students ’ own words and reflect their understanding Students ’ own words and reflect their understanding Vary regularly the experiments like using different methods, samples to be tested, concentrations of solutions, indicators, etc. in the lab manual to avoid plagiarism Vary regularly the experiments like using different methods, samples to be tested, concentrations of solutions, indicators, etc. in the lab manual to avoid plagiarism Feedback Feedback Feedback grades/marks/comments, helps students know their learning progress grades/marks/comments, helps students know their learning progress

Assessment Activity: Area B CriteriaWeightingScore Clear account, proper use of chemical nomenclature & terminology, accurate spelling, punctuation and grammar 2 Correct & efficient calculations 3 Appreciation of data and major source of errors 2 Satisfactory answers to discussion questions 2 Draw valid conclusion by applying knowledge and understanding of Chemistry 1 10

Allocation of marks 1. By a scheme of marking 2. By impression of the students ’ work on a particular operation 3. By overall impression over a longer period of observation, for a particular area

Some Remarks on Assessment Marking scheme vs overall impression Marking scheme vs overall impression Be objective and unbiased Be objective and unbiased Prioritize skills to be assessed Prioritize skills to be assessed Independent assessment of different skills Independent assessment of different skills Cross check with general descriptor / criteria Cross check with general descriptor / criteria Professional judgement Professional judgement Better for teachers to develop their own set of assessment criteria (teacher professionalism) Better for teachers to develop their own set of assessment criteria (teacher professionalism) Assessment Grid for recording of assessment results for a number of students in an assessment occasion Assessment Grid for recording of assessment results for a number of students in an assessment occasion Assessment Grid Assessment Grid

From Novice to Expert

Difficulty in Awarding Marks Q Some new teachers lack confidence in awarding a reasonable spread of marks and experience undue anxiety towards possible discrepancy in assessed marks across schools. A The essence of awarding marks is that teachers should be able to give a reasonable spread of marks, and arrange the students in a proper rank order. A Teachers need not worry about the discrepancy in the assessment marks across schools, as this can largely be taken care of by the moderation procedure.

Instant Lab Report Post lab reports - focus students ’ attention on producing good finished reports Post lab reports - focus students ’ attention on producing good finished reports Reports at the end of practical Reports at the end of practical students are likely to work faster, try to make more sense of what they are doing, make more observations and record them in better organised notes, and take more care when recording data, pick up obvious errors, time to do the work again and correct it students are likely to work faster, try to make more sense of what they are doing, make more observations and record them in better organised notes, and take more care when recording data, pick up obvious errors, time to do the work again and correct it Adjust the assessment criteria so that full recording of procedures and results will carry more weight than neatness Adjust the assessment criteria so that full recording of procedures and results will carry more weight than neatness Free students afterwards to do something more constructive Free students afterwards to do something more constructive More reliable assessment results More reliable assessment results Frequency? Frequency? (Habeshaw et al, Interesting Ways to Assess Your Students)

Planning Experiment Experiments: not just doing; should involve thinking (stimulate and challenge pupils) Experiments: not just doing; should involve thinking (stimulate and challenge pupils) Students should try to understand the relations between evidence gathered and relevant theory (facilitation provided) Students should try to understand the relations between evidence gathered and relevant theory (facilitation provided) Cognitive skills: Cognitive skills: Recall & Understanding (explain) Recall & Understanding (explain) Higher Skills (analysis, synthesis & evaluation) Higher Skills (analysis, synthesis & evaluation) Example: Decomposition of NaHCO 3 Example: Decomposition of NaHCO 3

Incorporating Inquiry into Experiments Inquiry - an active engaging process that mimics the work done by actual scientists (NSTA) Inquiry - an active engaging process that mimics the work done by actual scientists (NSTA) Choose experiments that Choose experiments that address simple concepts address simple concepts can be completed using familiar equipment can be completed using familiar equipment can be safely conducted e.g. microscale can be safely conducted e.g. microscale where the data can be pooled by the class and leads to final results where the data can be pooled by the class and leads to final results Require students to design some or all of the procedures (ownership and motivation): autonomy Require students to design some or all of the procedures (ownership and motivation): autonomy Increase the opportunities for students to think about the data they should collect and their presentation Increase the opportunities for students to think about the data they should collect and their presentation

Sources of Inquiry-based Experiments Exemplar Individual Investigations, Salters Advanced Chemistry ( Exemplar Individual Investigations, Salters Advanced Chemistry ( Inquiry-based Experiments in Chemistry Inquiry-based Experiments in Chemistry Calculating Heat of Solution Calculating Heat of Solution Calculating Heat of Solution Calculating Heat of Solution Identifying Unknown Solutions Identifying Unknown Solutions Identifying Unknown Solutions Identifying Unknown Solutions Brown versus White Eggshells Brown versus White Eggshells Brown versus White Eggshells Brown versus White Eggshells Effect of Temp on the Rate of a Clock Reaction Effect of Temp on the Rate of a Clock Reaction Effect of Temp on the Rate of a Clock Reaction Effect of Temp on the Rate of a Clock Reaction Creative Problem Solving in Chemistry Creative Problem Solving in Chemistry A Black Solid (C & CuO) A Black Solid (C & CuO) A Black Solid A Black Solid Making Copper (from Cu(NO 3 ) 2 ) Making Copper (from Cu(NO 3 ) 2 ) Making Copper Making Copper

TAS Project Work Project-work: Project-work: Practical-work based Practical-work based Involves planning, performing and presenting in a written form Involves planning, performing and presenting in a written form Equivalent to one “ A ” and one “ B ” Equivalent to one “ A ” and one “ B ” Open-ended vs Guided Project: A continuum Open-ended vs Guided Project: A continuum Group project: OK Group project: OK Try out of TAS project work and be prepared for NSS Investigative Study Try out of TAS project work and be prepared for NSS Investigative Study

Operating TAS How much should students be informed? How much should students be informed? Application for operation of new course (via REO) and 1 st participation in public examination (via HKEAA) Application for operation of new course (via REO) and 1 st participation in public examination (via HKEAA) Laboratory facilities and equipment Laboratory facilities and equipment Choosing experiments Choosing experiments Syllabus suggestions, TAS requirements Syllabus suggestions, TAS requirements Educational value, safety, availability of chemicals & equipment, teaching time, etc. Educational value, safety, availability of chemicals & equipment, teaching time, etc. Variety, Cook-book or Inquiry based Variety, Cook-book or Inquiry based Arrangements Arrangements Tryout of expts, coordination with LTs, oral and written instructions to students, distribution of chemicals & equipment, laboratory reports, etc. Tryout of expts, coordination with LTs, oral and written instructions to students, distribution of chemicals & equipment, laboratory reports, etc. Students with physical disabilities Students with physical disabilities

Resource Materials for TAS

Practical Chemistry Resources Exemplars of Learning & Teaching Activities for Sixth Form Chemistry Curriculum ( Exemplars of Learning & Teaching Activities for Sixth Form Chemistry Curriculum ( Resource Book for Sixth-form Practical Chemistry, CUHK ( Resource Book for Sixth-form Practical Chemistry, CUHK ( TAS Corner ( TAS Corner ( 高級程度化學實驗資料冊 高級程度化學實驗資料冊 Reference Books (Adv Practical Chem, NAS, Classic Chem Expts, ILPACs etc) Reference Books (Adv Practical Chem, NAS, Classic Chem Expts, ILPACs etc) Internet Resources (e.g. Dr David Brook ’ s website, Nuffield ’ s websites) Internet Resources (e.g. Dr David Brook ’ s website, Nuffield ’ s websites) Datalogging expts, Diocesan Girls ’ School ( Datalogging expts, Diocesan Girls ’ School ( Journals Journals Chem Review Chem Review Chem 13 News ( Chem 13 News ( Education in Chemistry Education in Chemistry 化學教學 化學教學

chemistry/TAS_corner/html TAS Corner

Videos on Practical Chemistry Demonstrate a new technique during lab class Demonstrate a new technique during lab class As a resource for students in pre-lab assignments As a resource for students in pre-lab assignments As a review of a specific technical procedure As a review of a specific technical procedure Quality assurance of laboratory techniques Quality assurance of laboratory techniques (ETC and CUHK) (ETC and CUHK)

Microscale Chemistry Expts R. G. Silberman & L. T. Eubanks. (1996). ACS Small-scale Laboratory Assessment Activities. ACS. R. G. Silberman & L. T. Eubanks. (1996). ACS Small-scale Laboratory Assessment Activities. ACS. Microscale equipment and methods Microscale equipment and methods reduce time and expense reduce time and expense become possible to develop activities that test a students ’ “ laboratory thinking skills ” and use problems posed in the laboratory as true assessment tools become possible to develop activities that test a students ’ “ laboratory thinking skills ” and use problems posed in the laboratory as true assessment tools

Thank you!