1. Aims for e3an consultants  to generate 50 questions per consultant  with answers / feedback / metadata  validated using the e3an tool  peer reviewed  to give good theme coverage.  to hit the submission deadline.

2. Theme Leaders  Each theme has a theme leader.  Theme leaders get a bit of extra money ... or produce less questions.  Theme leaders are responsible for the operation of the theme team ... and the successful delivery of the questions to e3an.

3. Agreeing the subtopics  Teams agree the subtopics ... and the levels for each subtopic Subtopic IntroductoryIntermediateAdvanced Information Channels Encoding Signalling LAN structure

4. Balance of questions  Teams decide  how many questions per ticked box are appropriate.  balance of question types between exam / mcq etc.  (the pilot balance was 2:1 mcq:exam)  approach to any theme-specific issue such as notation.  balance of difficulty (threshold / good / excellent)

5. Assigning the questions  Teams divide the questions amongst the consultants.  Theme leader keeps a record of who is going to do what.  Try to arrange a half day get-together to discuss the theme and sort out the questions if at all possible.

6. Generating the questions - 1  Consultants then generate:  questions  metadata  model solutions (exam type)  feedback (multiple choice)  other notes

7. Generating the questions - 2  Questions must  be entered using Word templates  have diagrams in acceptable format  follow the e3an guidelines  be complete and correct

8. More on questions  Can be based on existing questions, adapted for e3an.  A 3 part exam question would become 3 linked questions in e3an – preferably at increasing levels of difficulty.  Generate 5 alternatives for mcqs.  Can use other types of question.

9. Quality: Question validation  e3an has a validation tool which ensures that questions  are complete  are compatible with the database  will go through the QTI converter  have no font / symbol problems  Consultants must check each question with the validation tool.

10. Quality: Peer review - 1  All questions must be peer reviewed to ensure that they are  clear and unambiguous  correct  complete (answers, metadata etc)

11. Quality: Peer review 2  The most effective way to handle peer review is for the team to get together to review each other's work.  Failing this, the team should try to get together in subgroups for the review.  Theme leaders must make sure that peer review happens and is recorded.

12. The end of the road  Deadline: 9 September 2002  Delivery: CD or Zip according to format in the e3an guidelines.