Instrument for Participant Communication Chapter 12

Instrument Development Process Phase 1: Developing the instrument design strategy Phase 2: Constructing and refining the measurement questions Phase 3: Drafting and refining the instrument

Flowchart for Instrument Design Investigative Questions Measurement Questions Instrument Design Instrument Design Prepare Preliminary Analysis Plan Pretest individual Questions Pretest Individual Questions Instrument Ready for Data Collection

Data Hierarchy Management Question –The dilemma, stated in question form, that the manager needs resolved Research Question –The fact-based translation of the question the researcher must answer to contribute to the solution of the management question Investigative Question –Specific questions the researcher must answer to provide sufficient detail and coverage of the research question –There may be several questions as the researcher moves from the general to the specific Measurement Question –Questions participants must answer if the researcher is to gather the needed information and resolve the management question

Strategic Concern What type of data is needed to answer the management question? What communication approach will be used? Should the question be structured, unstructured or some combination? Should the question be undisguised or disguised? If the latter, to what degree?

Data Collection Type of data Communication approach Question structure Disguising objectives and sponsors

Ways to Interact with the Participant Personal interview Telephone Mail Computer

Types of Measurement Questions? Target Classification Administrative

Appropriate Question Content Should this question be asked? Is the question of proper scope and coverage? Can the participant adequately answer this question, as asked? Will the participant willingly answer this question, as asked?

How to Test a Respondent’s Appropriateness Filter questions Screen questions

Question Wording Criteria Is the question stated in terms of a shared vocabulary? Does the question contain vocabulary with a single meaning? Does the question contain unsupported assumptions? Is the question correctly personalized? Are adequate alternatives presented within the question?

What Dictates Your Response Strategy? Characteristics of participants Nature of the topic(s) being studied Type of data needed Your analysis plan

Types of Response Questions Free-response Dichotomous Multiple-choice Checklist Rating Ranking

Guidelines to Refining the Instrument Awaken the participant's interest Use buffer questions as a guide to request sensitive information Use the funnel approach to move to more specific questions

Improving Survey Results Pretesting is an established practice for discovering errors and useful for training the research team