Dr. John V. Richardson, Professor UCLA GSE&IS DIS UCLA DIS 280 Social Science Research Methodology: Methodological Orientations Dr. John V. Richardson, Professor UCLA GSE&IS DIS

Method Orientations Qualitative vs. (and/or) Quantitative Research “Focus of Research and Philosophical Roots; Associated phrases; Goal of investigation; Design characteristics; Setting and Sample; Data Collection; and Mode of Analysis and Findings” Positivism and Naturalist Axioms Functions of the Method Section Outlining, Detailing, Operationalizing, Analyzing, Organizing, and Qualifying

The Quals versus the Quants Today, LIS researchers and students can be divided into two camps: qualitative researchers as opposed to quantitative researchers Source: Altman, LISR (1991), chapter 9

The Quals 19th Century Concept of Research: Enumerative Bibliography Rigorous, Systematic Descriptive/Analytical Bibliography (Bowers)

The Quants Pierce Butler, Introduction to Library Science (1933) Sociological, Psychological, and Historical Problems Douglas Waples, Investigating Library Problems (1939) Problem, Definitions of Terms, External Validity, Rules of Evidence SOURCE: Richardson, Spirit of Inquiry (1981)

The Quals Challenge Thompson, “Do We Need a Library Science?” (1931) Butler, “Librarianship as a Profession” (1951) SOURCE: Richardson, Gospel of Scholarship (1992)

The Debate Continues 1960’s, computer revolution, inferential statistics 1970’s and 1980’s, sophisticated techniques; pseudo-science, scientism; 1990’s reaction--humanities orientation of most LIS faculty and students

Emic or Etic Orientation Etic oriented research: data driven Emic oriented research: theory driven

Look at Your Research Goals Qualitative Goals: To understand… Quantitative Goals To predict... To explain...

Focus of Research Qualitative research: Quantitative research Quality (nature, essence) Quantitative research Quantity (how much, how many)

Philosophical Roots Qualitative research: Quantitative research: Phenomenology, symbolic interaction Quantitative research: Positivism, empirical, statistical

Associated Phrases Qualitative research: Quantitative research: Fieldwork, ethnographic, naturalistic, grounded, subjective Quantitative research: Experimental, empirical, statistical

Goal of Investigation Qualitative research: Quantitative research: Understanding, description, discovery, hypothesis generating Quantitative research: Prediction, control, description, confirmation, hypothesis testing

Design Characteristics Qualitative research: Flexible, evolving, emergent Quantitative research: Predetermined, structured

Research Setting Qualitative research: Quantitative research: Natural, familiar Quantitative research: Artificial, unfamiliar

Sample Size and Characteristics Qualitative research: Small, nonrandom, theoretical Quantitative research: Large, random, representative

Data Collection Qualitative research: Quantitative research: Researcher as primary instrument, interviews, observation Quantitative research: Inanimate instruments (scales, tests, questionnaires, computers)

Mode of Analysis Qualitative research: Quantitative research: Inductive (by researcher) Quantitative research: Deductive (by statistical method)

Findings Qualitative research: Quantitative research: Comprehensive, holistic, expansive Quantitative research: Precise, narrow, reductionist” SOURCE: Merriam (1988), p. 18

Contrasting Paradigms The positivist paradigm and the naturalist paradigm can be contrasted along several lines: “The nature of reality The relationship of knower to the known The possibility of generalization The possibility of causal linkages The role of values

The Nature of Reality Positivism paradigm: Naturalistic paradigm: Reality is single, tangible & fragmentable Naturalistic paradigm: Realities are multiple, constructed, & holistic

Knower and the Unknown Positivism paradigm: Naturalistic paradigm: Knower and known are independent, a dualism. Naturalistic paradigm: Knower & known are interactive, inseparable.

Generalizations Positivism paradigm: Naturalistic paradigm: Time- & context-free generalizations (nomothetic statements) are possible Naturalistic paradigm: Only time- & context-bound working hypotheses (idiographic statements) are possible.

Causal linkages Positivism paradigm: Naturalistic paradigm: There are real causes, temporarily precedent to or simultaneous with their effects Naturalistic paradigm: All entities are in a state of mutual simultaneous shaping, so that it is impossible to distinguish causes from effects

Role of Values Positivism paradigm: Naturalistic paradigm: Inquiry is value-free Naturalistic paradigm: Inquiry is value-bound” SOURCE: Lincoln and Guba (1985), p. 37

Research Methods Textbook Which school of thought? “Whatever theory or working hypothesis eventually develops must grow naturally from the data analysis rather than standing to the side as an a priori statement that the data will find to be accurate or wanting.” SOURCE: Powell, p. 154

Outlining Function To ensure methodological integrity, the detailing function of this section of the research proposal includes: Overall research design or the action plan for development

Detailing Functions To ensure methodological integrity, the detailing function of this section of the research proposal includes: Safeguards for internal and external validity Validity and Reliability Internal vs. external validity

Validity and Reliability Reliability can be defined as: Consistency or dependability Validity can be defined as: Credibility (internal; Cronbach’s alpha) or generalizability (external)

Operationalizing Function To ensure methodological integrity, the operationalizing function of the research proposal includes: Operationalizing concepts or Instruments (construction) Techniques

Analyzing Function To ensure methodological integrity, the analyzing function of the research proposal includes: Treatment of data (identification of tests) what format or structure will you present?

Organizing Function To ensure methodological integrity, the organizing function of the research proposal includes: Plan Sequence of events

Qualifying Function To ensure methodological integrity, the qualifying function of the research proposal includes: Special conditions (limitations)

Deficiencies of the Procedures The methodological section can be found to be deficient in the following ways: Missing elements; Overlooked data sources; Project within a project; Externally invalid studies Great disclaimer; Incomplete descriptions No control; Inaccessible or remote data source Overreaching study

Questions Is the method outlined? Is the method detailed? Are any remaining terms or instruments operationalized? Does this section indicate that data screening will be performed?

More Questions Are the tests appropriate and the assumptions met? Is there any organizational plan? Is there a statement about ethical conduct? If necessary, are qualifications or limitations stated?

Just A Gentle Reminder... Remove the disk from the drive now!