BY TEMTIM ASSEFA REVISED SEPTEMBER, 2013 Research Methods for Computer Science, HILCO

Learning Objectives Explain the purpose of research Understand basic concepts in research (constructs, relationship, indicators, research model, theory, etc) Understand research as a scientific method to acquire knowledge Acquire skill to formulate researchable research problems Identify major research problems in computer engineering Explain the different research approaches and methods (Quantitative, qualitative and design science)

Objective … Justify the rational for selecting a particular research method to solve computer Science problems Able to design research projects or research proposal Able to collect data relevant to the research problem Undertake validity and reliability tests of research instruments

Objective … Able to interpret data into meaningful information Acquire skill to plan, execute, and implement research projects in computer science Able to review research articles Able to produce publishable research articles (conference or journals, etc)  Contribute new knowledge to your discipline

Meaning, objective and Overview of research

What Research Is Not Gathering information from resources such books or magazines isn’t a research. It has no contribution to new knowledge. Merely transporting facts from one resource to another doesn’t constitute research. It has no contribution to new knowledge, although this might make existing knowledge more accessible.

Research is not Research is not simply learning about something  Gathering information to know more about a certain area is different from looking at a body of data and deciding how it contributes to the solution of a problem Research problems do not simply result in a “yes” or a “no” answer  Should able to explain why something is happened - e.g computer increases organizational efficiency but add how ?

Research: A Definition “… the systematic process of collecting and analyzing information (data) in order to increase our understanding of the phenomenon about which we are concerned or interested.” an activity that contributes to the understanding of a phenomenon [Kuhn, 1962; Lakatos, 1978]

Research... Research:  phenomenon: a set of behaviors of some entity(ies) that is found interesting by a research community  understanding: knowledge that allows prediction of the behavior of some aspect of the phenomenon  activities considered appropriate to the production of understanding (knowledge) are the research methods and techniques of a research community

Research Characteristics 1. Originates with a question or problem. 2. Requires clear articulation of a goal or objective. 3. Follows a specific plan or procedure. 4. Often divides main problem into sub-problems. 5. Guided by specific problem, question, proposition or hypothesis. 6. Accepts certain critical assumptions. 7. Requires collection and interpretation of data. 8. Cyclical (helical) in nature.

Types of Research 1. Basic Research  its main purpose is the disclosure of fundamental truths or principles  Focuses the testing and development of theory  To extend existing human understanding  Has no immediate application to real world problems Example -  Physists are interested in understanding basic elements that make up matter  Computer scientist are interested to create an efficient algorithm to process data, retrieve information, etc

Cont’d 2. Applied research  To solve existing societal problems  Example - software automation like  Developing a SW that convert word files into database format  Doing payroll processing by a computer  Developing a program that copys files from a computer to a mobile phone

BASIC CONCEPTS IN RESEARCH

Epistemology of Knowledge is the branch of philosophy concerned with the nature and scope (limitations) of knowledge It answers the following questions  What is knowledge?  How is knowledge acquired?  To what extent is it possible for a given subject or entity to be known?

Continued … There is a debate between 1. Knowledge as objective Truth 2. Knowledge as subjective truth

Objective Truth Knowledge exists independent of the knower Knowledge can be measured by measuring instruments Observed independent of the researcher Can be quantified using different statistical methods It is constructed by deductive methods Research is targeted to falsify an existing truth or theory

Knowledge is constructed mainly through observation and experience. Aristotle is the main supporter of this view

Subjective truth Knowledge is a human construct People born with some thought constructs that are used to interprate and give meaning what we experience It is the human that gives meaning to real world objects It is a social construct and exits in the language, text, etc by the human being

Cont’d Knowledge is constructed by reflection, interpretation what respondent says The researcher is part of the knowledge construction process It is constructed by inductive method From observations, general truths are drawn There are as many truth as the there are a number of human beings

Theory An abstraction of realities that serve as a guide for future practice You may think theory as an absolute truth, such as the theory of gravity or the theory of relativity Actually a changing phenomenon, especially in the soft or social sciences. Theories are developed based on what is observed or experienced, often times in the real world. Changed as we gather new facts and observe new relationshi p

Theory -- Cont’d Dubin (1978) notes theory contains three main elements:  A set of well-defined concepts (or units);  Laws of interaction (or interrelationships between the units);  A boundary within which the theory holds. Example  Theory of planned behavior  Design theory  Communication theory  Human Computer Interaction theory (HCI), etc

Theory of Planned Behavior Attitude Subjective Norms IntentionBehavior Controlling Variables Source – Ajzen, 1991

Conceptual Framework It is the researchers understanding of the Research Problem It contains variables and their relationship to be investigated in the research It serve as a guide for the research process It is build from existing theory or prior experience of the researcher It is accepted or modified after the collected empirical data is analyzed and interpreted

Conceptual Framework – uses … are analytical schemes; simplify reality to make it easer to discuss, analyze or research; simplify reality by selecting certain phenomena/variables and suggesting certain relationships between them; are judged in terms or utility, not correctness.

Types of Conceptual Framework

Cause and Effect – explanation …  seeing other people being rewarded for acting well (vicarious reward)  and punished for acting badly (vicarious punishment);  whether people believe they control their own destinies or are at the mercy of forces beyond their control (locus of control)  and their level of moral development increases the likelihood that people will make decisions that are ethical rather than pragmatic.

Type of CF … Stages in a Process the concepts are related because they are stages in a process. Example Project Management Problem 1. It starts with planning and 2. then proceeds through the stages of doing, 3. monitoring and 4. Revising the plan. Here the theory is represented as a circle that flows in a cycle. What about software development theory?

Type of CF … Hierarchical relationships In many conceptual frameworks, concepts are related because they occupy higher or lower positions on a scale or in a hierarchy. Example Maslow’s (1954) Need Hierarchy 1. physiological needs 2. safety needs 3. belongingness needs 4. esteem needs 5. self-actualisation.

Type of CF … Map and coordinates You can define the relationships between concepts by plotting them against a series of coordinates. User requirement Elicitation Low High SW Testing High SW success Low SW success

Theory visa-vis Conceptual Framework Conceptual frameworks provide generalisations about processes, about the interaction of the concepts, whereas theories provide hypotheses about the outcomes of these processes. A conceptual framework might identify persistence, graphical buttons, user experience, etc linked with good user interface design Theory would show how these factors can increase use of the software by different groups of users

Proposition Predictions about the world are made using propositions, that is, conclusions that may be deduced logically from the theory. It establishes one construct with another construct It guides the research process in data collection and data analysis Used in qualitative research methods especially in case study research

Proposition … Example Proposition #1 --- ERP implementation can be successful only if there is a strong and committed leadership guiding the initiative” (Sarker and Lee 2000, p416) “Proposition #2 ----ERP implementation can be successful only if there is open and honest communication among the stakeholders” (Sarker and Lee 2000, p416) “Proposition #3 --- ERP implementation can be successful only if the implementation team is empowered and balanced” (Sarker and Lee 2000

Hypothesis A hypothesis is an empirically testable statement that is generated from a proposition Hypothesis is a tentative solution forwarded by the researcher based on previous theory or experience It is expressed in terms that support collection and analysis of empirical data Terms used in the hypothesis are “things observable” (Dubin 1978) One proposition may generate many hypotheses

Cont’d Begins with theory to identify variables Both hypothesis and research questions are used to guide the researcher  To collect what type of data  How to analyze the collected evidences

Hypothesis … Example 1. Graphical software interface increases SW learnability. 2. Cloud service reduces IT operation costs 3. Component based SW development increases SW project success The deductive testing of hypotheses involves looking for disconfirming evidence to falsify hypotheses (Lee 1989). Falsified hypotheses are then refined based on the reasons for falsification and subjected to further empirical testing.

Methodology A methodology is “a system of principles, practices, and procedures applied to a specific branch of knowledge A methodology might help researchers to produce and present high quality research results that is accepted as valuable, rigorous, and publishable in Computer Science research outlets. Method is one component in the Methodology  Data collection method like interview  Data analysis method like open coding, correlation, regression, etc  Method of prototype system evaluation – how do you evaluate it

Definitions of Terms Define each technical term as it is used in relation to your research project.  Resource – how is defined in the context of library and computer system This helps remove significant ambiguity from the research itself by ensuring that reviewers, while they may not agree with your definitions, at least know what you’re talking about..

Metrics in Research Metrics are measures used to represent the variable For example:  a sex variable is measured by Male or Female  Attitude is measured by likearte scale (Very strongly disagree Strongly Agree)  How do you measure CPU performance? Clearly state how you measure your research variable

Scales of variable measurement There are four measurement scales 1. Nominal – which does not show magnitude like male or famale 2. Ordinal – which measure magnitude but cannot quantify difference e.g poor and rich 3. Interval - measures magnitude and the difference between the two values 1. e.g age years and 20 years 4. Scale – measures which has vales below zero e.g temperature

Know your Research Contributions In what way(s) does your study add significant contribution(s) to:  Extant Theory?  Relevant Practice?

Free Access Journals topics-in-theoretical-computer-science-internet- research-problems-spring-2002/lecture-notes/ topics-in-theoretical-computer-science-internet- research-problems-spring-2002/lecture-notes/