Developing Research Questions & Research Design PDF

Faculty of Management Department of Venture Nizhny Novgorod Creation Developing Research Questions & Research Design Seminar 3 Dr. Waqas Ahmed  2 Agenda PREWRITING GENERAL QUESTION METHODOLOGICAL FIT CONNE...

Faculty of Management Department of Venture Nizhny Novgorod Creation Developing Research Questions & Research Design Seminar 3 Dr. Waqas Ahmed  2 Agenda PREWRITING GENERAL QUESTION METHODOLOGICAL FIT CONNECT THE LITERATURE TO YOUR STUDY CRITICAL ASSESSMENT OF THE LITERATURE THE RESEARCH QUESTION RESEARCH DESIGN DATA COLLECTION TECHNIQUES DATA VALIDITY  3 Prewriting General Questions 1. What does X mean? (Definition) 8. What are the consequences of X? 16. What is my personal response to X? (Causal Analysis) (Reflection) 2. What are the various features of X? (Description) 9. What are the types of X? (Classification) 17. What is my memory of X? (Reminiscence) 3. What are the component parts of X? 10. How is X like or unlike Y? (Comparison) (Simple Analysis) 18. What is the value of X? (Evaluation) 11. What is the present status of X? 4. How is X made or done? (Process (Comparison) 19. What are the essential major points or Analysis) features of X? (Summary) 12. What is the significance of X? 5. How should X be made or done? (Interpretation) 20. What case can be made for or against (Directional Analysis) X? (Persuasion) 13. What are the facts about X? (Reportage) 6. What is the essential function of X? (Functional Analysis) 14. How did X happen? (Narration) 7. What are the causes of X? (Causal 15. What kind of person is X? Analysis) (Characterization/Profile)  4 Topic Identification (initiation) Start writing Research Idea Generation Planning Literature Review Theoretical Theoretical and Conceptual Development Research Research Question Hypotheses Empirical Data gathering Analysis, conclusions The Research Linkages Research Writing full Constructing graphics Process draft Constructing the text Feedback, Completion proofreading, Disserta polishing 5 tion  5 Topic Identification – student is interested in CR and innovation Research Thinking, discussion with supervisor, other students etc Exampl W Reading CR, business ethics, innovation etc. literature Planning e Theory of CR and innovation e.g. CR is a resource R Theoretical (resource-based view of the firm) Research Research question: Does CR function as an innovation I resources? T Hypothesis: More CR firms will tend to be more innovative I Empirical Operational definitions: Measures for CR and innovation N Plan empirical work: Who, where, how, data sources, types, Research access, ethics Data collection G Analysis: Do data support the hypothesis? How far can you generalise? Conclusions: Relate findings to theory, literature; implications for practice; limitations, further research… Final draft 5  6 Research Design Terminology Sample: Who is the subject of my observation? How many subjects do I need to observe? Why is this the best subject of observation? Research participants: A study often determines how the participants will be selected for inclusion in the study and how they will be assigned to groups within it Variables - observation: It refers to the distinct concepts. What is the point of my observation? Which variables/categories does my research include? Operational definition: What is the best way to measure that concept (variable) to examine the specific reality in my research? Or categorized? Interactions: Model: Based on your hypotheses, how are the concepts in my observation connected? Analytical framework: Based on my analytical categories and propositions, which patterns do I expect to find? Data collection: What type of data do I need? How am I going to collect the data? When and from which period (s)? Type of analysis: A) Quantitative: descriptive, correlation, causation, prediction. B) Qualitative: Categorization of emergent narratives, Categorization based on interpretation of the reality, Patterns based on  7 METHODOLOGICAL FIT Four Key Elements of a Field Research Project Element Description Research Focuses a study question Narrows the topic area to a meaningful, manageable size Addresses issues of theoretical and practical signifi cance Points toward a viable research project—that is, the question can be answered Prior The state of the literature work Existing theoretical and empirical research papers that pertain to the topic of the current study An aid in identifying unanswered questions, unexplored areas, relevant constructs, and areas of Research low agreement design Type of data to be collected Data collection tools and procedures Type of analysis planned Contribution to Finding/selection of sites for collecting data literature The theory developed as an outcome of the study New ideas that contest conventional wisdom, challenge prior assumptions, integrate prior streams of research to produce a new model, or refi ne understanding of a phenomenon Any practical insights drawn from the fi ndings that may be suggested by the researcher Source: Edmondson and Mc  8 METHODOLOGICAL FIT Field Research As an Iterative, Cyclic Learning Journey Source: Edmondson and Mc  9 Connect the literature to your study 1. Beginning with the definitions from the literature Example: Topic: The hidden narratives of ethical dilemmas to legitimise strategic decisions in Multinationals Definition of (ethical dilemma) Nuances of strategic decision What is a legitimate strategic decision  10 Connect the literature to your study 2. What the reader needs to know to grasp the meaning of your study Example: Topic: The hidden narratives of ethical dilemmas to legitimise strategic decisions in Multinationals When an ethical dilemma in strategic decisions is presented? What kind of ethical dilemmas are recognised? In which context do I find an ethical dilemma? Which factors are involved in an ethical dilemma?  11 Connect the literature to your study 3. What evidence has been provided from previous research to support your study Example: Topic: The hidden narratives of ethical dilemmas to legitimise strategic decisions in Multinationals What do we know about ethical dilemmas in multinationals? Are there any differences between multinationals from different contexts of origin? Are there any differences between multinationals concerning the type of  12 Connect the literature to your study 4. At what stage has the theory been built in explaining the phenomena in your study Example: Topic: The hidden narratives of ethical dilemmas to legitimise strategic decisions in Multinationals Is the theory Mature? It presents well-developed constructs and models studied over time with increasing precision by various scholars. This results in a body of work consisting of broad agreement points representing cumulative knowledge gained. Is the theory intermediate? Presents provisional explanations of phenomena, often introducing a new construct and proposing relationships between it and established constructs. Although the research questions may allow the development of testable hypotheses, like mature theory research, one or more of the constructs involved is often tentative, similar to nascent theory research. Is the theory nascent? Proposes tentative answers to novel questions of how and why, often merely suggesting new  13 In mature theories Researh problems A researcher might, for example, test a theory in a new setting, identify or clarify the boundaries of a theory, examine a mediating mechanism, or provide new support for or against previous work. Researchers draw from the literature to argue the need for a new study and to develop the logic underlying the hypotheses they will test. This hypothesis-testing approach examines relationships between previously developed constructs (and variables) to produce Researh questions Research questions and designs thus utilize correlation-based analyses consistent variance theory. with causal inferences supported by logic. Researh design These studies rely heavily on statistical analyses and inferences to support new theoretical propositions. Surveys; interviews or observations designed to be systematically coded and quantified; obtaining data from field sites that measure the extent or amount of salient constructs  14 In intermediate theories Researh problems Intermediate theory research draws from prior work— often from separate bodies of literature— to propose new constructs and/or provisional theoretical relationships. The research outcome may present promising new measures and data consistent with the provisional theory presented. One trigger for developing intermediate theory is the desire to reinvestigate a theory or construct within a mature research stream to challenge or modify prior work. Research questions conducive to developing intermediate theory include initial tests of hypotheses enabled by prior theory (e.g., Edmond- son, 1999) and focused exploration Researh questions that generates theoretical propositions as output (e.g., Eisenhardt, 1989b). The latter may include preliminary quantitative analysis to reinforce the logic underlying the qualitatively induced propositions. A single study may describe patterns that suggest both variance theories (an increase in X leads to an increase in Y) and process theories (how a phenomenon works, how a process unfolds) Research design Just as quantitative methods are appropriate for mature theory and qualitative methods for nascent theory, intermediate theory is well served by a blend of both. Interviews, observations, surveys, and obtaining material from field sites relevant to the phenomena of interest.  15 Nascent theories Researh problems These topics have attracted little research or formal theorizing to date, or they represent new phenomena in the world. Developing insight about a novel or unusual phenomenon, digging into a paradox, and explaining the occurrence of a surprising event. Interest in these problems can arise from unexpected findings in the field, from questioning assumptions or accepted wisdom promulgated in the extant literature, and from identifying The researchand addressing questions gaps are more in existing open-ended theory. than those used to further knowledge in mature areas of the literature. In studies where theory is nascent or immature, Researh questions researchers do not know what issues may emerge from the data, so they avoid hypothesizing specific relationships between variables. Because little is known, rich, detailed, and evocative data are needed to illuminate the Research design phenomenon. Interviews, observations, open-ended questions, and longitudinal investigations are methods for learning with an open mind. Openness to input from the field helps ensure that researchers identify and investigate key variables over the course of the study. Data collection may involve the full immersion of ethnography or, more simply, exploratory interviews with organizational informants. Researchers frequently use a grounded theory approach.  16 RESEARCH PROBLEM Feature Description The object of Here you describe the phenomenon of study, for instance inquiry ( Description (a) Process in an organisation (e.g. the product innovation process in SMEs); of the topic (b) The causal relationship between two concepts. statement) (c) The interaction between two organisations (e.g. cooperation between MNEs and SMEs; suppliers and buyers) (d) An organisational decision/ practice in terms of its evolution, categorisation (e) What clarities does the literature provide? Main domains of The treatment and discussion prior literature provide about the concepts in your research. inquiry (Discuss and (a) Have the concept change define the main (b) How the concepts offer clarity to the phenomenon of the study concepts in your (c) Have the concepts been split into categories? inquiry) (d) If the concepts are not clear or not applicable to your phenomenon, this is part of your research problem. Causal interaction / The literature provides claims about how the phenomenon of study has been treated and patterns/ alternative explanations. You need to answer: descriptions / (a) What was the literature about the interactions between concepts, processes, decisions, etc.? categorization and (b) Are the claims specific to your object of inquiry? explanation (c) Has the prior literature provided the explanations, the patterns, the descriptions and the casual interactions that specifically refer to your inquiry? Research In which particular geographic context, type of organization, moment, situation and organizational process settings or practice prior literature done research similar to you? (Evidence) How does your context of research provide an additional understanding from what prior literature in other conditions has provided already?  17 RESEARCH QUESTIONS One of the key criteria for your research success will be whether you have a set of clear conclusions drawn from the data you have collected. The extent to which you can do that will be determined largely by the clarity with which you have posed your initial research questions. A research question comprises a connection to a theoretical framework. The pitfall you must avoid at all costs is asking research questions that will not generate new insights. This raises the question of the extent to which you have consulted the relevant literature. It is perfectly legitimate to replicate research because you are genuinely concerned about its applicability to your research setting (for example, your organisation). However, displaying your ignorance of the literature is not legitimate. (SAUNDERS ET AL, 2009)  18 RESEARCH QUESTIONS (QUANTITATIVE RESEARCH) 1 3 4 2 Descriptive Normative Correlative Impact What are the events, (‘What is happening (‘What is the (‘What impact does a belief, attitudes, social compared to what should relationship, and the change in X have on strictures and happen?). strength of this Y?’). processes occurring in The standards against relationship, between this phenomenon? In contrast to could which the include outcomes variable X and Y?’). correlation studies, requirements, legalare evaluated (‘What is happening’, standards or professional Note that this impact questions do ‘Which methods are programme objectives establishes a try to establish a causal being used?’). relationship, but it does relationship between not imply a cause. variables.  19 Example: Use of Generative AI in Business Decision-making Descriptive research Normative research Correlative research Causal research questions questions questions questions 1. What percentage of 1. To what extent should 1. Is there a relationship 1. Does the Fortune 500 companies rely on between the adoption implementation of companies are generative AI for of generative AI tools generative AI in currently using making critical and the financial supply chain generative AI tools in financial decisions? performance of small management lead to their decision-making 2. How can businesses to medium-sized a reduction in processes? balance the use of AI- enterprises? operational costs? 2. How often do mid- generated insights 2. How does the 2. To what extent does level managers in with human intuition frequency of using AI- the use of AI-powered tech startups consult in strategic planning? generated predictive analytics AI-generated reports 3. What ethical recommendations cause an before making guidelines should be correlate with the improvement in the strategic choices? established for the speed of decision- accuracy of sales 3. What types of use of generative AI making in corporate forecasts? business decisions in hiring and human environments? 3. How does the are most commonly resource decisions? 3. Is there an integration of aided by generative association between generative AI in AI across different a company's customer service  20 RESEARCH QUESTIONS (QUALITATIVE RESEARCH) 1 3 4 2 Exploratory Explanatory Descriptive Emancipator To investigate little- To explain the To document and y understood patterns related to a describe the To create phenomenon phenomenon phenomenon of opportunities and To understand To identify plausible interest will to engage in important categories of relationships shaping social acation meaning the phenomenon To Generate hypothesis for further research  21 RESEARCH QUESTIONS (QUALITATIVE RESEARCH) Exploratory questions Explanatory questions Descriptive questions Emancipatory questions 1. How are business 1. Why do some 1. How do managers 1. How can the leaders perceiving the businesses readily describe their implementation of role of generative AI in adopt generative AI for experiences of using generative AI in their decision-making decision-making while generative AI tools in business decision- processes? others remain hesitant? day-to-day decision- making be designed to 2. What unexpected 2. How does a company's making? promote equity and challenges or organisational culture 2. What changes in inclusion across all opportunities have influence its approach decision-making levels of an emerged for companies to implementing processes do organization? as they integrate generative AI in employees observe 2. In what ways might generative AI into their decision-making after the introduction of generative AI be used strategic planning? processes? generative AI in their to challenge existing 3. In what novel ways are 3. What factors contribute organization? power structures and different industries to successfully 3. How do business democratize decision- experimenting with integrating generative leaders articulate the making processes generative AI to AI insights with human benefits and drawbacks within companies? enhance their decision- expertise in business of AI-generated insights 3. How can employees making capabilities? decision-making? for strategic decisions? who feel marginalized by the introduction of AI in decision-making be  22 Quantitative & Qualitative Research Quantitative research Qualitative research Quantitative research involves Qualitative research typically studies that make use of involve the use of systematic statistical analyses to obtain their data collection through interviews findings. Key features include and observations without formal using large samples, formal and measurement. A case study, systematic measurement and the which is an in-depth examination use of statistics. of one person, organization or situation is a form of qualitative research.  23 Quantitative & Qualitative Research Design Type Quantitative research Qualitative research Experimental Research Case study Field experiment Single Survey research Multiple case study Data-driven research Comparative case study Ethnography Grounded theory Action research  24 Population & Sample Size Quantitative research Qualitative research The nomothetic approach studies groups to The idiographic approach is the study of an identify general laws that apply to a large individual. An example of the idiographic group of people. The goal is often to identify approach is the case study. the average member of the group being studied or the average performance of a group member. The choice of which research approaches to use largely depends on: The types of research questions being asked in the research study The chosen type of evidence The availability and accessibility of the data  25 Sample: Defining your research participants Quantitative research Qualitative research Random selection: Choosing study Qualitative researchers are more likely to participants from the population of interest so select a purposive sample of individuals. that each member of the population has an equal probability of being selected to Single cases: Extreme and unique events, participate in the study. organizations or individuals. Random assignment (stratified Multiplecase studies: Typical events are random): Assigning study participants to organized or individual. groups within the study so that each participant has an equal probability of being Comparative case study: Heterogeneous assigned to any of the groups within the events, organizational or individuals. study.  26 Variables (Quantitative) and Categories (Qualitative) of Analysis A variable is anything that can take on different values, such as weight, time, and height.) Independent Variables vs. (intervening) Dependent Variables Independent variable is the factor that is manipulated or controlled by the researcher. Intervening (control) variables: independent variables may act upon dependent variables only indirectly via intervening variables The dependent variable measures the independent variable's effect (if any). Categorical Variables vs. Continuous Variables Categorical variables can take on specific values only within a defined range. Categorical variables consist of discrete, mutually exclusive categories, such as “male/female,” “White/Black,” “single/married/divorced,” and “blonde/brunette/redhead.” Continuous variables can take on any value along a continuum. For example, “age” is a continuous variable because, theoretically, at least, someone can be any age. “Income,” “weight,” and “height” are other examples of continuous variables.  27 Data Collection Quantitative research Qualitative research Survey: when a detailed and quantified Observation description of a population – a precise map or Direct observation a precise measurement of potential. Participant observation Descriptive surveys are designed to measure the characteristics of a particular Structured and semi-structured interviews population. Analytical surveys attempt to test a theory Focus group interviews in the field, mainly to explore and test associations between variables. Documentation: Collecting narratives and images from written reports Official databases: when data is produced by official organizations who made surveys to Archival records: Use in socio-historical collect the data systematically, and the research. researcher has access to the microdata.  28 Data Analysis Quantitative research Qualitative research Descriptive statistics Pattern matching Correlation (Anova) Explanation building Causation Socio-historical analysis Regression analysis Cognitive maps Multiple regression analysis Discourse analysis Content analysis Tools: MS Excel, Stata, SPSS Tools: NVIVO, Atlasti  29 Validity Internal validity refers to the ability of a research design to rule out or make implausible alternative explanations of the results or plausible rival hypotheses. (A plausible rival hypothesis is an alternative interpretation of the researcher’s hypothesis about the interaction of the dependent and independent variables that provides a reasonable explanation of the findings other than the researcher’s original hypothesis.) Construct validity refers to the basis of the causal relationship and is concerned with the congruence between the study’s results and the theoretical underpinnings guiding the research. In essence, construct validity asks whether the theory supported by the findings best explains the results. External validity refers to the generalizability of the results of a research study. In all forms of research design, the results and conclusions of the study are limited to the participants and conditions as defined by the contours of the research. External validity refers to the degree to which research results generalize to other conditions, participants, times, and places. Statistical validity refers to aspects of quantitative evaluation that affect the accuracy of the conclusions drawn from the results of a study. At its simplest level, statistical validity addresses whether the statistical conclusions drawn from the results of a study are reasonable.  30 Tools for referencing Mendeley https://www.mendeley.com/ EndNote https://endnote.com/ Zotero https://www.zotero.org/ Preferred Referencing Styles APA 7 Harvard For Referencing Guide https://www5.open.ac.uk/library/referencing-and-plagiarism/quick-guide-to-harvard-referencing-cite-them-right https://subjectguides.york.ac.uk/referencing-style-guides  31 Exercise Please use this format to define your research problem https://forms.gle/yratyyWBV5Go3t7h9