Podcast
Questions and Answers
What is standard regression?
What is standard regression?
Predicts a dependent variable using two or more independent variables simultaneously.
What is the best fitting line?
What is the best fitting line?
The most appropriate line showing the relationship between dependent and independent variables.
What is error ?
What is error ?
The difference between the observed value and the true value (often unobserved).
What is unique variance?
What is unique variance?
Signup and view all the answers
What is shared variance?
What is shared variance?
Signup and view all the answers
What is the general linear model in regression and ANOVA?
What is the general linear model in regression and ANOVA?
Signup and view all the answers
What is the standardised slope
What is the standardised slope
Signup and view all the answers
What is total variance SS total?
What is total variance SS total?
Signup and view all the answers
What is SS regression
What is SS regression
Signup and view all the answers
What is SS residual?
What is SS residual?
Signup and view all the answers
What is the regression coefficient R2?
What is the regression coefficient R2?
Signup and view all the answers
What is the unstandardised coefficient?
What is the unstandardised coefficient?
Signup and view all the answers
What is the standardised coefficient?
What is the standardised coefficient?
Signup and view all the answers
What is semi-partial correlation (sr2)?
What is semi-partial correlation (sr2)?
Signup and view all the answers
What is partial correlation?
What is partial correlation?
Signup and view all the answers
What is a studentised residual?
What is a studentised residual?
Signup and view all the answers
What is a discrepancy score?
What is a discrepancy score?
Signup and view all the answers
What is an influential score?
What is an influential score?
Signup and view all the answers
What is the assumption of linearity?
What is the assumption of linearity?
Signup and view all the answers
What is the assumption of homoscedasticity?
What is the assumption of homoscedasticity?
Signup and view all the answers
What is the assumption of normality?
What is the assumption of normality?
Signup and view all the answers
What is multicollinearity?
What is multicollinearity?
Signup and view all the answers
What is tolerance and variance inflation factor (VIF)
What is tolerance and variance inflation factor (VIF)
Signup and view all the answers
What is the standard multiple regression?
What is the standard multiple regression?
Signup and view all the answers
What is hierarchical regression model?
What is hierarchical regression model?
Signup and view all the answers
What is statistical regression (stepwise).
What is statistical regression (stepwise).
Signup and view all the answers
What is mediated regression?
What is mediated regression?
Signup and view all the answers
What is the order of a mediated regression?
What is the order of a mediated regression?
Signup and view all the answers
What is a parallel mediator model?
What is a parallel mediator model?
Signup and view all the answers
What are the 4 steps of Baron and Kenny mediated regression
What are the 4 steps of Baron and Kenny mediated regression
Signup and view all the answers
How do you obtain the total effects of the ab pathway?
How do you obtain the total effects of the ab pathway?
Signup and view all the answers
What is bootstrapping used for?
What is bootstrapping used for?
Signup and view all the answers
What is the sobel test?
What is the sobel test?
Signup and view all the answers
What is moderating regression analysis?
What is moderating regression analysis?
Signup and view all the answers
What is unconditional?
What is unconditional?
Signup and view all the answers
What does the b3 coefficient reflect?
What does the b3 coefficient reflect?
Signup and view all the answers
What is the moderated regression equation?
What is the moderated regression equation?
Signup and view all the answers
What coefficient (standardised or unstandardised slope) do we use for moderated regression?
What coefficient (standardised or unstandardised slope) do we use for moderated regression?
Signup and view all the answers
What is an additive model?
What is an additive model?
Signup and view all the answers
What is an interactive model?
What is an interactive model?
Signup and view all the answers
What is a pick a point technique in moderated regression?
What is a pick a point technique in moderated regression?
Signup and view all the answers
What is Johnson-Neyman Test?
What is Johnson-Neyman Test?
Signup and view all the answers
What is an issue in moderated regression?
What is an issue in moderated regression?
Signup and view all the answers
What is homogeneity of regression?
What is homogeneity of regression?
Signup and view all the answers
What is the T statistics?
What is the T statistics?
Signup and view all the answers
What ist he F stastic?
What ist he F stastic?
Signup and view all the answers
What is SS between?
What is SS between?
Signup and view all the answers
What is SS within?
What is SS within?
Signup and view all the answers
What is an omnibus test?
What is an omnibus test?
Signup and view all the answers
What are the three ANOVA designs
What are the three ANOVA designs
Signup and view all the answers
What is the main effect?
What is the main effect?
Signup and view all the answers
What is the interaction?
What is the interaction?
Signup and view all the answers
What is disordinal interaction?
What is disordinal interaction?
Signup and view all the answers
What is the main effect in ANOVA?
What is the main effect in ANOVA?
Signup and view all the answers
What is the simple effects in ANOVA?
What is the simple effects in ANOVA?
Signup and view all the answers
What are the similarities of bivariate correlation and semi partial correlation
What are the similarities of bivariate correlation and semi partial correlation
Signup and view all the answers
What is studenised residual?
What is studenised residual?
Signup and view all the answers
What is Cook's Distance
What is Cook's Distance
Signup and view all the answers
Why should you use bootstrapping for mediated regression.
Why should you use bootstrapping for mediated regression.
Signup and view all the answers
Why are eigenvalues different from the unrotated and rotated factor matrices?
Why are eigenvalues different from the unrotated and rotated factor matrices?
Signup and view all the answers
Explain differences between an unrotated factor
matrix, varimax & oblique rotations of obtained
factors. When would you use each?
Explain differences between an unrotated factor matrix, varimax & oblique rotations of obtained factors. When would you use each?
Signup and view all the answers
Why is it important to assess the reliability of
each of the factors produced in a principal
components or factor analysis?
Why is it important to assess the reliability of each of the factors produced in a principal components or factor analysis?
Signup and view all the answers
When should a covariate be used in an analysis? Give an
example.
When should a covariate be used in an analysis? Give an example.
Signup and view all the answers
Describe homogeneity of regression used in ANCOVA.
Describe homogeneity of regression used in ANCOVA.
Signup and view all the answers
What is difference between conditional and unconditional effects in ANOVA or regression?
What is difference between conditional and unconditional effects in ANOVA or regression?
Signup and view all the answers
What is difference between a balanced and unbalanced design in ANOVA? What sorts of difficulties can an unbalanced design cause?
What is difference between a balanced and unbalanced design in ANOVA? What sorts of difficulties can an unbalanced design cause?
Signup and view all the answers
Please explain Mauchly’s test, and when is it not conducted in a study?
Please explain Mauchly’s test, and when is it not conducted in a study?
Signup and view all the answers
What is KMO sampling technique in FA/PCA?
What is KMO sampling technique in FA/PCA?
Signup and view all the answers
What is Bartlett's test of sphericity in FA /PCA
What is Bartlett's test of sphericity in FA /PCA
Signup and view all the answers
What is the primary difference between unconditional and conditional effects in ANOVA or regression?
What is the primary difference between unconditional and conditional effects in ANOVA or regression?
Signup and view all the answers
What is the primary advantage of a balanced design in ANOVA?
What is the primary advantage of a balanced design in ANOVA?
Signup and view all the answers
What is the purpose of Mauchly's test in ANOVA?
What is the purpose of Mauchly's test in ANOVA?
Signup and view all the answers
What is the primary function of the KMO sampling technique in FA/PCA?
What is the primary function of the KMO sampling technique in FA/PCA?
Signup and view all the answers
What is the purpose of Bartlett's test of sphericity in FA/PCA?
What is the purpose of Bartlett's test of sphericity in FA/PCA?
Signup and view all the answers
What is the consequence of an unbalanced design in ANOVA?
What is the consequence of an unbalanced design in ANOVA?
Signup and view all the answers
What is a characteristic of conditional effects in ANOVA or regression?
What is a characteristic of conditional effects in ANOVA or regression?
Signup and view all the answers
What is the primary purpose of standard regression?
What is the primary purpose of standard regression?
Signup and view all the answers
When is Mauchly's test not conducted in a study?
When is Mauchly's test not conducted in a study?
Signup and view all the answers
Which of the following is a characteristic of unique variance?
Which of the following is a characteristic of unique variance?
Signup and view all the answers
What is the relationship between the standardized slope and the unstandardized coefficient?
What is the relationship between the standardized slope and the unstandardized coefficient?
Signup and view all the answers
What is the purpose of the general linear model in regression and ANOVA?
What is the purpose of the general linear model in regression and ANOVA?
Signup and view all the answers
What is the difference between SS total and SS regression?
What is the difference between SS total and SS regression?
Signup and view all the answers
What is the range of the regression coefficient R2?
What is the range of the regression coefficient R2?
Signup and view all the answers
What is the purpose of the standardized coefficient?
What is the purpose of the standardized coefficient?
Signup and view all the answers
What is the semi-partial correlation (sr2) used for?
What is the semi-partial correlation (sr2) used for?
Signup and view all the answers
Which of the following assumptions is NOT related to the distribution of the dependent variable?
Which of the following assumptions is NOT related to the distribution of the dependent variable?
Signup and view all the answers
What is the primary difference between hierarchical and stepwise regression?
What is the primary difference between hierarchical and stepwise regression?
Signup and view all the answers
Which of the following is a measure of the indirect effect in mediated regression?
Which of the following is a measure of the indirect effect in mediated regression?
Signup and view all the answers
What is the purpose of bootstrapping in mediated regression?
What is the purpose of bootstrapping in mediated regression?
Signup and view all the answers
Which of the following is a characteristic of an interactive model?
Which of the following is a characteristic of an interactive model?
Signup and view all the answers
What is the purpose of the Johnson-Neyman test?
What is the purpose of the Johnson-Neyman test?
Signup and view all the answers
Which of the following is a limitation of moderated regression?
Which of the following is a limitation of moderated regression?
Signup and view all the answers
What is the difference between a discrepancy score and an influential score?
What is the difference between a discrepancy score and an influential score?
Signup and view all the answers
Which of the following is a characteristic of a parallel mediator model?
Which of the following is a characteristic of a parallel mediator model?
Signup and view all the answers
What is the coefficient that reflects the interaction between the predictor and moderator variables?
What is the coefficient that reflects the interaction between the predictor and moderator variables?
Signup and view all the answers
What is a key assumption for using a covariate in an analysis?
What is a key assumption for using a covariate in an analysis?
Signup and view all the answers
What is the main effect in ANOVA?
What is the main effect in ANOVA?
Signup and view all the answers
What is the purpose of bootstrapping in mediated regression?
What is the purpose of bootstrapping in mediated regression?
Signup and view all the answers
What is the difference between an unrotated factor matrix and varimax rotation?
What is the difference between an unrotated factor matrix and varimax rotation?
Signup and view all the answers
What is the purpose of assessing the reliability of each factor produced in a principal components or factor analysis?
What is the purpose of assessing the reliability of each factor produced in a principal components or factor analysis?
Signup and view all the answers
What is the definition of disordinal interaction?
What is the definition of disordinal interaction?
Signup and view all the answers
What is the purpose of Cook's Distance?
What is the purpose of Cook's Distance?
Signup and view all the answers
What is the difference between bivariate correlation and semi-partial correlation?
What is the difference between bivariate correlation and semi-partial correlation?
Signup and view all the answers
What is the purpose of an omnibus test?
What is the purpose of an omnibus test?
Signup and view all the answers
What is the definition of homogeneity of regression in ANCOVA?
What is the definition of homogeneity of regression in ANCOVA?
Signup and view all the answers
What is the primary purpose of standard regression?
What is the primary purpose of standard regression?
Signup and view all the answers
What is the main difference between unique variance and shared variance?
What is the main difference between unique variance and shared variance?
Signup and view all the answers
What is the purpose of the general linear model in regression and ANOVA?
What is the purpose of the general linear model in regression and ANOVA?
Signup and view all the answers
What does the standardised slope represent in standard regression?
What does the standardised slope represent in standard regression?
Signup and view all the answers
What is the purpose of the regression coefficient R2?
What is the purpose of the regression coefficient R2?
Signup and view all the answers
What is the main difference between the unstandardised coefficient and the standardised coefficient?
What is the main difference between the unstandardised coefficient and the standardised coefficient?
Signup and view all the answers
What does the semi-partial correlation (sr2) represent?
What does the semi-partial correlation (sr2) represent?
Signup and view all the answers
What is the condition for using a covariate in an analysis?
What is the condition for using a covariate in an analysis?
Signup and view all the answers
What is the main effect in ANOVA?
What is the main effect in ANOVA?
Signup and view all the answers
What is disordinal interaction?
What is disordinal interaction?
Signup and view all the answers
What is Cook's Distance?
What is Cook's Distance?
Signup and view all the answers
What is the purpose of bootstrapping in mediated regression?
What is the purpose of bootstrapping in mediated regression?
Signup and view all the answers
What is the difference between an unrotated factor matrix and varimax & oblique rotations?
What is the difference between an unrotated factor matrix and varimax & oblique rotations?
Signup and view all the answers
Why is it important to assess the reliability of each of the factors produced in a principal components or factor analysis?
Why is it important to assess the reliability of each of the factors produced in a principal components or factor analysis?
Signup and view all the answers
What is homogeneity of regression assumption in ANCOVA?
What is homogeneity of regression assumption in ANCOVA?
Signup and view all the answers
What is the purpose of using ANOVA?
What is the purpose of using ANOVA?
Signup and view all the answers
What is the difference between bivariate correlation and semi-partial correlation?
What is the difference between bivariate correlation and semi-partial correlation?
Signup and view all the answers
Which type of regression analysis involves an indirect effect, where the independent variable influences the dependent variable through a second independent variable?
Which type of regression analysis involves an indirect effect, where the independent variable influences the dependent variable through a second independent variable?
Signup and view all the answers
What is the purpose of the Baron and Kenny mediated regression steps?
What is the purpose of the Baron and Kenny mediated regression steps?
Signup and view all the answers
What is the name of the technique used to produce a figure to describe the association in moderated regression?
What is the name of the technique used to produce a figure to describe the association in moderated regression?
Signup and view all the answers
What is the assumption that the variance of the residual is the same for any value of the independent variable?
What is the assumption that the variance of the residual is the same for any value of the independent variable?
Signup and view all the answers
What is the term for the correlation between a predictor variable and the outcome variable while removing the shared variance with other predictors?
What is the term for the correlation between a predictor variable and the outcome variable while removing the shared variance with other predictors?
Signup and view all the answers
What is the name of the test that is no longer used for significant testing for a mediated regression?
What is the name of the test that is no longer used for significant testing for a mediated regression?
Signup and view all the answers
What is the term for the influence of one independent variable on the dependent variable changing based on the score on a second independent variable?
What is the term for the influence of one independent variable on the dependent variable changing based on the score on a second independent variable?
Signup and view all the answers
What is the coefficient that reflects the interaction between the independent variable and the moderator variable?
What is the coefficient that reflects the interaction between the independent variable and the moderator variable?
Signup and view all the answers
What is the minimum recommended sample size for moderated regression analysis?
What is the minimum recommended sample size for moderated regression analysis?
Signup and view all the answers
What is the type of regression analysis where the effect of one predictor is dependent or conditional on the other predictor?
What is the type of regression analysis where the effect of one predictor is dependent or conditional on the other predictor?
Signup and view all the answers
What is the primary difference between unconditional and conditional effects in ANOVA or regression?
What is the primary difference between unconditional and conditional effects in ANOVA or regression?
Signup and view all the answers
What is the primary issue with unbalanced designs in ANOVA?
What is the primary issue with unbalanced designs in ANOVA?
Signup and view all the answers
What is the purpose of Mauchly's test in ANOVA?
What is the purpose of Mauchly's test in ANOVA?
Signup and view all the answers
What does the Kaiser-Meyer-Olkin (KMO) sampling technique measure in factor analysis?
What does the Kaiser-Meyer-Olkin (KMO) sampling technique measure in factor analysis?
Signup and view all the answers
What is the purpose of Bartlett's test of sphericity in factor analysis?
What is the purpose of Bartlett's test of sphericity in factor analysis?
Signup and view all the answers
What is the primary difference between balanced and unbalanced designs in ANOVA?
What is the primary difference between balanced and unbalanced designs in ANOVA?
Signup and view all the answers
What is the result of a non-significant Mauchly's test?
What is the result of a non-significant Mauchly's test?
Signup and view all the answers
When is Mauchly's test not conducted in a study?
When is Mauchly's test not conducted in a study?
Signup and view all the answers
Study Notes
Regression Analysis
- Standard Regression: A statistical method used to establish a relationship between a dependent variable and one or more independent variables.
- Best Fitting Line: A line that minimizes the sum of the squared errors between the observed and predicted values.
- Error: The difference between the observed and predicted values.
- Unique Variance: The variance in the dependent variable that is explained by a single independent variable.
- Shared Variance: The variance in the dependent variable that is explained by multiple independent variables.
General Linear Model
- General Linear Model in Regression and ANOVA: A statistical model that describes the relationship between a dependent variable and one or more independent variables.
- Standardized Slope: A measure of the strength of the relationship between the dependent variable and an independent variable, expressed in standard deviation units.
Variance Components
- Total Variance (SS Total): The total amount of variance in the dependent variable.
- SS Regression: The amount of variance in the dependent variable explained by the independent variables.
- SS Residual: The amount of variance in the dependent variable not explained by the independent variables.
- Regression Coefficient (R2): A measure of the proportion of variance in the dependent variable explained by the independent variables.
Coefficients
- Unstandardized Coefficient: A measure of the change in the dependent variable for a one-unit change in the independent variable.
- Standardized Coefficient: A measure of the change in the dependent variable for a one-standard-deviation change in the independent variable.
- Semi-Partial Correlation (sr2): A measure of the unique variance in the dependent variable explained by an independent variable.
- Partial Correlation: A measure of the linear relationship between two variables while controlling for the effects of other variables.
Residuals
- Studentized Residual: A measure of the difference between the observed and predicted values, expressed in standard deviation units.
- Discrepancy Score: A measure of the difference between the observed and predicted values.
- Influential Score: A measure of the influence of a data point on the regression analysis.
Assumptions
- Assumption of Linearity: The assumption that the relationship between the dependent variable and independent variables is linear.
- Assumption of Homoscedasticity: The assumption that the variance of the residuals is constant across all levels of the independent variables.
- Assumption of Normality: The assumption that the residuals are normally distributed.
- Multicollinearity: The problem of high correlation between independent variables.
Regression Models
- Standard Multiple Regression: A regression model that includes multiple independent variables to predict the dependent variable.
- Hierarchical Regression Model: A regression model that includes independent variables in a specific order to predict the dependent variable.
- Statistical Regression (Stepwise): A regression model that selects the most important independent variables to predict the dependent variable.
- Mediated Regression: A regression model that examines the indirect effect of an independent variable on the dependent variable through a mediator variable.
- Order of a Mediated Regression: The order in which the independent variable, mediator variable, and dependent variable are related.
- Parallel Mediator Model: A mediated regression model in which the independent variable affects the dependent variable through multiple mediator variables.
- 4 Steps of Baron and Kenny Mediated Regression: A mediated regression model that involves four steps to test the indirect effect of an independent variable on the dependent variable.
Moderated Regression
- Moderated Regression Analysis: A regression model that examines the interaction between an independent variable and a moderator variable to predict the dependent variable.
- Unconditional: A term used to describe the main effect of an independent variable on the dependent variable.
- B3 Coefficient: The coefficient that reflects the interaction between the independent variable and moderator variable.
- Moderated Regression Equation: An equation that includes the interaction term between the independent variable and moderator variable.
- Standardized or Unstandardized Slope: The coefficient used to interpret the interaction between the independent variable and moderator variable.
- Additive Model: A model that assumes the effect of the independent variable on the dependent variable is the same across all levels of the moderator variable.
- Interactive Model: A model that assumes the effect of the independent variable on the dependent variable changes across different levels of the moderator variable.
- Pick-a-Point Technique: A method used to interpret the interaction between the independent variable and moderator variable.
- Johnson-Neyman Test: A test used to determine the regions of significance for the interaction between the independent variable and moderator variable.
ANOVA
- T-Statistics: A test statistic used to compare the means of two groups.
- F-Statistic: A test statistic used to compare the means of multiple groups.
- SS Between: The sum of squared differences between the group means and the grand mean.
- SS Within: The sum of squared differences within each group.
- Omnibus Test: A test used to determine whether the means of multiple groups are different.
- Three ANOVA Designs: One-way ANOVA, two-way ANOVA, and factorial ANOVA.
- Main Effect: The effect of an independent variable on the dependent variable.
- Interaction: The effect of the interaction between two or more independent variables on the dependent variable.
- Disordinal Interaction: An interaction in which the effect of an independent variable on the dependent variable changes direction across different levels of another independent variable.
Standard Regression
- Predicts a dependent variable using two or more independent variables simultaneously.
- The best-fitting line shows the relationship between the dependent and independent variables.
- Error is the difference between the observed value and the true value (often unobserved).
Variance in Regression
- Unique variance is the variability in a dependent variable (DV) uniquely explained by specific independent variables (IVs) in multiple regression, distinct from Pearson's correlation where unique variance isn't assessed.
- Shared variance is the variability in a DV explained by multiple IVs simultaneously in both multiple regression and Pearson's correlation.
General Linear Model
- Data = Model + Error
Standardized Slope and Coefficients
- The standardized slope is the change in the DV for one unit change in the IV, holding other IVs constant, excluding shared variance.
- The unstandardized coefficient is the slope of the regression line, reflecting the change in the DV from one unit change in the IV, while holding all other variables constant.
- The standardized coefficient is the slope of the regression line in standard deviation units, making it comparable with other standardized coefficients.
Regression Analysis
- Semi-partial correlation (sr2) is the correlation between the predictor and outcome variable, with variance shared between other predictors controlled in the predictor variable only.
- Partial correlation is the correlation between a predictor variable and outcome variable, while removing the shared variance with other predictors.
- The regression coefficient (R2) represents the proportion of variance in the DV that is explained by the IV in the model.
Assumptions in Regression
- Linearity: The relationship between the IV and the mean of the DV is linear.
- Homoscedasticity: The variance of the residual is the same for any IV.
- Normality: For any fixed value of the IV, the DV is normally distributed.
Outliers and Influential Scores
- Studentized residual is an outlier score, unusual on the IV.
- Discrepancy score is the most unstable, unusual on both IV and DV.
- Influential score is unusual on the IV.
Multicollinearity
- Multicollinearity occurs when the associations between predictors are not independent.
- Tolerance and variance inflation factor (VIF) are used to measure multicollinearity.
Types of Regression
- Standard multiple regression: predicts a DV using two or more IVs, with equal importance to explanation.
- Hierarchical regression model: determines what happens based on theory, with variables entered based on theoretical importance or control.
- Statistical regression (stepwise): not based on theory, but on the size of the correlation.
- Mediated regression: uses an indirect effect, where the IV influences the DV by a pathway through a second IV (mediator).
Mediated Regression
- The order of a mediated regression is: IV precedes the mediator in time, and the mediator precedes the DV.
- A parallel mediator model has two or more parallel mediators, each with an indirect pathway association.
- The 4 steps of Baron and Kenny's mediated regression are: Path A, B, C, C', and a*b significant.
Bootstrapping and Moderating Regression
- Bootstrapping is used to test the significance of the mediated pathway, using the 95% CI and sampling distribution.
- Moderating regression analysis: the influence of one IV on the DV changes based on the score on a second IV (moderator).
- The moderating regression equation is: y = b0 + b1X + b2M + b3(X*M).
ANOVA and ANCOVA
- Homogeneity of regression: the covariate must have the same effect at each level of the moderator variable, so it does not produce a conditional effect itself.
- The T-statistic tests whether two group means are significantly different.
- The F-statistic is the ratio of the model to its error, between groups divided by within groups.
- SS between is the variance explained by the model.
- SS within is the variance not explained by the model (error).
Designs in ANOVA
- Between groups: independent groups, with more error.
- Repeated measures: participants take part in all conditions, with less error.
- Mixed: a combination of repeated and independent measures.
Effects in ANOVA
- Main effect: the influence of the IV without regard to other IVs in the analysis.
- Interaction: the influence of one IV on the score of the DV, conditional on other IVs.
- Disordinal interaction: the effect of one IV, differing at the level of the second IV.
- Simple effects: a specific set of cell means at different levels of other IVs.
Standard Regression
- Predicts a dependent variable using two or more independent variables simultaneously.
- The best-fitting line shows the relationship between the dependent and independent variables.
- Error is the difference between the observed value and the true value (often unobserved).
Variance in Regression
- Unique variance is the variability in a dependent variable (DV) uniquely explained by specific independent variables (IVs) in multiple regression, distinct from Pearson's correlation where unique variance isn't assessed.
- Shared variance is the variability in a DV explained by multiple IVs simultaneously in both multiple regression and Pearson's correlation.
General Linear Model
- Data = Model + Error
Standardized Slope and Coefficients
- The standardized slope is the change in the DV for one unit change in the IV, holding other IVs constant, excluding shared variance.
- The unstandardized coefficient is the slope of the regression line, reflecting the change in the DV from one unit change in the IV, while holding all other variables constant.
- The standardized coefficient is the slope of the regression line in standard deviation units, making it comparable with other standardized coefficients.
Regression Analysis
- Semi-partial correlation (sr2) is the correlation between the predictor and outcome variable, with variance shared between other predictors controlled in the predictor variable only.
- Partial correlation is the correlation between a predictor variable and outcome variable, while removing the shared variance with other predictors.
- The regression coefficient (R2) represents the proportion of variance in the DV that is explained by the IV in the model.
Assumptions in Regression
- Linearity: The relationship between the IV and the mean of the DV is linear.
- Homoscedasticity: The variance of the residual is the same for any IV.
- Normality: For any fixed value of the IV, the DV is normally distributed.
Outliers and Influential Scores
- Studentized residual is an outlier score, unusual on the IV.
- Discrepancy score is the most unstable, unusual on both IV and DV.
- Influential score is unusual on the IV.
Multicollinearity
- Multicollinearity occurs when the associations between predictors are not independent.
- Tolerance and variance inflation factor (VIF) are used to measure multicollinearity.
Types of Regression
- Standard multiple regression: predicts a DV using two or more IVs, with equal importance to explanation.
- Hierarchical regression model: determines what happens based on theory, with variables entered based on theoretical importance or control.
- Statistical regression (stepwise): not based on theory, but on the size of the correlation.
- Mediated regression: uses an indirect effect, where the IV influences the DV by a pathway through a second IV (mediator).
Mediated Regression
- The order of a mediated regression is: IV precedes the mediator in time, and the mediator precedes the DV.
- A parallel mediator model has two or more parallel mediators, each with an indirect pathway association.
- The 4 steps of Baron and Kenny's mediated regression are: Path A, B, C, C', and a*b significant.
Bootstrapping and Moderating Regression
- Bootstrapping is used to test the significance of the mediated pathway, using the 95% CI and sampling distribution.
- Moderating regression analysis: the influence of one IV on the DV changes based on the score on a second IV (moderator).
- The moderating regression equation is: y = b0 + b1X + b2M + b3(X*M).
ANOVA and ANCOVA
- Homogeneity of regression: the covariate must have the same effect at each level of the moderator variable, so it does not produce a conditional effect itself.
- The T-statistic tests whether two group means are significantly different.
- The F-statistic is the ratio of the model to its error, between groups divided by within groups.
- SS between is the variance explained by the model.
- SS within is the variance not explained by the model (error).
Designs in ANOVA
- Between groups: independent groups, with more error.
- Repeated measures: participants take part in all conditions, with less error.
- Mixed: a combination of repeated and independent measures.
Effects in ANOVA
- Main effect: the influence of the IV without regard to other IVs in the analysis.
- Interaction: the influence of one IV on the score of the DV, conditional on other IVs.
- Disordinal interaction: the effect of one IV, differing at the level of the second IV.
- Simple effects: a specific set of cell means at different levels of other IVs.
Studying That Suits You
Use AI to generate personalized quizzes and flashcards to suit your learning preferences.
Description
Test your understanding of regression analysis, a statistical method that establishes relationships between variables. Learn about standard regression, best fitting lines, and more!