🎧 New: AI-Generated Podcasts Turn your study notes into engaging audio conversations. Learn more

Regression Analysis Quiz
140 Questions
7 Views

Regression Analysis Quiz

Created by
@ModernRomanesque

Podcast Beta

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What is standard regression?

Predicts a dependent variable using two or more independent variables simultaneously.

What is the best fitting line?

The most appropriate line showing the relationship between dependent and independent variables.

What is error ?

The difference between the observed value and the true value (often unobserved).

What is unique variance?

<p>Variability in a DV uniquely explained by specific IV(s) in multiple regression, distinct from Pearson's where unique variance isn't assessed. Similar that they both are between 0-1.</p> Signup and view all the answers

What is shared variance?

<p>Variability in a DV explained by multiple IV's simultaneously in both multiple regression and Pearson's correlation.</p> Signup and view all the answers

What is the general linear model in regression and ANOVA?

<p>data = model + error</p> Signup and view all the answers

What is the standardised slope

<p>Change in DV for one unit change in IV, holding other IV's constant - shared variance excluded.</p> Signup and view all the answers

What is total variance SS total?

<p>Difference between raw score and the mean score.</p> Signup and view all the answers

What is SS regression

<p>Difference of predicted score from the mean (want to increase this).</p> Signup and view all the answers

What is SS residual?

<p>The error - difference between raw score and predicted score. Want to reduce this.</p> Signup and view all the answers

What is the regression coefficient R2?

<p>Represents the proportion of variance in the DV that is explained by the IV in the model. Ranges from 0 (not explained) to 1 (explains all variability).</p> Signup and view all the answers

What is the unstandardised coefficient?

<p>The slope of the regression line reflecting the change in the DV from one unit change in the iV, whilst holding all other variables constant.</p> Signup and view all the answers

What is the standardised coefficient?

<p>The slopes of the regression line in standard deviation units (generally -1 to +1), making it comparable with other standardised coefficients. The change in SD units, for one SD change in IV, holding all other variables constant.</p> Signup and view all the answers

What is semi-partial correlation (sr2)?

<p>Correlation between the predictor and outcome variable with variance shared between other predictors controlled in the predictor variable only.</p> Signup and view all the answers

What is partial correlation?

<p>Correlation between a predictor variable and outcome variable while removing the shared variance with other predictors.</p> Signup and view all the answers

What is a studentised residual?

<p>It's an outlier score, that is unusual on the IV.</p> Signup and view all the answers

What is a discrepancy score?

<p>Most unstable. Unusual on IV and DV, use Cooks distance or gap measure to identify.</p> Signup and view all the answers

What is an influential score?

<p>Unusual on IV, can use Mahanobalis or Leverage to identify.</p> Signup and view all the answers

What is the assumption of linearity?

<p>The relation between IV and the mean of DV is linear.</p> Signup and view all the answers

What is the assumption of homoscedasticity?

<p>The variance of redial is the same of any of IV.</p> Signup and view all the answers

What is the assumption of normality?

<p>For any fixed value of IV, DV is normally distributed.</p> Signup and view all the answers

What is multicollinearity?

<p>That the association between predictors are independent.</p> Signup and view all the answers

What is tolerance and variance inflation factor (VIF)

<p>Both used to measure multicollinearity, tolerance is 0 (redundant) - 1 (independent). VIF is 10 redundant.</p> Signup and view all the answers

What is the standard multiple regression?

<p>To predict a DV using two ore more IV's. The IV's have equal importance to explanation.</p> Signup and view all the answers

What is hierarchical regression model?

<p>We determine what happens based on theory. Entered based on theoretical importance or control Eg. casual or exclusion. Change is obtained at each step.</p> Signup and view all the answers

What is statistical regression (stepwise).

<p>Not based on theory (not recommended), based on the size of the correlation. Largest correlation is entered first.</p> Signup and view all the answers

What is mediated regression?

<p>Mediated regression uses an indirect effect, where the IV influences the DV by a pathway through a second IV (mediator).</p> Signup and view all the answers

What is the order of a mediated regression?

<p>The IV should precede the mediator in time, and the mediator should preceded the DV.</p> Signup and view all the answers

What is a parallel mediator model?

<p>Two or more parallel mediator, that need each have an indirect pathway association.</p> Signup and view all the answers

What are the 4 steps of Baron and Kenny mediated regression

<p>Path A, B, C, C' and a*b significant. Path C no longer required to be significant.</p> Signup and view all the answers

How do you obtain the total effects of the ab pathway?

<p>a*b</p> Signup and view all the answers

What is bootstrapping used for?

<p>Test the significance of the mediated pathway, uses the 95% CI , sampling distribution. If contains 0 not statically significant.</p> Signup and view all the answers

What is the sobel test?

<p>No longer used for significant testing for a mediated regression. need a high number and too conservative.</p> Signup and view all the answers

What is moderating regression analysis?

<p>The influence of one IV on DV changes based on score on second IV (moderator). The moderator is conditional and influences the direction or strength.</p> Signup and view all the answers

What is unconditional?

<p>The predictors each add variance to the explanation of the DV, so each predictor is independent, so additive influence on the outcome.</p> Signup and view all the answers

What does the b3 coefficient reflect?

<p>The interaction between X*M.</p> Signup and view all the answers

What is the moderated regression equation?

<p>y=b0+b1X_b2M+b3(X*M)</p> Signup and view all the answers

What coefficient (standardised or unstandardised slope) do we use for moderated regression?

<p>We use the unstandardised slope coefficient.</p> Signup and view all the answers

What is an additive model?

<p>The influence of each predictor is independent to other predictors. Lines are parallel.</p> Signup and view all the answers

What is an interactive model?

<p>The effect of one predictor is dependent or conditional on the other predictor (slopes are different)</p> Signup and view all the answers

What is a pick a point technique in moderated regression?

<p>It is used to produce a figure to describe the association. Mean and +/- 1 SD, to create low, mod, high. Can also use variable centring, produces a mean of 0.</p> Signup and view all the answers

What is Johnson-Neyman Test?

<p>Old test, for describing the association, uses multiple levels of continuous moderator variables, more exact.</p> Signup and view all the answers

What is an issue in moderated regression?

<p>Power, minimum 150 participants</p> Signup and view all the answers

What is homogeneity of regression?

<p>The covariate must have the same effect at each level of moderator variable, so does not produce a conditional effect itself.</p> Signup and view all the answers

What is the T statistics?

<p>Tests whether two group means are significantly different.</p> Signup and view all the answers

What ist he F stastic?

<p>The ratio of the model to its error - between groups divided by within groups.</p> Signup and view all the answers

What is SS between?

<p>The variance explained by our model?</p> Signup and view all the answers

What is SS within?

<p>The variance not explained by our model (error).</p> Signup and view all the answers

What is an omnibus test?

<p>Test for an overall experimental effect, the difference lies somewhere.</p> Signup and view all the answers

What are the three ANOVA designs

<p>Between groups - independent groups (more error) Repeated measures (participants take part in all conditions) can control for error. Mixed: combination of repeated and independent.</p> Signup and view all the answers

What is the main effect?

<p>The influence of IV without regard for other IV's in the analysis.</p> Signup and view all the answers

What is the interaction?

<p>The influence of one IV on score of DV conditional on other IVs.</p> Signup and view all the answers

What is disordinal interaction?

<p>The effect of one IV, differing at level of second IV.</p> Signup and view all the answers

What is the main effect in ANOVA?

<p>Overall effect of each IV of interest ignoring the other IV's.</p> Signup and view all the answers

What is the simple effects in ANOVA?

<p>Specific set of cell means at different level of other IV's: eg. drugs: male/female (in univariate table)</p> Signup and view all the answers

What are the similarities of bivariate correlation and semi partial correlation

<p>Both describe linear relationships between two variables, with range of 0 to 1. Bivariate is based on all variance in IV and DV. Semi-partial correlation shows how much unique variance is added to explanation when other IVs are controlled.</p> Signup and view all the answers

What is studenised residual?

<p>How different the actual score is from the predicted score within the regression model. Whether there is an unusual score on the DV. More likely to be unusually high or low on DV. Between +/- 3 no problem - look at plots</p> Signup and view all the answers

What is Cook's Distance

<p>Measure of discrepancy, unusual score on IV and DV, occur at top or bottom of distribution only. Uses studenised residual and measure of leverage to give global measure of influence. Can use the gap method of cooks distance, to identify larger distances.</p> Signup and view all the answers

Why should you use bootstrapping for mediated regression.

<p>It's a non-parametric sampling technique, generating multiple samples to generate a 95% CI for mediated effect. If contain 0, effect of mediated pathway is statistically significant.</p> Signup and view all the answers

Why are eigenvalues different from the unrotated and rotated factor matrices?

<p>Size of factor loadings for individual items change with rotation. Groups with related items move closer to principal axis, increasing loading on one factor and reducing loadings on other factor/s. Rotated factors attempt to maximise the difference between factors.</p> Signup and view all the answers

Explain differences between an unrotated factor matrix, varimax & oblique rotations of obtained factors. When would you use each?

<p>Rotations used to produce more coherent factors which have different items loading on different factors. Orthogonal used when factors independent, oblique solution used when factors not independent. Factor matrix used when single factor solution expected.</p> Signup and view all the answers

Why is it important to assess the reliability of each of the factors produced in a principal components or factor analysis?

<p>Cronbach alpha assesses internal consistency of items on each factor, so will determine if factor is internally reliable. Need to have coefficient of .70 or better to use as a scale measure of a specific factor in research.</p> Signup and view all the answers

When should a covariate be used in an analysis? Give an example.

<p>When covariate is associated with DV &amp; not IV. – Used to reduce error. – Effects of IQ removed from problem solving, when effects of different amounts of alcohol intake on problem solving are to be evaluated</p> Signup and view all the answers

Describe homogeneity of regression used in ANCOVA.

<p>Assumption of ANCOVA. Association between covariate &amp; DV is same for each group, i.e., slopes are same.</p> Signup and view all the answers

What is difference between conditional and unconditional effects in ANOVA or regression?

<p>Unconditional effects – Influence of each IV independent of one another, so additive – E.g., standard regression analysis; main effects only significant in ANOVA • Conditional effects: – Influence of one IV on DV influenced by score on additional IV, so influence of IVs not independent of one another – e.g., Significant moderator term in regression – e.g., Significant interaction in ANOVA/ANCOVA</p> Signup and view all the answers

What is difference between a balanced and unbalanced design in ANOVA? What sorts of difficulties can an unbalanced design cause?

<p>Balanced design: Equal number of participants in each group Unbalanced: when there are different numbers in each group. Effects can be correlated (hard isolate independent effects).</p> Signup and view all the answers

Please explain Mauchly’s test, and when is it not conducted in a study?

<p>Test determines whether variances &amp; covariance matrices across groups on repeated measures are same. Compares differences between group 1 &amp; 2 with differences between groups 1 &amp; 3 and 2 &amp; 3 across these measures. If same test is non-significant, sphericity is assumed.</p> <p>Not conducted if study has only two levels of repeated factor. Nothing to compare as only two groups.</p> Signup and view all the answers

What is KMO sampling technique in FA/PCA?

<p>Tells us about adequacy of overall items in solution. Measures scores range from 0 to 1. Closer to one better the solution. Want to be &gt; .70</p> Signup and view all the answers

What is Bartlett's test of sphericity in FA /PCA

<p>Is a factor/PCA solution viable. If significant shows there are groups of independent or semi-independent items, so FA can be conducted. If not significant, identity matrix, so all items assessing same thing. PCA/FA should not be conducted.</p> Signup and view all the answers

What is the primary difference between unconditional and conditional effects in ANOVA or regression?

<p>Unconditional effects consider the influence of each IV independent of the others, while conditional effects consider the influence of one IV influenced by another IV.</p> Signup and view all the answers

What is the primary advantage of a balanced design in ANOVA?

<p>It provides more accurate estimates of the population means.</p> Signup and view all the answers

What is the purpose of Mauchly's test in ANOVA?

<p>To determine if the covariance matrices across groups are equal.</p> Signup and view all the answers

What is the primary function of the KMO sampling technique in FA/PCA?

<p>To measure the adequacy of the overall items in the solution.</p> Signup and view all the answers

What is the purpose of Bartlett's test of sphericity in FA/PCA?

<p>To test for the viability of a factor/PCA solution.</p> Signup and view all the answers

What is the consequence of an unbalanced design in ANOVA?

<p>The estimates of the population means are less accurate.</p> Signup and view all the answers

What is a characteristic of conditional effects in ANOVA or regression?

<p>The influence of one IV is influenced by another IV.</p> Signup and view all the answers

What is the primary purpose of standard regression?

<p>To predict a dependent variable using multiple independent variables</p> Signup and view all the answers

When is Mauchly's test not conducted in a study?

<p>When there are only two levels of the repeated factor.</p> Signup and view all the answers

Which of the following is a characteristic of unique variance?

<p>It is a unique aspect of multiple regression</p> Signup and view all the answers

What is the relationship between the standardized slope and the unstandardized coefficient?

<p>The standardized slope is the unstandardized coefficient divided by the standard deviation of the independent variable</p> Signup and view all the answers

What is the purpose of the general linear model in regression and ANOVA?

<p>To partition the total variance into explainable and unexplainable components</p> Signup and view all the answers

What is the difference between SS total and SS regression?

<p>SS total is the sum of SS regression and SS residual</p> Signup and view all the answers

What is the range of the regression coefficient R2?

<p>0 to 1</p> Signup and view all the answers

What is the purpose of the standardized coefficient?

<p>To make the regression coefficient comparable across different variables</p> Signup and view all the answers

What is the semi-partial correlation (sr2) used for?

<p>To measure the proportion of variance explained by each independent variable</p> Signup and view all the answers

Which of the following assumptions is NOT related to the distribution of the dependent variable?

<p>Multicollinearity</p> Signup and view all the answers

What is the primary difference between hierarchical and stepwise regression?

<p>The order of variable entry</p> Signup and view all the answers

Which of the following is a measure of the indirect effect in mediated regression?

<p>a*b</p> Signup and view all the answers

What is the purpose of bootstrapping in mediated regression?

<p>To test the significance of the mediated pathway</p> Signup and view all the answers

Which of the following is a characteristic of an interactive model?

<p>The slopes are different</p> Signup and view all the answers

What is the purpose of the Johnson-Neyman test?

<p>To describe the association between the predictor and outcome variable</p> Signup and view all the answers

Which of the following is a limitation of moderated regression?

<p>Power</p> Signup and view all the answers

What is the difference between a discrepancy score and an influential score?

<p>A discrepancy score is unusual on the IV and DV, while an influential score is unusual on the IV</p> Signup and view all the answers

Which of the following is a characteristic of a parallel mediator model?

<p>Two or more mediators with indirect pathways</p> Signup and view all the answers

What is the coefficient that reflects the interaction between the predictor and moderator variables?

<p>b3</p> Signup and view all the answers

What is a key assumption for using a covariate in an analysis?

<p>The covariate is associated with the dependent variable and not the independent variable</p> Signup and view all the answers

What is the main effect in ANOVA?

<p>The overall effect of each independent variable of interest ignoring the other independent variables</p> Signup and view all the answers

What is the purpose of bootstrapping in mediated regression?

<p>To generate a 95% confidence interval for the mediated effect</p> Signup and view all the answers

What is the difference between an unrotated factor matrix and varimax rotation?

<p>Varimax rotation attempts to maximise the difference between factors, whereas unrotated factor matrix does not</p> Signup and view all the answers

What is the purpose of assessing the reliability of each factor produced in a principal components or factor analysis?

<p>To determine the internal consistency of the items on each factor</p> Signup and view all the answers

What is the definition of disordinal interaction?

<p>The effect of one independent variable differs at different levels of the second independent variable</p> Signup and view all the answers

What is the purpose of Cook's Distance?

<p>To determine the influence of an individual data point on the regression model</p> Signup and view all the answers

What is the difference between bivariate correlation and semi-partial correlation?

<p>Bivariate correlation shows the shared variance, whereas semi-partial correlation shows the unique variance added to the explanation</p> Signup and view all the answers

What is the purpose of an omnibus test?

<p>To test the overall effect of the independent variables</p> Signup and view all the answers

What is the definition of homogeneity of regression in ANCOVA?

<p>The assumption that the covariate has the same effect at each level of the moderator variable</p> Signup and view all the answers

What is the primary purpose of standard regression?

<p>To predict a dependent variable using multiple independent variables</p> Signup and view all the answers

What is the main difference between unique variance and shared variance?

<p>Unique variance is the variability explained by a single independent variable, while shared variance is the variability explained by multiple independent variables</p> Signup and view all the answers

What is the purpose of the general linear model in regression and ANOVA?

<p>To decompose the total variance into components</p> Signup and view all the answers

What does the standardised slope represent in standard regression?

<p>The change in the dependent variable for one standard deviation change in the independent variable, holding other variables constant</p> Signup and view all the answers

What is the purpose of the regression coefficient R2?

<p>To represent the proportion of variance in the dependent variable explained by the independent variables</p> Signup and view all the answers

What is the main difference between the unstandardised coefficient and the standardised coefficient?

<p>The unstandardised coefficient is the slope of the regression line in original units, while the standardised coefficient is the slope of the regression line in standard deviation units</p> Signup and view all the answers

What does the semi-partial correlation (sr2) represent?

<p>The proportion of variance in the dependent variable explained by a specific independent variable</p> Signup and view all the answers

What is the condition for using a covariate in an analysis?

<p>When the covariate is associated with the DV and not the IV</p> Signup and view all the answers

What is the main effect in ANOVA?

<p>The overall effect of each IV of interest ignoring the other IVs</p> Signup and view all the answers

What is disordinal interaction?

<p>The effect of one IV differing at the level of the second IV</p> Signup and view all the answers

What is Cook's Distance?

<p>A measure of discrepancy, unusual score on IV and DV</p> Signup and view all the answers

What is the purpose of bootstrapping in mediated regression?

<p>To generate multiple samples to generate a 95% CI for mediated effect</p> Signup and view all the answers

What is the difference between an unrotated factor matrix and varimax & oblique rotations?

<p>The size of factor loadings for individual items change with rotation</p> Signup and view all the answers

Why is it important to assess the reliability of each of the factors produced in a principal components or factor analysis?

<p>To determine if the factor is internally reliable</p> Signup and view all the answers

What is homogeneity of regression assumption in ANCOVA?

<p>The assumption that the covariate has the same effect at each level of moderator variable</p> Signup and view all the answers

What is the purpose of using ANOVA?

<p>To test for an overall experimental effect</p> Signup and view all the answers

What is the difference between bivariate correlation and semi-partial correlation?

<p>Bivariate correlation describes linear relationships between two variables, while semi-partial correlation shows how much unique variance is added to explanation when other IVs are controlled</p> Signup and view all the answers

Which type of regression analysis involves an indirect effect, where the independent variable influences the dependent variable through a second independent variable?

<p>Mediated regression</p> Signup and view all the answers

What is the purpose of the Baron and Kenny mediated regression steps?

<p>To test the significance of the mediated pathway</p> Signup and view all the answers

What is the name of the technique used to produce a figure to describe the association in moderated regression?

<p>Pick a point technique</p> Signup and view all the answers

What is the assumption that the variance of the residual is the same for any value of the independent variable?

<p>Assumption of homoscedasticity</p> Signup and view all the answers

What is the term for the correlation between a predictor variable and the outcome variable while removing the shared variance with other predictors?

<p>Partial correlation</p> Signup and view all the answers

What is the name of the test that is no longer used for significant testing for a mediated regression?

<p>Sobel test</p> Signup and view all the answers

What is the term for the influence of one independent variable on the dependent variable changing based on the score on a second independent variable?

<p>Moderation</p> Signup and view all the answers

What is the coefficient that reflects the interaction between the independent variable and the moderator variable?

<p>b3</p> Signup and view all the answers

What is the minimum recommended sample size for moderated regression analysis?

<p>150</p> Signup and view all the answers

What is the type of regression analysis where the effect of one predictor is dependent or conditional on the other predictor?

<p>Interactive model</p> Signup and view all the answers

What is the primary difference between unconditional and conditional effects in ANOVA or regression?

<p>Unconditional effects consider the influence of one independent variable on the dependent variable, while conditional effects consider the influence of multiple independent variables.</p> Signup and view all the answers

What is the primary issue with unbalanced designs in ANOVA?

<p>The effects of the independent variables are correlated, making it difficult to isolate independent effects.</p> Signup and view all the answers

What is the purpose of Mauchly's test in ANOVA?

<p>To determine if the variances and covariance matrices are equal across groups.</p> Signup and view all the answers

What does the Kaiser-Meyer-Olkin (KMO) sampling technique measure in factor analysis?

<p>The adequacy of the overall items in the solution.</p> Signup and view all the answers

What is the purpose of Bartlett's test of sphericity in factor analysis?

<p>To determine if the solution is viable.</p> Signup and view all the answers

What is the primary difference between balanced and unbalanced designs in ANOVA?

<p>The number of participants in each group.</p> Signup and view all the answers

What is the result of a non-significant Mauchly's test?

<p>Sphericity is assumed.</p> Signup and view all the answers

When is Mauchly's test not conducted in a study?

<p>When there are only two levels of the repeated factor.</p> Signup and view all the answers

Study Notes

Regression Analysis

  • Standard Regression: A statistical method used to establish a relationship between a dependent variable and one or more independent variables.
  • Best Fitting Line: A line that minimizes the sum of the squared errors between the observed and predicted values.
  • Error: The difference between the observed and predicted values.
  • Unique Variance: The variance in the dependent variable that is explained by a single independent variable.
  • Shared Variance: The variance in the dependent variable that is explained by multiple independent variables.

General Linear Model

  • General Linear Model in Regression and ANOVA: A statistical model that describes the relationship between a dependent variable and one or more independent variables.
  • Standardized Slope: A measure of the strength of the relationship between the dependent variable and an independent variable, expressed in standard deviation units.

Variance Components

  • Total Variance (SS Total): The total amount of variance in the dependent variable.
  • SS Regression: The amount of variance in the dependent variable explained by the independent variables.
  • SS Residual: The amount of variance in the dependent variable not explained by the independent variables.
  • Regression Coefficient (R2): A measure of the proportion of variance in the dependent variable explained by the independent variables.

Coefficients

  • Unstandardized Coefficient: A measure of the change in the dependent variable for a one-unit change in the independent variable.
  • Standardized Coefficient: A measure of the change in the dependent variable for a one-standard-deviation change in the independent variable.
  • Semi-Partial Correlation (sr2): A measure of the unique variance in the dependent variable explained by an independent variable.
  • Partial Correlation: A measure of the linear relationship between two variables while controlling for the effects of other variables.

Residuals

  • Studentized Residual: A measure of the difference between the observed and predicted values, expressed in standard deviation units.
  • Discrepancy Score: A measure of the difference between the observed and predicted values.
  • Influential Score: A measure of the influence of a data point on the regression analysis.

Assumptions

  • Assumption of Linearity: The assumption that the relationship between the dependent variable and independent variables is linear.
  • Assumption of Homoscedasticity: The assumption that the variance of the residuals is constant across all levels of the independent variables.
  • Assumption of Normality: The assumption that the residuals are normally distributed.
  • Multicollinearity: The problem of high correlation between independent variables.

Regression Models

  • Standard Multiple Regression: A regression model that includes multiple independent variables to predict the dependent variable.
  • Hierarchical Regression Model: A regression model that includes independent variables in a specific order to predict the dependent variable.
  • Statistical Regression (Stepwise): A regression model that selects the most important independent variables to predict the dependent variable.
  • Mediated Regression: A regression model that examines the indirect effect of an independent variable on the dependent variable through a mediator variable.
  • Order of a Mediated Regression: The order in which the independent variable, mediator variable, and dependent variable are related.
  • Parallel Mediator Model: A mediated regression model in which the independent variable affects the dependent variable through multiple mediator variables.
  • 4 Steps of Baron and Kenny Mediated Regression: A mediated regression model that involves four steps to test the indirect effect of an independent variable on the dependent variable.

Moderated Regression

  • Moderated Regression Analysis: A regression model that examines the interaction between an independent variable and a moderator variable to predict the dependent variable.
  • Unconditional: A term used to describe the main effect of an independent variable on the dependent variable.
  • B3 Coefficient: The coefficient that reflects the interaction between the independent variable and moderator variable.
  • Moderated Regression Equation: An equation that includes the interaction term between the independent variable and moderator variable.
  • Standardized or Unstandardized Slope: The coefficient used to interpret the interaction between the independent variable and moderator variable.
  • Additive Model: A model that assumes the effect of the independent variable on the dependent variable is the same across all levels of the moderator variable.
  • Interactive Model: A model that assumes the effect of the independent variable on the dependent variable changes across different levels of the moderator variable.
  • Pick-a-Point Technique: A method used to interpret the interaction between the independent variable and moderator variable.
  • Johnson-Neyman Test: A test used to determine the regions of significance for the interaction between the independent variable and moderator variable.

ANOVA

  • T-Statistics: A test statistic used to compare the means of two groups.
  • F-Statistic: A test statistic used to compare the means of multiple groups.
  • SS Between: The sum of squared differences between the group means and the grand mean.
  • SS Within: The sum of squared differences within each group.
  • Omnibus Test: A test used to determine whether the means of multiple groups are different.
  • Three ANOVA Designs: One-way ANOVA, two-way ANOVA, and factorial ANOVA.
  • Main Effect: The effect of an independent variable on the dependent variable.
  • Interaction: The effect of the interaction between two or more independent variables on the dependent variable.
  • Disordinal Interaction: An interaction in which the effect of an independent variable on the dependent variable changes direction across different levels of another independent variable.

Standard Regression

  • Predicts a dependent variable using two or more independent variables simultaneously.
  • The best-fitting line shows the relationship between the dependent and independent variables.
  • Error is the difference between the observed value and the true value (often unobserved).

Variance in Regression

  • Unique variance is the variability in a dependent variable (DV) uniquely explained by specific independent variables (IVs) in multiple regression, distinct from Pearson's correlation where unique variance isn't assessed.
  • Shared variance is the variability in a DV explained by multiple IVs simultaneously in both multiple regression and Pearson's correlation.

General Linear Model

  • Data = Model + Error

Standardized Slope and Coefficients

  • The standardized slope is the change in the DV for one unit change in the IV, holding other IVs constant, excluding shared variance.
  • The unstandardized coefficient is the slope of the regression line, reflecting the change in the DV from one unit change in the IV, while holding all other variables constant.
  • The standardized coefficient is the slope of the regression line in standard deviation units, making it comparable with other standardized coefficients.

Regression Analysis

  • Semi-partial correlation (sr2) is the correlation between the predictor and outcome variable, with variance shared between other predictors controlled in the predictor variable only.
  • Partial correlation is the correlation between a predictor variable and outcome variable, while removing the shared variance with other predictors.
  • The regression coefficient (R2) represents the proportion of variance in the DV that is explained by the IV in the model.

Assumptions in Regression

  • Linearity: The relationship between the IV and the mean of the DV is linear.
  • Homoscedasticity: The variance of the residual is the same for any IV.
  • Normality: For any fixed value of the IV, the DV is normally distributed.

Outliers and Influential Scores

  • Studentized residual is an outlier score, unusual on the IV.
  • Discrepancy score is the most unstable, unusual on both IV and DV.
  • Influential score is unusual on the IV.

Multicollinearity

  • Multicollinearity occurs when the associations between predictors are not independent.
  • Tolerance and variance inflation factor (VIF) are used to measure multicollinearity.

Types of Regression

  • Standard multiple regression: predicts a DV using two or more IVs, with equal importance to explanation.
  • Hierarchical regression model: determines what happens based on theory, with variables entered based on theoretical importance or control.
  • Statistical regression (stepwise): not based on theory, but on the size of the correlation.
  • Mediated regression: uses an indirect effect, where the IV influences the DV by a pathway through a second IV (mediator).

Mediated Regression

  • The order of a mediated regression is: IV precedes the mediator in time, and the mediator precedes the DV.
  • A parallel mediator model has two or more parallel mediators, each with an indirect pathway association.
  • The 4 steps of Baron and Kenny's mediated regression are: Path A, B, C, C', and a*b significant.

Bootstrapping and Moderating Regression

  • Bootstrapping is used to test the significance of the mediated pathway, using the 95% CI and sampling distribution.
  • Moderating regression analysis: the influence of one IV on the DV changes based on the score on a second IV (moderator).
  • The moderating regression equation is: y = b0 + b1X + b2M + b3(X*M).

ANOVA and ANCOVA

  • Homogeneity of regression: the covariate must have the same effect at each level of the moderator variable, so it does not produce a conditional effect itself.
  • The T-statistic tests whether two group means are significantly different.
  • The F-statistic is the ratio of the model to its error, between groups divided by within groups.
  • SS between is the variance explained by the model.
  • SS within is the variance not explained by the model (error).

Designs in ANOVA

  • Between groups: independent groups, with more error.
  • Repeated measures: participants take part in all conditions, with less error.
  • Mixed: a combination of repeated and independent measures.

Effects in ANOVA

  • Main effect: the influence of the IV without regard to other IVs in the analysis.
  • Interaction: the influence of one IV on the score of the DV, conditional on other IVs.
  • Disordinal interaction: the effect of one IV, differing at the level of the second IV.
  • Simple effects: a specific set of cell means at different levels of other IVs.

Standard Regression

  • Predicts a dependent variable using two or more independent variables simultaneously.
  • The best-fitting line shows the relationship between the dependent and independent variables.
  • Error is the difference between the observed value and the true value (often unobserved).

Variance in Regression

  • Unique variance is the variability in a dependent variable (DV) uniquely explained by specific independent variables (IVs) in multiple regression, distinct from Pearson's correlation where unique variance isn't assessed.
  • Shared variance is the variability in a DV explained by multiple IVs simultaneously in both multiple regression and Pearson's correlation.

General Linear Model

  • Data = Model + Error

Standardized Slope and Coefficients

  • The standardized slope is the change in the DV for one unit change in the IV, holding other IVs constant, excluding shared variance.
  • The unstandardized coefficient is the slope of the regression line, reflecting the change in the DV from one unit change in the IV, while holding all other variables constant.
  • The standardized coefficient is the slope of the regression line in standard deviation units, making it comparable with other standardized coefficients.

Regression Analysis

  • Semi-partial correlation (sr2) is the correlation between the predictor and outcome variable, with variance shared between other predictors controlled in the predictor variable only.
  • Partial correlation is the correlation between a predictor variable and outcome variable, while removing the shared variance with other predictors.
  • The regression coefficient (R2) represents the proportion of variance in the DV that is explained by the IV in the model.

Assumptions in Regression

  • Linearity: The relationship between the IV and the mean of the DV is linear.
  • Homoscedasticity: The variance of the residual is the same for any IV.
  • Normality: For any fixed value of the IV, the DV is normally distributed.

Outliers and Influential Scores

  • Studentized residual is an outlier score, unusual on the IV.
  • Discrepancy score is the most unstable, unusual on both IV and DV.
  • Influential score is unusual on the IV.

Multicollinearity

  • Multicollinearity occurs when the associations between predictors are not independent.
  • Tolerance and variance inflation factor (VIF) are used to measure multicollinearity.

Types of Regression

  • Standard multiple regression: predicts a DV using two or more IVs, with equal importance to explanation.
  • Hierarchical regression model: determines what happens based on theory, with variables entered based on theoretical importance or control.
  • Statistical regression (stepwise): not based on theory, but on the size of the correlation.
  • Mediated regression: uses an indirect effect, where the IV influences the DV by a pathway through a second IV (mediator).

Mediated Regression

  • The order of a mediated regression is: IV precedes the mediator in time, and the mediator precedes the DV.
  • A parallel mediator model has two or more parallel mediators, each with an indirect pathway association.
  • The 4 steps of Baron and Kenny's mediated regression are: Path A, B, C, C', and a*b significant.

Bootstrapping and Moderating Regression

  • Bootstrapping is used to test the significance of the mediated pathway, using the 95% CI and sampling distribution.
  • Moderating regression analysis: the influence of one IV on the DV changes based on the score on a second IV (moderator).
  • The moderating regression equation is: y = b0 + b1X + b2M + b3(X*M).

ANOVA and ANCOVA

  • Homogeneity of regression: the covariate must have the same effect at each level of the moderator variable, so it does not produce a conditional effect itself.
  • The T-statistic tests whether two group means are significantly different.
  • The F-statistic is the ratio of the model to its error, between groups divided by within groups.
  • SS between is the variance explained by the model.
  • SS within is the variance not explained by the model (error).

Designs in ANOVA

  • Between groups: independent groups, with more error.
  • Repeated measures: participants take part in all conditions, with less error.
  • Mixed: a combination of repeated and independent measures.

Effects in ANOVA

  • Main effect: the influence of the IV without regard to other IVs in the analysis.
  • Interaction: the influence of one IV on the score of the DV, conditional on other IVs.
  • Disordinal interaction: the effect of one IV, differing at the level of the second IV.
  • Simple effects: a specific set of cell means at different levels of other IVs.

Studying That Suits You

Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

Quiz Team

Description

Test your understanding of regression analysis, a statistical method that establishes relationships between variables. Learn about standard regression, best fitting lines, and more!

More Quizzes Like This

Statistics: Regression Analysis
10 questions
Regression Analysis
8 questions

Regression Analysis

LikedClearQuartz avatar
LikedClearQuartz
Use Quizgecko on...
Browser
Browser