Classical Linear Regression Model Assumptions
60 Questions
16 Views

Choose a study mode

Play Quiz
Study Flashcards
Spaced Repetition
Chat to lesson

Podcast

Play an AI-generated podcast conversation about this lesson

Questions and Answers

What does the assumption E(ut) = 0 imply in a classical linear regression model?

  • The errors average out to zero (correct)
  • The errors have a non-zero mean
  • The errors are independent of the predictors
  • The errors are normally distributed
  • What is the potential consequence of violating the assumption var(ut) = σ² < ∞?

  • The model will definitely produce correct forecasts
  • The test statistics may not follow the expected distributions (correct)
  • The estimates of standard errors will be consistent
  • The model's coefficient estimates could become biased
  • Which of the following tests specifically addresses autocorrelation in regression residuals?

  • Jarque-Bera test
  • Breusch-Pagan test
  • Shapiro-Wilk test
  • Durbin-Watson test (correct)
  • What is one possible effect of ignoring a violation of the assumption cov(ut, xt) = 0?

    <p>Parameter estimates may be biased</p> Signup and view all the answers

    Which statement accurately defines the normality assumption in a regression model?

    <p>The residuals are normally distributed</p> Signup and view all the answers

    Which of the following is a step in testing for heteroscedasticity in regression residuals?

    <p>Plotting residuals against fitted values</p> Signup and view all the answers

    What might be an advantage of using a dynamic model in econometrics?

    <p>They account for time-dependent patterns in data</p> Signup and view all the answers

    What does the Breusch-Godfrey test specifically diagnose?

    <p>The presence of autocorrelation</p> Signup and view all the answers

    What conclusion can be drawn when both the F - and χ 2 tests indicate no evidence of heteroscedasticity?

    <p>The results are ambiguous regarding heteroscedasticity.</p> Signup and view all the answers

    Which regression option needs to be selected in EViews to obtain heteroscedasticity-robust standard errors?

    <p>Heteroskedasticity consistent coefficient variance.</p> Signup and view all the answers

    What effect do heteroskedasticity-consistent standard errors typically have on the parameter estimates?

    <p>They remain identical to those from ordinary standard errors.</p> Signup and view all the answers

    What does Assumption 3 of the CLRM state regarding the error terms?

    <p>The covariance between error terms is zero.</p> Signup and view all the answers

    What is the implication of positive autocorrelation in residuals?

    <p>Positive residuals tend to follow positive residuals.</p> Signup and view all the answers

    What does the Durbin-Watson (DW) test specifically test for?

    <p>Independence of error terms over time.</p> Signup and view all the answers

    In the context of autocorrelation, what does a plot showing no pattern in residuals indicate?

    <p>Absence of autocorrelation.</p> Signup and view all the answers

    Which of the following indicates evidence of negative autocorrelation?

    <p>Residuals alternate between positive and negative values.</p> Signup and view all the answers

    What happens to the p-values when comparing heteroscedasticity-robust standard errors to ordinary standard errors?

    <p>P-values become smaller.</p> Signup and view all the answers

    When testing for autocorrelation, what is plotted to assess the relationship between current and previous residuals?

    <p>Residual plot against its lagged values.</p> Signup and view all the answers

    What effect does a high p-value have on the evidence of heteroscedasticity?

    <p>Does not support the presence of heteroscedasticity.</p> Signup and view all the answers

    What does the test statistic formula for DW primarily assess?

    <p>Change in residuals over observations.</p> Signup and view all the answers

    What happens to OLS estimators in the presence of heteroscedasticity?

    <p>They remain unbiased but are no longer BLUE.</p> Signup and view all the answers

    When heteroscedasticity is ignored, what is most likely affected?

    <p>The standard errors of the coefficients.</p> Signup and view all the answers

    What does a significance test statistic of TR² = 28 indicate regarding the null hypothesis?

    <p>Reject the null hypothesis.</p> Signup and view all the answers

    Which method can be used to adjust for known heteroscedasticity in a regression model?

    <p>Generalised Least Squares (GLS)</p> Signup and view all the answers

    What effect does heteroscedasticity typically have on the slope standard errors when its variance is positively related to an explanatory variable?

    <p>They are too low.</p> Signup and view all the answers

    What does the use of heteroscedasticity-consistent standard error estimates do for hypothesis testing?

    <p>Makes testing more conservative.</p> Signup and view all the answers

    What is the consequence of using OLS under conditions of heteroscedasticity?

    <p>The standard errors may be misleading.</p> Signup and view all the answers

    What is one method suggested for transforming variables to deal with heteroscedasticity?

    <p>Taking logarithms of the variables.</p> Signup and view all the answers

    How does the variance of errors relate when applying GLS with the specific form var(ut) = σ²zt²?

    <p>It becomes homoscedastic.</p> Signup and view all the answers

    Which option best describes the relationship between heteroscedasticity and OLS standard errors for the intercept?

    <p>They are typically too high.</p> Signup and view all the answers

    How can the residuals help identify heteroscedasticity?

    <p>They should have systematically changing variability.</p> Signup and view all the answers

    What happens when a researcher applies OLS yet the errors are inversely related to an explanatory variable?

    <p>Slope standard errors will be too low.</p> Signup and view all the answers

    What is a common problem faced when trying to identify the exact cause of heteroscedasticity?

    <p>Researchers are typically unsure of the exact cause.</p> Signup and view all the answers

    What distribution does the LM test statistic follow in the context of regression diagnostic tests?

    <p>Chi-squared distribution</p> Signup and view all the answers

    What is one reason why R-squared values may be meaningless when the regression does not include a constant term?

    <p>The mean of the dependent variable will not equal the mean of the fitted values.</p> Signup and view all the answers

    Which test is a commonly used method for detecting heteroscedasticity in regression?

    <p>Goldfeld-Quandt test</p> Signup and view all the answers

    Under the null hypothesis of heteroscedasticity tests like Goldfeld-Quandt, what is assumed about the variances?

    <p>The variances of the disturbances are equal.</p> Signup and view all the answers

    What does the Wald test statistic follow in terms of distribution?

    <p>F-distribution</p> Signup and view all the answers

    In the Goldfeld-Quandt test, how are the two residual variances calculated?

    <p>By estimating the regression model on two sub-samples.</p> Signup and view all the answers

    What is a potential drawback of the Goldfeld-Quandt test?

    <p>It is contingent on the choice of where to split the sample.</p> Signup and view all the answers

    What phenomenon is observed when the variance of the errors changes over time?

    <p>ARCH</p> Signup and view all the answers

    What is the consequence of forcing a regression line through the origin by omitting the constant term?

    <p>It introduces bias in the slope coefficient estimate.</p> Signup and view all the answers

    Under the assumptions detailed for regression analysis, what is homoscedasticity?

    <p>The errors have constant variance.</p> Signup and view all the answers

    What happens to the equivalence of the LM and Wald tests as the sample size increases?

    <p>They become equivalent.</p> Signup and view all the answers

    Which of the following is NOT a reason for using diagnostic tests in regression models?

    <p>To solely predict future values.</p> Signup and view all the answers

    In the context of residual analysis for heteroscedasticity, what kind of plot is generally used?

    <p>Residuals plotted against one of the explanatory variables.</p> Signup and view all the answers

    Which of the following statements is true regarding the implications of heteroscedasticity in a regression model?

    <p>It violates the assumption of constant variance.</p> Signup and view all the answers

    What does a Durbin-Watson (DW) statistic value less than the lower critical value indicate?

    <p>There is positive autocorrelation</p> Signup and view all the answers

    Which of the following is NOT a condition for the Durbin-Watson test to be valid?

    <p>The regressors must be stochastic</p> Signup and view all the answers

    If the DW statistic value is equal to 4, what does that suggest about the residuals?

    <p>There is perfect negative autocorrelation</p> Signup and view all the answers

    What would be the implication if the DW statistic is found between the upper and lower critical values?

    <p>No significant autocorrelation is presumed</p> Signup and view all the answers

    What does the numerator of the DW test statistic help identify in regression errors?

    <p>The correlation between errors over time</p> Signup and view all the answers

    Which of these statistics follows an irregular distribution, making it difficult to classify autocorrelation?

    <p>Durbin-Watson statistic</p> Signup and view all the answers

    What is the acceptable value range for the DW statistic to conclude no autocorrelation exists?

    <p>Between 1.42 and 1.57</p> Signup and view all the answers

    What does the Breusch-Godfrey test assess in comparison to the Durbin-Watson test?

    <p>Autocorrelation of multiple lagged values</p> Signup and view all the answers

    In the example given, what conclusion can be drawn if the DW statistic value is 0?

    <p>Residuals are positively autocorrelated</p> Signup and view all the answers

    Which term is used to refer to the presence of errors in regression that are correlated across time periods?

    <p>Autocorrelation</p> Signup and view all the answers

    What does a positive autocorrelation in the errors indicate about the model's residuals?

    <p>Errors tend to follow a consistent pattern</p> Signup and view all the answers

    What is the general hypothesis test structure used in Breusch-Godfrey test for autocorrelation?

    <p>H0: ρ1 = 0 and ρ2 = 0, H1: At least one ρ ≠ 0</p> Signup and view all the answers

    Why must the conditions for using the DW test be strictly adhered to?

    <p>To avoid biases toward indicating no autocorrelation</p> Signup and view all the answers

    Study Notes

    Classical Linear Regression Model Assumptions and Diagnostic Tests

    • Five assumptions underpin the classical linear regression model (CLRM) to ensure ordinary least squares (OLS) estimation's desirable properties and validity of hypothesis tests. These include:

      • Expected value of the error term (ut) is zero (E(ut) = 0).
      • Variance of the error term is constant and finite (var(ut) = σ2 < ∞).
      • Covariance between any two error terms is zero (cov(ui, uj) = 0).
      • Covariance between the error term and explanatory variables is zero (cov(ut, xt) = 0).
      • Error term follows a normal distribution (ut ~ N(0, σ2)).
    • Violations of these assumptions can lead to several problems:

      • Incorrect coefficient estimates (β̂s).
      • Incorrect standard errors.
      • Invalid test statistic distributions.

    Diagnostic Tests

    • Diagnostic (misspecification) tests calculate a test statistic.
      • Common approaches include the Lagrange Multiplier (LM) test and Wald test, both asymptotically equivalent but with slightly different small-sample results.
        • LM test statistics follow a chi-squared distribution (χ2) with degrees of freedom (m) equal to the restrictions.
        • Wald test statistics follow an F-distribution with (m, T - k) degrees of freedom.

    Assumption 2: Constant Variance (Homoscedasticity)

    • Homoscedasticity assumes the error term's variance is constant.
    • Heteroscedasticity implies varying error variances—a common violation.
    • A graph of residuals against an explanatory variable can illustrate heteroscedasticity. Increasing variance with the variable in the plot clearly depicts heteroscedasticity.

    Detecting Heteroscedasticity

    • Visual inspection of residual plots can be unreliable.
    • Formal statistical tests like the Goldfeld-Quandt test are more robust.

    Goldfeld--Quandt Test

    • Divides the sample into subsamples (T1, T2).
    • Estimates the regression and calculates residual variances (s12, s22).
    • Assumes equal error variances (H0: σ12 = σ22) and tests for heteroscedasticity using the ratio (GQ) of the variances.
    • Large GQ values lead to heteroscedasticity rejection.

    Consequences of Ignoring Heteroscedasticity

    • OLS coefficient estimates remain unbiased and consistent but aren't the Best Linear Unbiased Estimators (BLUE).
    • OLS standard errors are incorrect, resulting in misleading inferences.
      • Intercept standard errors are typically underestimated.
      • Slope standard errors depend on the heteroscedasticity form.

    Dealing with Heteroscedasticity

    • GLS (Generalized Least Squares) or WLS (Weighted Least Squares) can address known heteroscedasticity patterns.
    • Data transformation (e.g., logs) may reduce the effect of heteroscedasticity.
    • Robust standard error estimates account for heteroscedasticity. A software packages adjustment of the std errors.

    Testing for Heteroscedasticity in EViews

    • Residual plots can indicate heteroscedasticity if variability changes systematically over time.

    Assumption 3: Zero Covariance (No Autocorrelation)

    • The covariance between error terms across observations (or over time) is zero in the classical linear model.
    • Autocorrelation (serial correlation) indicates correlated error terms.

    Detecting Autocorrelation

    • Visual inspection of plots (residuals against lagged residuals, or residuals over time).
    • Positive autocorrelation indicates a pattern of similar signs in successive errors.
    • Negative autocorrelation indicates alternating signs.
    • No pattern represents no autocorrealtion

    Durbin-Watson (DW) Test

    • Tests for first-order autocorrelation (correlation between consecutive errors).
    • DW statistic's value depends on the autocorrelation level (positive or negative), which can be inconclusive in some cases.
      • Critical values (dL, dU) help determine rejection or non-rejection regions.

    Breusch-Godfrey Test

    • A generalized test for autocorrelation up to a specified order (r).
    • Uses auxiliary regressions and calculated χ2 or F statistics to test for autocorrelation.
    • Assumes no relationship between the error term and previous values of errors (H0).

    Conditions for Valid DW Test

    • Constant term in the regression.
    • Non-stochastic regressors.
    • No lagged dependent variables in the regression.

    Other Key Considerations

    • White's method provides heteroscedasticity-consistent standard errors for OLS and helps with appropriate inference in case of heteroscedasticity during regression analysis.

    Studying That Suits You

    Use AI to generate personalized quizzes and flashcards to suit your learning preferences.

    Quiz Team

    Description

    This quiz covers the five key assumptions that underpin the classical linear regression model (CLRM), essential for the validity of ordinary least squares (OLS) estimation. Understand the implications of each assumption and the potential issues arising from their violations. Test your knowledge through diagnostic tests and mis-specification assessments.

    More Like This

    Use Quizgecko on...
    Browser
    Browser