Preview

The Simple Regression Model

Good Essays
Open Document
Open Document
984 Words
Grammar
Grammar
Plagiarism
Plagiarism
Writing
Writing
Score
Score
The Simple Regression Model
The simple regression model (SRM) is model for association in the population between an explanatory variable X and response Y. The SRM states that these averages align on a line with intercept β0 and slope β1: µy|x = E(Y|X = x) = β0 + β1x
Deviation from the Mean The deviation of observed responses around the conditional means µy|x are called errors (ε). The error’s equation: ε = y - µy|x
Errors can be positive or negative, depending on whether data lie above (positive) or below the conditional means (negative). Because the errors are not observed, the SRM makes three assumptions about them: * Independent. The error for one observation is independent of the error for any other observation. * Equal variance. All errors have the same variance, Var(ε) = σε2. * Normal. The errors are normally distributed.
If these assumptions hold, then the collection of all possible errors forms a normal population with mean 0 and variance σε2, abbreviated ε ̴̴ N (0, σε2). Simple Regression Model (SRM) observed values of the response Y are linearly related to values of the explanatory variable X by the equation: y = β0 + β1x + ε, ε ̴̴ N (0, σε2)
The observations: 1. are independent of one another, 2. have equal variance σε2 around the regression line, and 3. are normally distributed around the regression line.
21.2 Conditions for the SRM ( Simple Regression Model )
Instead of checking for random residual variation, we have three specific conditions. Checklist for the simple regression model * Is the association between y and x linear? * Have we ruled out obvious lurking variables? Errors appears to be a sample from a normal population. | * Are the errors evidently independent? * Are the variances of the residuals similar? * Are the residuals nearly normal?
21.3 INTERFERENCE IN REGRESSION
Confidence intervals and hypothesis tests work as in inferences for the mean of a population: * The 95% confidence

You May Also Find These Documents Helpful

  • Good Essays

    PreLab Questions

    • 481 Words
    • 2 Pages

    Ex. If three measurements are taken by Andrea (1.7 mL, 1.7 mL and 1.8 mL) we know that her spread in measured values will be small and, thus, the average measurement will be more precise than Andrew.…

    • 481 Words
    • 2 Pages
    Good Essays
  • Good Essays

    Stat 250 Review

    • 1113 Words
    • 5 Pages

    what the standard deviation is – the average distance each data value is from the…

    • 1113 Words
    • 5 Pages
    Good Essays
  • Good Essays

    Assignment 4

    • 2820 Words
    • 14 Pages

    4. If the limits of the confidence interval of the difference between the means of two normally distributed populations were 0.5 and 2.5 at the 95% confidence level, then we can conclude that we are 95% certain that there is no significant difference between the two population means. false…

    • 2820 Words
    • 14 Pages
    Good Essays
  • Powerful Essays

    Standard deviation is a measure of the data spread and it is signified by the Greek letter sigma (σ). The standard deviation requires calculation of the average, compare each respondent’s value to the average, and square that difference (Burns & Bush, 2012, pg. 252). Therefore, the formula for standard deviation is the square root of the variance. The variance is the average of the squared differences of the mean. The standard deviation explains the density of data scattered around the mean. Curve distribution is a bell shaped curve when data is tightly bunched together. Highly arched bell shaped curves have a small standard deviation. Flat bell shaped curves have a large standard deviation.…

    • 1440 Words
    • 7 Pages
    Powerful Essays
  • Satisfactory Essays

    Week 3 Assignment 2

    • 718 Words
    • 3 Pages

    The regression analysis shows the results also of an Analysis of Variance (ANOOA) to calculate the significant F (2.9764E x 30 -7). The graph shows all measured data points, the line of best fit and the equation for the line and the R2 and P value.…

    • 718 Words
    • 3 Pages
    Satisfactory Essays
  • Good Essays

    In this equation, Y is the dependent variable, and X is the independent variable. α is the intercept of the regression line, and β is the slope of the regression line. e is the random disturbance term.…

    • 983 Words
    • 4 Pages
    Good Essays
  • Better Essays

    Real Estate Data Set

    • 1091 Words
    • 5 Pages

    The graphic figures of stable variables are listed in the table. The team observes cost and dimension have larger scales, which leads us to believe the logarithm of two variables is weak. The team can detect weak linear association among some pairs. Though, this start examination is not adequate enough to sense the significance of descriptive variables to the house cost. When using OLS to estimate a linear regression model with all eight descriptive variables. Regression analysis is used for prediction purposes. A regression model is a statistical model that is used to predict the values of a dependent or…

    • 1091 Words
    • 5 Pages
    Better Essays
  • Good Essays

    The four assumptions of the simple linear regression model are (1) linearity – the mean of E(Y|X) is a straight line function of X; (2) constant variance – the standard deviation of Y|X is the same for all X; (3) normality – the distribution of Y|X is normal; (4) independence – the observations are all independent.…

    • 958 Words
    • 4 Pages
    Good Essays
  • Satisfactory Essays

    Sas Lecture

    • 676 Words
    • 3 Pages

    In the previous two lectures, we learnt how to obtain the residuals of the estimation and to formally test for heteroscedasticity in the model. In this lecture, we will focus on testing the model errors for serial correlation.…

    • 676 Words
    • 3 Pages
    Satisfactory Essays
  • Satisfactory Essays

    Run the regression Report your answer in the format of equation 5.8 (Chapter 5, p. 152) in the textbook including and the standard error of the regression (SER). Interpret the estimated slope parameter for LOT. In the interpretation, please note that PRICE is measured in thousands of dollars and LOT is measured in acres.…

    • 2927 Words
    • 12 Pages
    Satisfactory Essays
  • Better Essays

    Regression Analysis

    • 1285 Words
    • 6 Pages

    This presentation on Regression Analysis will relate to a simple regression model. Initially, the regression model and the regression equation will be explored. As well, there will be a brief look into estimated regression equation. This case study that will be used involves a large Chinese Food restaurant chain.…

    • 1285 Words
    • 6 Pages
    Better Essays
  • Powerful Essays

    • The sample correlation coefficient r is an estimate of ρ and is used to measure the strength of the linear relationship in the sample observations…

    • 3123 Words
    • 13 Pages
    Powerful Essays
  • Good Essays

    The first step in evaluating a regression model is to determine whether the sign of the estimated slope term makes sense. The second step is to test whether or not the slope term is significantly different from zero. The appropriate statistical test to determine this is a t-test since the true regression error variance is generally unknown. The third check of regression is to evaluate what percent of the variation in the dependent variable is explained by variation in the independent variable. This is given by the R-squared (coefficient of determination) in regression output. Fourth, the regression model should be evaluated for serial correlation. The Durbin-Watson statistic is used in this regard. The problem of serial correlation is common to time-series data and leads to the problem of spurious regression, i.e., misleading regression statistics.…

    • 399 Words
    • 2 Pages
    Good Essays
  • Powerful Essays

    Regression

    • 2029 Words
    • 9 Pages

    This section works out an example that includes all the topics we have discussed so far in this chapter.…

    • 2029 Words
    • 9 Pages
    Powerful Essays
  • Good Essays

    love

    • 7509 Words
    • 31 Pages

    Two broad kinds of error must be considered. The first affects the truth of the…

    • 7509 Words
    • 31 Pages
    Good Essays