Preview

The Simple Regression Model

Good Essays
Open Document
Open Document
984 Words
Grammar
Grammar
Plagiarism
Plagiarism
Writing
Writing
Score
Score
The Simple Regression Model
The simple regression model (SRM) is model for association in the population between an explanatory variable X and response Y. The SRM states that these averages align on a line with intercept β0 and slope β1: µy|x = E(Y|X = x) = β0 + β1x
Deviation from the Mean The deviation of observed responses around the conditional means µy|x are called errors (ε). The error’s equation: ε = y - µy|x
Errors can be positive or negative, depending on whether data lie above (positive) or below the conditional means (negative). Because the errors are not observed, the SRM makes three assumptions about them: * Independent. The error for one observation is independent of the error for any other observation. * Equal variance. All errors have the same variance, Var(ε) = σε2. * Normal. The errors are normally distributed.
If these assumptions hold, then the collection of all possible errors forms a normal population with mean 0 and variance σε2, abbreviated ε ̴̴ N (0, σε2). Simple Regression Model (SRM) observed values of the response Y are linearly related to values of the explanatory variable X by the equation: y = β0 + β1x + ε, ε ̴̴ N (0, σε2)
The observations: 1. are independent of one another, 2. have equal variance σε2 around the regression line, and 3. are normally distributed around the regression line.
21.2 Conditions for the SRM ( Simple Regression Model )
Instead of checking for random residual variation, we have three specific conditions. Checklist for the simple regression model * Is the association between y and x linear? * Have we ruled out obvious lurking variables? Errors appears to be a sample from a normal population. | * Are the errors evidently independent? * Are the variances of the residuals similar? * Are the residuals nearly normal?
21.3 INTERFERENCE IN REGRESSION
Confidence intervals and hypothesis tests work as in inferences for the mean of a population: * The 95% confidence

You May Also Find These Documents Helpful

  • Good Essays

    PreLab Questions

    • 481 Words
    • 2 Pages

    Ex. If three measurements are taken by Andrea (1.7 mL, 1.7 mL and 1.8 mL) we know that her spread in measured values will be small and, thus, the average measurement will be more precise than Andrew.…

    • 481 Words
    • 2 Pages
    Good Essays
  • Satisfactory Essays

    Week 3 Assignment 2

    • 718 Words
    • 3 Pages

    a. To start the regression model is posed a relationship concerning the dependent and independent variables. You input your data for the spreadsheet and in this paper we are using 30 market examples or observations.…

    • 718 Words
    • 3 Pages
    Satisfactory Essays
  • Good Essays

    The four assumptions of the simple linear regression model are (1) linearity – the mean of E(Y|X) is a straight line function of X; (2) constant variance – the standard deviation of Y|X is the same for all X; (3) normality – the distribution of Y|X is normal; (4) independence – the observations are all independent.…

    • 958 Words
    • 4 Pages
    Good Essays
  • Good Essays

    2 + 0.75(100) = 77. However, in any particular year when sales X = 100, the actual cost of goods sold can deviate randomly around 77. This deviation from the average is called the “disturbance” or the “error” and is represented by “e”.…

    • 983 Words
    • 4 Pages
    Good Essays
  • Better Essays

    Real Estate Data Set

    • 1091 Words
    • 5 Pages

    The graphic figures of stable variables are listed in the table. The team observes cost and dimension have larger scales, which leads us to believe the logarithm of two variables is weak. The team can detect weak linear association among some pairs. Though, this start examination is not adequate enough to sense the significance of descriptive variables to the house cost. When using OLS to estimate a linear regression model with all eight descriptive variables. Regression analysis is used for prediction purposes. A regression model is a statistical model that is used to predict the values of a dependent or…

    • 1091 Words
    • 5 Pages
    Better Essays
  • Powerful Essays

    Stat Ch14

    • 10344 Words
    • 42 Pages

    a. b. c. d. ANS: C 8. a. b. c. d. ANS: B 9. a. b. c. d. ANS: A 10. a. b. c. d. ANS: D 11. a. b. c. d. ANS: C 12. error term ε? a. b. c. d. ANS: A The standard error is the…

    • 10344 Words
    • 42 Pages
    Powerful Essays
  • Satisfactory Essays

    Case Exercise

    • 431 Words
    • 2 Pages

    The percentage of the variation in output that is “explained” by the regression equation is 94.8%.…

    • 431 Words
    • 2 Pages
    Satisfactory Essays
  • Satisfactory Essays

    Sas Lecture

    • 676 Words
    • 3 Pages

    Recall that, in order to make valid inferences using the linear regression estimates, we need the errors of the model (i.e. residuals) to satisfy the following key assumption:…

    • 676 Words
    • 3 Pages
    Satisfactory Essays
  • Good Essays

    The first step in evaluating a regression model is to determine whether the sign of the estimated slope term makes sense. The second step is to test whether or not the slope term is significantly different from zero. The appropriate statistical test to determine this is a t-test since the true regression error variance is generally unknown. The third check of regression is to evaluate what percent of the variation in the dependent variable is explained by variation in the independent variable. This is given by the R-squared (coefficient of determination) in regression output. Fourth, the regression model should be evaluated for serial correlation. The Durbin-Watson statistic is used in this regard. The problem of serial correlation is common to time-series data and leads to the problem of spurious regression, i.e., misleading regression statistics.…

    • 399 Words
    • 2 Pages
    Good Essays
  • Satisfactory Essays

    Run the regression Report your answer in the format of equation 5.8 (Chapter 5, p. 152) in the textbook including and the standard error of the regression (SER). Interpret the estimated slope parameter for LOT. In the interpretation, please note that PRICE is measured in thousands of dollars and LOT is measured in acres.…

    • 2927 Words
    • 12 Pages
    Satisfactory Essays
  • Better Essays

    Regression Analysis

    • 1285 Words
    • 6 Pages

    This presentation on Regression Analysis will relate to a simple regression model. Initially, the regression model and the regression equation will be explored. As well, there will be a brief look into estimated regression equation. This case study that will be used involves a large Chinese Food restaurant chain.…

    • 1285 Words
    • 6 Pages
    Better Essays
  • Good Essays

    The Standard deviation is a measure of the variation (or spread) of a data set. For a variable x, the standard deviation of all possible observations for the entire population is called the population standard deviation or standard deviation of the variable x. It is denoted σx or, when no confusion will arise, simply σ. Suppose that we want to obtain information about a population standard deviation. If the population is small, we can often determine σ exactly by first taking a census and then computing σ from the population data. However, if the population is large, which is usually the case, a census is generally not feasible, and we must use inferential methods to obtain the required information about σ.…

    • 466 Words
    • 2 Pages
    Good Essays
  • Powerful Essays

    • The sample correlation coefficient r is an estimate of ρ and is used to measure the strength of the linear relationship in the sample observations…

    • 3123 Words
    • 13 Pages
    Powerful Essays
  • Good Essays

    love

    • 7509 Words
    • 31 Pages

    Two broad kinds of error must be considered. The first affects the truth of the…

    • 7509 Words
    • 31 Pages
    Good Essays
  • Powerful Essays

    Regression

    • 2029 Words
    • 9 Pages

    This section works out an example that includes all the topics we have discussed so far in this chapter.…

    • 2029 Words
    • 9 Pages
    Powerful Essays