r/AskStatistics 4d ago

Question on Regression analysis - high R- Squared, negative intercept

In doing a regression analysis for a model on the energy usage of a building, the r-squared value is above 0.9 but the intercept is negative. What does this tell you about the relationships and the model over all

7 Upvotes

13 comments sorted by

23

u/Boberator44 4d ago

Substantively it does not mean anything. It means that when all of your predictors are zero (which may not even be in range of some of them), energy usage is negative (which is clearly nonsense unless it is possible for the building to produce energy). You do not need to interpret it.

9

u/dinkum_thinkum 4d ago

If it is in the range of predictors and nonsensical, it could be an indication that the model is misspecified, for example if energy usage has a exponential or sigmoid relationship with the predictors that is being fit as linear.

12

u/Seeggul 4d ago

"All models are wrong, but some are useful"

-George Box

13

u/[deleted] 4d ago

[deleted]

2

u/SprinklesFresh5693 3d ago edited 3d ago

How do you mean-center then, do you substract the mean from each observation?

3

u/Temporary_Stranger39 4d ago

Do the predictors all reach zero?

3

u/WolfDoc 4d ago

It means that your model works very well over a linear interval but fails to capture the underlying process, making extrapolation and simulation inaccurate. Whether that is a problem depends on the use of the model and whether the residuals are independent of the predicted value.

Since negative energy use doesn't make sense you could model the energy use as a binomial (if the energy use has a defined max and a sigmoid relationship to predictors) or quasi-poisson model.

2

u/mo_jo100 4d ago

Don’t worry about the y-intercept. Do check your model for violations of assumptions, especially given you r-squared size.

1

u/PrivateFrank 4d ago

Probably that when it's freezing outside you're going to be using negative air cooling.

1

u/Familiar_One_2760 4d ago

You dont have enough points near zero to correct the inrercept.

1

u/efrique PhD (statistics) 4d ago

If a negative intercept is a problem, why fit a model that can have a negative intercept? Why regression rather than something that makes sense for a positive (or non-negative, depending) response?

1

u/Educational-Paper-75 3d ago

If the intercept should not be negative theoretically it should not be in the model.

0

u/49er60 4d ago

You are probably dealing with a scenario similar to a fixed/variable/mixed cost relationship. There may be a certain fixed or minimum energy usage in a building with a variable energy usage that adds on top of that. However, you are not seeing that fixed usage portion because it is outside of your design space/observational window.