Wednesday, July 11, 2012

Mark Thoma reminds me of something Art Goldberger taught me: R-squared is over-rated

Mark posts a letter from Stephen Ziliak:

The chief finding of the Soyer-Hogarth experiment is that the expert econometricians themselves—our best number crunchers—make better predictions when only graphical information—such as a scatter plot and theoretical linear regression line—is provided to them. Give them t-statistics and fits of R-squared for the same data and regression model and their forecasting ability declines. Give them only t-statistics and fits of R-squared and predictions fall from bad to worse.
It’s a finding that hits you between the eyes, or should. R-squared, the primary indicator of model fit, and t-statistic, the primary indicator of coefficient fit, are in the leading journals of economics - such as the AER, QJE, JPE, and RES - evidently doing more harm than good.
This reminds me of Art Goldberger's teaching in Econ 612.  After I took that class, he turned his class notes into a book.  From page 177:

From our perspective, R2 has a very modest role in regression analysis, being a measure of the goodness of fit of a sample of LS (least squares) linear regression in a body of data.  Nothing in the CR (classical regression) model requires R2 to be high.  Hence a high R2 is not evidence in favor of the model, and a low R2 is not evidence against it...

...In fact, the most important thing about R2 is that is is not important in the CR model.  The CR model is concerend with parameters in a population, not with the goodness of fit within the sample. 

I also remember Gary Chamberlain was not crazy about t-statistics--he said he didn't want to see any "damn stars" in our papers.  We should care more about confidence intervals than hypothesis tests. 

4 comments:

Eigenscape said...

Confidence intervals and hypothesis tests are the same thing.

A 95% CI is the set of values for a parameter where the null is rejected at a 2.5% significance level.

Unknown said...

Nice informative post.it will be very interesting and informative post.
dave lindahl

Unknown said...

DAVE LINDAHL says that Real Estate Investment can be a great profitable market. Availability of good house for sale/rent or cash may not be a real problem. The actual problem is to find the right neighborhood for this business. If we find a correct neighborhood then buying and selling property is always an easy task.

turesta, said...

It can be described more roughly by the number of rooms. A studio apartment has a single bedroom with no living room (possibly a separate kitchen istanbul real estate).
A one-bedroom apartment has a living or dining room istanbul property separate from the bedroom. Two bedroom, three bedroom, and larger units are common.
(A bedroom is defined istanbul properties as a room with a closet for clothes storage.)


The size of an apartment or house can be istanbul property described in square feet or meters. In the United States, this istanbul real estate includes the area of "living space",
excluding the garage and other non-living spaces. The "square meters" figure of a house in Europe istanbul properties may report the total area of the walls enclosing the home,
thus including any attached garage and non-living spaces, which makes it important to inquire what kind of surface definition has been used.


In recent years, istanbul real estate many economists have recognized that the lack of
effective real estate laws can be a significant istanbul properties barrier to investment in
many developing countries. In most societies, rich and poor, a significant fraction of the total wealth is in the form of istanbul property land and buildings.

In most advanced economies, the main source of capital istanbul real estate used by
individuals and small companies to purchase and improve land and buildings is mortgage loans (or other instruments). These are loans for which the real property
itself constitutes collateral. Banks are willing to make such loans at favorable rates in large part because,
istanbul property if the borrower does not make payments, the lender can foreclose by
filing a court action which allows them to take back the property and sell it to get their money back. For investors, profitability can be enhanced by using an off
plan or pre-construction strategy to purchase at a lower price which is often the case in the pre-construction istanbul properties phase of development.