Are Internet reviews reliable?

Deciphering Online Ratings Through ‘Picky Eaters Make For Better Raters’
In an era where online ratings significantly influence consumer choices, especially in the hospitality industry, understanding the nuances behind these ratings becomes crucial. Sasha Stoikov, Director of Research at Cornell Financial Engineering, along with Dr. Stefano Borzillo and Steffen Raub, delve into this realm in their upcoming paper, “Picky Eaters Make For Better Raters,” set to appear in Cornell Hospitality Quarterly.

The research by Stoikov and colleagues explores the dynamics of online rating systems, with a specific focus on Yelp reviews for restaurants. The central thesis posits that not all raters are equal in their ability to predict restaurant quality. The study categorizes raters into “inflating raters,” who tend to give high ratings, and “deflating raters,” who are more stringent. This segmentation provides a fresh lens to view and understand online ratings.
Methodology and Data Analysis?
The paper uses a public dataset from Yelp, applying statistical techniques to differentiate between the two identified rater categories. The analysis seeks to correlate these ratings with the future success of restaurants, particularly in achieving top ratings. The approach is methodical and data-driven, offering empirical insights into the behavioral patterns of online raters.
Key Findings?
One of the significant findings is the predictive accuracy of “deflating raters” in identifying top-performing restaurants. These users, moreover, akin to Michelin critics in their discernment. Thus, provide a more reliable indicator of a restaurant’s future success and actual quality. This contrasts with the “inflating raters,” whose evaluations are less predictive of future top ratings.
Implications and Impact
- For Restaurant Owners: Understanding the nature of reviews and the profile of reviewers can be instrumental in managing online reputations and business strategies.
- For Consumers: The study encourages a more critical approach to interpreting online reviews, highlighting the importance of considering the rater’s profile and history.
Conclusions and Future Research “Picky Eaters Make For Better Raters” is a groundbreaking study that adds depth to our understanding of online consumer behavior and the reliability of online ratings. It challenges the perception of online ratings as uniformly reliable indicators of quality, suggesting a more nuanced interpretation.
Read the full paper: Picky Eaters Make For Better Raters by Sasha Stoikov, Stefano Borzillo, Steffen Raub :: SSRN



