While simple five-star systems are good enough at identifying and weeding out very low-quality products or suppliers, they do a poor job of separating good from great products or suppliers.

As currently implemented, five-star rating systems suffer from several shortcomings. Lacking incentives for providing truthful feedback, users who have extreme experiences (either very bad or very good) are much more likely to leave feedback than users who have average experiences, thus creating selection biases.