Methodology
How we test and score
Our scores answer one question: should you buy this, and for what? Here is exactly how we evaluate products, how our ratings work, and why commissions can never move a score.
Our rating philosophy
- We rate for your decision, not the manufacturer’s spec sheet.
- Transparency beats authority. We show the criteria, the weights, and the reasoning so you can disagree with our weighting and still use our data.
- No perfect products, no zero products. We explain trade-offs rather than manufacture separation.
- Ratings are editorial, never commercial. Commission rates, brand relationships, and traffic potential have zero input into a score — enforced in our data model, not just our policy.
The weighted scoring system
Each category defines its own criteria and weights, chosen to reflect what actually matters for that product class. Every criterion is scored 0–10; the overall is a weighted sum normalized to a single 0–100 score that every review, guide, and comparison reuses. Weights are public and versioned — if we change them, we note it and re-derive affected scores.
Example weighting (espresso machines, illustrative):
| Criterion | Weight | What it measures |
|---|---|---|
| Performance / results | 30% | Shot quality, temperature stability, steam power |
| Build & durability | 25% | Materials, longevity signals, repairability |
| Ease of use | 20% | Setup, daily workflow, cleaning |
| Value | 15% | Performance per dollar vs. the class |
| Consistency | 10% | Repeatable results, unit to unit |
Scores map to plain-language labels so a number is never shown without meaning. Because each category uses its own rubric, scores are not directly comparable across categories — we never mix rubrics into an “overall best” ranking.
- 90–100 Exceptional
- 80–89 Excellent
- 70–79 Good
- 60–69 Fair
- Below 60 Poor
Hands-on tested vs. research-based
We use a clearly-labeled, tiered approach and never imply lab testing we didn’t do:
- Tested — we physically used the product against our criteria, with first-hand observations and original photos.
- Researched — synthesized from specifications, verified owner feedback at scale, and expert sources, with no first-hand use. These never carry “tested” language.
Every review states its tier and how the product was acquired (retail-purchased, a manufacturer loaner, or research). As our operation matures, research-based pieces are upgraded to hands-on.
How we choose what to review
Reader demand comes first — search volume, coverage gaps, and requests drive what we cover, not what has the best commission. We aim to be representative of the market (bestsellers, category leaders, notable budget and premium options) so our guides are genuinely comparative. We may decline to rank a product that is out of stock, discontinued, or unverifiable.
When ratings change
Every review carries published, last-updated, and last-tested dates plus a visible change log. A rating can change when a hardware or firmware revision alters the product, long-term use reveals reliability issues, the competitive set shifts, we re-test with improved methodology, or we correct an error. We never silently edit scores — when a score changes, we log why.
Editorial independence
Ratings, rankings, and verdicts are decided by editorial staff alone. No advertiser, affiliate partner, or brand gets pre-publication review, approval, or influence over scores or rankings. The monetization system cannot reach the rating system by construction: affiliate offers and rating data live in separate records with no field linking one to the other. We publish unfavorable verdicts on high-commission products and recommend low- or no-commission options — including “the cheap one is fine” — whenever they win.
Sponsored or paid placements, if any, are never mixed into editorial ratings or “best” rankings; they are unmistakably labeled and excluded from our scoring. Writers disclose any financial interest in a brand they cover and are recused from rating it.