Retailer compliance scorecards can strike fear in the hearts of even the most confident and competent of suppliers, perhaps in part because they’re often compared to school report cards. It’s understandable to wince at the thought of being graded or scored. Making matters more complicated, there isn't a single scorecard standard. Every retailer structures their scorecard according to the measure(s) they’re most interested in, so Walmart’s scorecard will look different from Amazon’s and so on.
In the simplest terms, retailer compliance scorecards measure how well a supplier is meeting the retailer’s expectations. And just like your middle school math grade could greatly affect how your teacher (and parents) treated you, compliance scores are directly tied to things like retailer chargebacks, shelf space, promotional opportunities, and whether a retailer expands or shrinks future orders. In other words, scorecards can play a pivotal role in the growth of your business.
While every retailer scorecard is different, there are several categories and metrics you’re likely to find on most. Suppliers that understand what each metric measures will be better positioned to obtain top scores and quickly address root problems the scorecard reveals.
In this article, you will learn:
What a retailer compliance scorecard is and why it’s important
Common retailer scorecard metrics
How to use your scores to find and fix root issues
What is a Retailer Compliance Scorecard and Why is It Important?
A retailer compliance scorecard is a regular report (usually monthly or quarterly) that details how well a supplier is meeting the retailer’s operational requirements based on real transaction data (e.g., advance ship notices, dock scans, receiving records, labeling compliance).
Retailers work with hundreds (if not thousands) of suppliers. Compliance scorecards offer a consistent, data-driven way to track and compare performance across the full supplier spectrum — giving buying, replenishment, and finance teams visibility into which suppliers are reliable and which ones are creating extra work downstream.
Retailer compliance scores matter because they correspond to important consequences and opportunities. Good scores can translate to:
Fewer chargebacks. Scorecard misses (e.g., late shipments, short fills) usually translate into chargebacks, which are deductions taken directly from a supplier’s invoice.
Better retailer-supplier relationships and increased growth. Buyers and replenishment planners use the scorecard as a proxy for reliability when deciding whether to expand orders or add new SKUs. A supplier with a strong track record is easier to say "yes" to when new opportunities come up, while a consistently low score can shrink opportunities — even if the products themselves sell well.
Related Reading: Understanding Retailer Deductions, Chargebacks, and Fines
Common Retailer Compliance Scorecard Metrics
Scorecard metrics and their individual weightings vary by retailer. Here are some of the most common ones, divided by category:
Delivery Timing and Completeness
On-time (OT): whether the shipment arrived within the requested delivery window.
On-time, in-full (OTIF): timing and completeness combined; usually the most heavily weighted scorecard metric.
Fill rate: the percentage of ordered units that shipped.
Order and Data Accuracy
Case pack/unit-level accuracy: whether the shipped quantity matches the order at the SKU level.
Advance ship notice (ASN) accuracy: whether the ASN matches what’s in the shipment.
Documentation and Process Compliance
Electronic data interchange (EDI) compliance: whether required EDI documents (e.g., ASNs, invoices) were sent correctly and on time.
Labeling compliance: whether the supplier followed the labeling requirements for cartons, pallets, etc.
Product Quality
Defect rate/return rate: product issues (e.g., damage, material defects) discovered by the retailer or the end consumer.
How To Use Your Scorecard To Find and Fix Problems
While there are obvious benefits to getting good scores, less-than-stellar scores can also be helpful in identifying root issues that need attention. You can even think of scorecards as collaboration tools that help retailers and suppliers work better together. After all, retailers have a vested interest in helping their suppliers succeed. Rising tides raise all ships.
The following table breaks down the metrics above and the possible root causes behind low scores:
Metric | What it Measures | Common Root Causes |
On-time (OT) | Did the shipment arrive within the specific delivery window the retailer requested? | Missed dock appointment; carrier delay |
On-time, in-full (OTIF) | Did the order arrive on time, and did it arrive complete? | Carrier/scheduling issues (timing) and/or inventory/allocation issues (fill) |
Fill rate | What percentage of the units ordered by the retailer did the supplier actually ship? | Inventory shortages; allocation errors |
Case pack/unit-level accuracy | Did the shipment match what the retailer ordered (correct SKU and quantity)? | Substitutions; short shipments; mismatched pack sizes |
ASN accuracy | Did the ASN match what was physically in the shipment? | Data entry errors; timing mismatches between system and dock |
EDI compliance | Did the supplier send the required EDI documents correctly and on time? | Missing or incorrect EDI documents |
Labeling compliance | Did the supplier follow the retailer’s labeling requirements? | Mislabeled cartons |
Defect/return rate | Did the products have quality issues? | Damage; sizing problems (clothing); material defects; shelf-life issues (grocery) |
Related Reading: A Suppliers Guide to KeHE's Good Better Best (GBB) 2.0 Brand Scorecard
Frequently Asked Questions
What is a retailer compliance scorecard?
Retailers use compliance scorecards to track how well their suppliers are meeting operational expectations. Instead of a single grade, scorecards typically separate these expectations into various metrics gleaned through raw transaction data (ASNs, label scans, etc.).
What are common retailer compliance scorecard metrics and how are they weighted?
Every retailer structures its compliance scorecard differently in terms of both the metrics and their weights. A grocer that places utmost importance on in-stock rates may weight delivery timing and completeness more heavily than a specialty retailer focused on product quality. Before reacting to any single score, it helps to understand how that particular retailer weighs its categories.
While scorecards vary, common metrics include:
On-time (OT)
On-time, in-full (OTIF)
Fill rate
Case pack/unit-level accuracy
ASN accuracy
EDI compliance
Labeling compliance
Defect/return rate
How often should suppliers check their scorecards?
While you can wait for the monthly or quarterly summary, the scorecard itself might update more regularly and is often available on a self-service basis within the supplier portal. A weekly check can make it easier to catch issues before they turn into chargebacks.
What does a bad scorecard cost?
Because a bad scorecard can negatively affect the retailer-supplier relationship and shrink growth opportunities, it’s difficult to put a dollar amount on the cost. However, bad scorecards can also correlate to chargebacks. Walmart suppliers, for example, lose an average of 5.8% of revenue to deductions and compliance fines.
Partner with SPS Commerce for Fewer Scorecard Surprises
Many of the errors that show up on a compliance scorecard start as data problems. SPS Fulfillment uses MAX, the agentic AI supply chain layer that sits in the SPS network, to watch every transaction, ensure it matches what each retailer requires, and flag what’s off before it ships — so a missed ASN or labeling error gets caught before it becomes a deduction.
If you're already sitting on deductions tied to scorecard failures, SPS Revenue Recovery helps suppliers identify invalid deductions, gather documentation, build stronger disputes, and recover more revenue across every major retailer.
Not ready for either? Explore more supplier support articles on The Supply Chain Source.