Process Hygiene: Why Clean Data Never Stays Clean
Process hygiene is the condition of the routines that create your data. What it is, the five failure patterns, and why data cleanups decay without it.
Notes from the Data Layer
Process hygiene is the condition of the routines that create your data. What it is, the five failure patterns, and why data cleanups decay without it.
How to dispute a retailer deduction across Walmart, UNFI, KeHE, and Kroger: filing windows, the evidence that wins, and the mistakes that auto-deny.
A plain-English guide to KeHE deduction codes: MCB, EP, spoils, service-level fines. What each means, which you can dispute, and how to file in K-Solve.
A plain-English guide to Kroger deductions: shortages, list cost, EDI, and ORAD. What each means, which you can dispute in Lavante, and by when.
A plain-English guide to Walmart deductions: Codes 22, 25, and 13, plus OTIF and SQEP fines. What each means, which you can dispute in APDP, and by when.
A plain-English guide to UNFI deduction codes: MCB, INV, shortages, spoilage, and compliance fees. What each one means, which are disputable, and how to file a dispute that wins.
A retailer told you to publish your items to 1WorldSync. Here is what a data pool actually is, how publication works, and why being on it does not mean your data is right.
On $2M of Amazon volume, Seller Central keeps roughly $105K more than Vendor Central. The 1P vs 3P margin math for a food brand, and why the gap isn't the real call.
Rank a $25M brand's channels by revenue and Walmart wins. Rank them by contribution after every deduction and the order scrambles. An interactive walk from gross revenue to the capital-allocation decision.
One wrong field in your item file pays a routing-guide fee on every shipment. How EDI and ASN chargebacks compound to six figures, and why you can't dispute them.
A practical guide to GDSN for specialty food brands: what a data pool is, why food can't treat it as optional, which attributes reject, and where the food-specific data breaks.
A valid check digit proves twelve or fourteen digits are internally consistent. It says nothing about the four things that actually get an item rejected. What GTIN verification means when the retailer, not the math, is the judge.
A brand's internal fill rate reads 99%. Walmart's OTIF scorecard reads 84%. Both are right. The 14.8-point gap costs $57K a year, and it hides in the one number the brand doesn't watch.
A $25M food brand writes off ~$67K in invalid retailer deductions a year without opening the file. Where the money hides in the data, and why it decays.
Book trade spend as marketing and your gross margin reads 52% when it's 44%. Why ASC 606 makes it contra-revenue, and what the misfiling hides.
Syndigo bought 1WorldSync, merging the two largest GDSN pools. 97% of US GLNs now sit in one pool, with one validation ruleset and no alternative routing.
Warehouse distribution through UNFI or KeHE costs 40-52% of wholesale after fees. DSD runs 25-35%. Here's when each model pays for itself.
A branded product's 45% gross margin loses 15 points to trade spend and deductions. Private label's 30% stays close to what it keeps.
A specialty food brand grew revenue 22% while cash declined. S&OP is the reconciliation of demand, production, and cash that most brands skip.
Trade promotion management data lives in three systems with three owners. 40% of small-brand trade spend goes unmeasured because nobody reconciles them.
Trade spend leakage explains why a brand's biggest account, reranked by net-revenue yield, often falls to the bottom of the list.
1WorldSync does not publish pricing. Annual subscription fees run $2K-$15K+ depending on SKU count, services, and contract terms.
The same $1M of revenue yields ~$54,000 more contribution through retail than through distribution. Most brands allocate by revenue rank, not contribution rank.
Three CPG penetration metrics get called one name: distribution, velocity vs. distribution, and household. Confusing them means funding the wrong strategy.
A single botched shelf reset worth $165,526. Classifying and dollarizing authorization voids turns a hunch into a ranked broker work list.
Trial vs repeat purchase: high penetration with low repeat means spending to acquire buyers who never come back. Product failure disguised as growth.
A specialty food brand's operating decisions are finite and answerable with rules, not dashboards. CPG analytics as a question engine, not a BI project.
Distribution tells you where you are. Scan velocity tells you how fast you sell there. That distinction drives expansion, pruning, and rationalization.
At a 99.3% fill rate, a synthetic $25M brand's short-ship cost reaches $894K over three years. Four dimensions, every dollar traced to a platform event.
Most retail velocity reports say what happened. Nine decision modes turn scan data into shelf defense, production plans, promo ROI, and distribution expansion.
The hard part is the 90 days after the buyer says yes. A retail readiness scorecard finds the operational gaps before the placement becomes a loss.
Retailer remittance stubs arrive as PDFs in inconsistent formats. Manual remittance parsing is the bottleneck between deduction discovery and recovery.
One contaminated lot can put dozens of SKUs and hundreds of stores inside the recall blast radius. Most brands need 72 hours to map it. It should take three.
Stockouts suppress observed velocity by 15-25%. A production demand forecast built on that data under-predicts demand, guaranteeing the next stockout.
Most CPG chargebacks trace to twelve product master fields. A governed product master data model (brand to pallet, GTINs at every level) closes the gap.
Most specialty food founders check a different number each week. A tiered Monday morning report tracks the same three signals and catches drift early.
Consultancies lose deals because NDAs block their proof. Deterministic data anonymization turns client work into case studies buyers can verify.
EDI reconciliation at most CPG brands stops at the 997. Quantities, prices, and item identities go unchecked across the PO lifecycle.
Distribution penetration is the gap between authorized and scanning doors, where slotting is paid and revenue never arrives. Most brands cannot state it.
Sales rose on price while fewer households bought each quarter. Three-lever sales decomposition catches erosion disguised as growth.
CPG data standards in one page: GTIN anatomy, GDSN syndication, retailer item setup, and freight-class logic, verified against GS1 and retailer sources.
When two file versions disagree on 400 rows, the cost is the hours spent finding them. A data comparison tool cuts that to seconds.
Chargeback prediction works: 70-80% of compliance penalties trace to specific, fixable upstream data conditions present at shipment time.
Applying a five-layer cost waterfall to 10 channels shows gross revenue rank and contribution rank diverge by 3-4 positions for most specialty food brands.
Deduction recovery at specialty food brands runs under 15% of deducted dollars. Five compounding operational failures, not failed disputes, explain the gap.
A single wrong digit in a GS1-128 shipping label GTIN generates retailer chargebacks thousands of times the label's cost. Most brands verify labels by eye.
Contract to cash: of every invoiced dollar, 15-25 cents disappears into deductions, chargebacks, and timing gaps. Most brands never calculate it.
Channel profitability analysis ranks channels by contribution after trade, compliance, and deductions. The highest-revenue channel is often the lowest return.
SKU rationalization by revenue rank misses the SKUs bleeding margin through trade cost, chargebacks, and velocity decay. 35% drive zero profit.
Commission rates run 5-12% but the fee structure (commission, retainer, or hybrid) determines what the broker prioritizes. Real ranges and total cost analysis.
Seven GDSN validation errors cause most retailer rejections, brand name mismatches, missing GLNs, barcode type errors. Per-field fixes and what they cost.
Retail launch economics: most specialty food launches into national retail lose money in year one after slotting, trade spend, compliance, and working capital.
Most retailer chargebacks concentrate in four root cause categories. How to run the twelve-month diagnostic that maps each one to a fixable data field.
SPINS vs. Retail Link: one covers natural channel trends and share, the other Walmart store-level POS. A framework for which one answers your question.
The Syndigo 1WorldSync migration hits three kinds of brand differently depending on whether you ran GDSN, content syndication, or both. What moves and what doesn't.
Ten decisions nobody owns drive specialty food brand operational costs of $1.4M–$2.3M a year. Each is answerable with data the brand already has.
Most co-packer agreements protect IP but miss the operational clauses that prevent retailer chargebacks, GTIN ownership, ASN obligations, fill rate.
CPG demand forecasting built on ERP shipment records misses the retail scan signal, and the gap costs money in both directions.
The gross-to-net bridge is built from scan allowances, MCBs, slotting fees, and distributor deductions, none of which appear on a standard P&L.
Food broker management needs its own data layer. Brokers earn on shipments, not scans. What Retail Link, SPINS, and UNFI Connect show that the deck omits.
Before the first Sprouts order, brands need UNFI item setup, IX-ONE image registration, and EDI 810 compliance. Here's the operational sequence.
Most CPG brands track deduction win rate, not dispute rate: the share of invalid deductions ever contested. Distributor deduction management starts there.
Whole Foods supplier data requirements split between WFM buyer approval and UNFI item setup. EDI and item data pace the launch timeline.
SBT transfers inventory ownership, shrink liability, and reconciliation burden to the supplier. Most brands sign without reviewing those terms.
UNFI rejects at the document layer. KeHE rejects on barcodes and date formats. The pre-submission checklist is different for each, here's what to check.
Units per store per week is the velocity number buyers use to delist SKUs. Brands measure it from shipments; buyers measure scans, and the gap costs facings.
CPG deductions run 5-15% of gross sales. Net margins sit at 3-5%. A supply chain data quality audit traces the gap to twelve fields nobody has audited.
EDI 856 ASN errors generate more chargebacks than any other EDI document. Four error types cause most of them. All are data fixes, not logistics changes.
Most OTIF fines at specialty food brands trace back to product master data errors, not late trucks. Where the data breaks, and what it costs.
Twelve fields disagreeing across three systems cause most CPG chargebacks. Product master data management starts here: the fields, the systems, the cost.
Syndigo bought 1WorldSync, so the vendor comparison is over. What replaces it is one supplier controlling 97% of U.S. GDSN routing on the other side of the table at renewal.
Specialty food brands spend 15-20% of revenue on trade promotions and can't say which worked. Trade spend optimization starts by connecting three data streams.