How accurate is the matching?
Results at a glance
91%
of each company's top 10 matches were relevant (average)
69%
of the open notices in each company's own industry codes were found (average)
18 of 20
company websites could be read; the other 2 got no matches
How we tested
We picked 20 small and mid-sized US companies that have won federal contracts, across 19 industries. For each one we did exactly what a new customer does: entered the company's website and let the product build a profile from it. We added nothing by hand.
We then scored all 5,065 SAM.gov notices that were open that day and checked the top 10 matches for each company. A match counts as relevant if its industry (NAICS) code belongs to the same family as contracts the company has actually won, according to USAspending.gov, or if a reviewer read the notice and found it fits the services on the company's website.
We used 15 of the companies while improving the matching. The other 5 we kept aside and only ran at the end, to see how it does on companies it was never tuned for. Those results are worse, and we show them separately.
Results
| Company's industry | Top 10 relevant | Found in its codes | Note |
|---|---|---|---|
| Used while improving the matching (15): 94% relevant, 77% found | |||
| IT services | 80% | 96% | |
| IT services / cybersecurity | 100% | 14% | |
| R&D / research software | 100% | 56% | |
| Construction (general building) | 100% | 100% | |
| Construction (general building) | 100% | 100% | |
| Janitorial / facilities | 90% | 30% | |
| Architecture & engineering | 100% | 97% | |
| Consulting / accounting | 100% | 94% | |
| Management consulting | 100% | 100% | |
| Medical supplies | 100% | 100% | |
| Logistics / freight | 50% | — | No open notices in its award codes that day |
| Manufacturing (machining) | 100% | 94% | |
| Training | 100% | 100% | |
| Security guards | — | 0% | Website could not be reached, so no profile and no matches |
| R&D (energy / aerospace) | 100% | 98% | |
| Never seen before the final run (5): 80% relevant, 47% found | |||
| IT consulting | 100% | 96% | |
| Manufacturing (machine shop) | 100% | 6% | |
| Healthcare staffing | 60% | 33% | |
| Environmental consulting | 60% | 100% | |
| HVAC / mechanical construction | — | 0% | Website blocks automated reading, so no profile and no matches |
Averages leave out the 2 companies with no profile for "top 10 relevant", and the company with no open notices in its codes for "found". We don't name the companies: they didn't ask to be in a test.
Where it falls short
- Websites we can't read. If a site blocks automated reading or is down, the free scan finds nothing. You can still type your services and NAICS codes into your profile by hand.
- Broad suppliers. A machine shop that can make almost anything matched only 6% of the notices in its codes, because most of those are short parts orders that name no service. Adding your exact NAICS codes and product keywords to your profile fixes most of this.
- Unseen companies did worse. 80% relevant instead of 94%. Twenty companies is a small test, so treat these numbers as a rough guide, not a guarantee.
- Federal only. This test covers SAM.gov notices. State, local and forecast listings use the same scoring but were not part of it.
Every score in the product shows the points behind it, so you can see why a notice matched. See how matching works. We rerun this test when we change the matching and update this page with the new results.
Try it on your own company.
Enter your website. The preview is free and needs no account.