The bench table you won't see anywhere else.
Why I published a public competitive benchmark with corrections-by-attribution, vs the analyst reports nobody can quote in a procurement deck.
Founder byline - 2026-02-28
The bench table itself
You can find it at /bench. Eight vendors, eight dimensions, scored as native, partial, or absent. BleedWatch is on the table next to GitGuardian, Snyk, Censys, Defender EASM, runZero, Wiz, and Bishop Fox. Each cell is a specific capability claim with a few words of context.
The table is published. The methodology is documented. The corrections inbox is [email protected]. Disagreements get published with attribution.
This article is not about the table itself. It's about why publishing it is the right move and why almost no security vendor does it.
The analyst-quadrant gravity
The dominant competitive framing in security software is the analyst quadrant. Gartner Magic Quadrant for SAST. Forrester Wave for ASM. IDC MarketScape for cloud security. The reports themselves cost between $2,000 and $20,000 per seat. They are based on vendor briefings, customer interviews, and proprietary scoring rubrics.
Three things make these reports awkward for buyers:
- You can't quote them externally without buying a reprint license — and the reprint license is usually purchased by the vendor and posted on their site, not by the buyer who needs an independent take.
- The vendor pays for the briefing. The relationship is incentive-aligned in a way that nobody pretends doesn't exist.
- Capability claims are recorded at one moment in time and update annually. In a category where the right product changes quarterly, this is structurally too slow.
I have nothing against the analyst firms. They serve a real function for risk-averse procurement teams. They are not the right frame for the kind of buyer BleedWatch sells to — a security engineer or a CISO at a mid-market or enterprise team who wants a defensible take they can quote in an email to their CFO.
What the bench at /bench is trying to do
Three principles:
1. Specificity over score. Each cell is a sentence, not a number. "Image-level only · no layer forensics" is a real claim a reviewer can check. "Score 7.3/10" is opaque.
2. Sources cited. The methodology page lists where each capability claim came from — public product docs, product trial, customer interview, vendor sales material. If we got it from a sales call, we say so. If we got it from running the product, we say so.
3. Corrections-by-attribution. When a vendor's marketing or engineering team writes in with a correction, we update the cell, we update the methodology with the date, and we credit the source in the changelog. The corrections inbox is [email protected]. As of writing, we've taken 3 corrections (one from Snyk's product team on a CI integration scope, one from Censys on a DNS coverage range, one from Bishop Fox on engagement format).
The corrections discipline is the part nobody else does. Bench tables published by competitors tend to be one-way: vendor publishes, vendor's customers cite, nobody updates. We update. The update history is the credibility.
The combat angle
I'll be honest that part of the reason for publishing is competitive. BleedWatch lives in a gap that the incumbents don't cover well (Docker layer scan, kill chain correlation, AgentGuard). The bench table makes that gap visible in a format procurement teams can read and quote.
I'm okay with the combat framing. It's how categories evolve. The big players have analyst-quadrant gravity; smaller players need a different format to be visible. Public, specific, corrections-attributed is the format that works for us.
The risk: a vendor sees their cell, disagrees, doesn't bother to write a correction, and instead complains in a different forum. That's happened twice in the four months the table has been published. Both times the complaining vendor's specific objection turned out to be either a misread of the cell or an outdated claim. Once we'd traced through the disagreement, both vendors went silent. Not malicious — just nobody on their team had the appetite to engage in public.
That's fine too. The table reflects our best read. It will be wrong sometimes. The corrections discipline assumes that and provides the path forward.
What I think a buyer should do with the table
Use it as an input, not an answer.
The right buyer behavior:
- Read the table to understand who claims what.
- Pick the 2-3 vendors whose claims map to your specific operating need.
- Run each vendor's free trial or sandbox against your own scope.
- Compare the actual outputs against the table's cell claims.
- If a vendor's actual output is better than the table claims — write to
[email protected]with what you saw. We'll update the cell. You'll get credited. - If a vendor's actual output is worse than the table claims — write to that vendor and to us. Both should care.
This is the procurement loop that scales. The vendor who supports it benefits from the trust that comes with public engagement. The vendor who hides from it gets routed around.
The "manifest destiny" objection
The objection I get sometimes is "you're going to put yourself on the table and rate yourself best, so the whole thing is biased." True. The bench shows BleedWatch as native across all 8 dimensions because the table reflects what we actually built. The fix to the bias isn't to leave BleedWatch off the table; it's to make the methodology specific enough that any reader can verify our cells against the actual product.
You can run the product. You can read the cells. You can find disagreement and write to us. The corrections we've published include a self-correction (we previously claimed native on a CI/CD coverage cell that should have been partial until we shipped the relevant scanner in March; we downgraded the cell, published the change in the changelog, and bumped it back to native when we shipped).
The bench is not perfect. It's specific, public, attributable, updated. That's enough.
Where this fits in the broader pitch
The bench is the procurement-credibility move. The honest pre-launch checklist is the operational-credibility move. The Trust Center is the security-credibility move. The research articles are the methodology-credibility move.
These are different layers of the same posture: be specific, name the gaps, publish the methodology, accept corrections. The competitors who do less of this win the analyst quadrant. The competitors who do more of it win the procurement deck.
That's the bet.