01 Why Feature Checklists Fail

Decisions backed by evidence, not vendor claims.

In a sales cycle, every vendor says "yes". A platform chosen on marketing promises — or an idea greenlit without knowing who else is already building it — leads to operational lock-in and stalled transformations. Plumbline is a governed, vendor-neutral evaluation that moves from claims to hard constraints, so your next technology decision is defensible to your board, not just your gut.

Vendor Claims

Sales sheets & promises

Evidence Gathering

API testing & POCs

Constraint Analysis

Mapping to your reality

Defensible Recommendation

Objective architectural path

02 How We Evaluate Reality

We score on execution, not capabilities.

A feature checklist tells you what a platform can do. It says nothing about what it costs you to run. A platform can win every box on the list and still become the most expensive thing your team owns — because integrations matter more than features. If a required capability exists but its API limits extraction or lacks idempotency, your long-term engineering cost multiplies quietly, long after the contract is signed.

Vendor claims are not evidence

Sales collateral describes the platform vendors want to sell, not the one your team will operate. We test the claim before it becomes an architectural commitment.

Familiarity is not fit

Teams default to the platform they already recognise rather than the one that matches their actual requirements. A structured, evidence-led comparison closes that gap.

Lock-in is a design decision

API maturity, data portability, and extensibility determine how much control you keep after signature. We measure them before you sign, not after you're stuck.

03 Before You Build

Evidence for an idea, not just a vendor shortlist.

Not every Plumbline engagement starts with a shortlist of vendors. Some start with an idea that hasn't been built yet — and the question is whether it should be, and how. We apply the same evidence-led, vendor-neutral discipline to competitive-landscape and technical-feasibility research before a single line of code is committed.

  • What already exists in this market, and how mature is it?
  • Who are we up against, and where are they weak?
  • Which technical approaches are realistic for this idea, and what are the trade-offs?

What this covers

Competitive & market landscape mapping Technical feasibility and options analysis Market positioning research

Scaled to the question — a fast read on a single point of uncertainty, or a deeper study to shape strategy before you commit engineering time.

04 The Method

Four phases. A deliverable at every one.

Plumbline runs as a fixed-fee, 2–4 week diagnostic — not an open-ended audit. Each phase has a named deliverable, so you always know what you're getting and when.

Deliverables — Scope & Claims

  • Requirements register, drawn from your actual constraints
  • Vendor claims log — every promise made in the sales cycle, captured for testing
  • Constraint brief agreed with your technical stakeholders

The architectural trade-off matrix

There is no perfect platform, only the right set of trade-offs for your operational capacity. We map custom builds, headless platforms, and incumbent SaaS against your specific risk appetite. You don't just see the winner; you see exactly what you are sacrificing to get there.

Monolithic SaaS

All-in-one Ecosystem
API Maturity
Data Portability
Vendor Lock-in
Integration Effort
Ops Complexity
Total Cost (TCO)
Extensibility

Composable SaaS

Headless / MACH
API Maturity
Data Portability
Vendor Lock-in
Integration Effort
Ops Complexity
Total Cost (TCO)
Extensibility

Custom Build

In-house Architecture
API Maturity
Data Portability
Vendor Lock-in
Integration Effort
Ops Complexity
Total Cost (TCO)
Extensibility

05 How We Evidence Outcomes

No case study yet. A named methodology instead.

We don't have a public case study to point you to today, so we won't invent one. What we can show you is the framework itself — the same seven criteria and evaluation discipline applied to every Plumbline engagement, regardless of client or industry.

The seven-criteria evaluation framework

  • API maturity
  • Data portability
  • Vendor lock-in
  • Integration effort
  • Operational complexity
  • Total cost of ownership
  • Extensibility
100 %

Vendor Neutral

We take zero commission or referral fees from software vendors. Every recommendation is scored strictly against the seven-criteria framework and your operational constraints — if a custom build is cheaper long-term, we will tell you.

What the recommendation actually looks like

Every Plumbline engagement ends in a governed, board-ready document like this one — not a slide deck of impressions.

06 What's Included

One Assess-tier engagement. Fixed scope, fixed fee.

Plumbline is priced and structured the same way for every engagement — there is no ladder of tiers to navigate.

Fixed fee, agreed up front

No hourly billing, no per-seat pricing. One scoped fee for the full diagnostic, confirmed before work starts.

2–4 week diagnostic window

Scoped to the decision in front of you — a single platform question or a fuller build-vs-buy evaluation, sized to what's actually being decided.

Fully creditable against a Build

If the evidence points to a NOPSO-delivered Build, the Assess fee is credited in full against that engagement — you are never paying twice to reach the same decision.

A governed, board-ready deliverable

The evaluation ends in a document, not a slide deck of impressions — a recommendation your team can act on and your board can scrutinise.

08 What's Different

Governed by evidence, not by who pays us.

Zero commission, zero referral fees

We are not paid by the vendors we evaluate. There is no incentive, hidden or otherwise, pulling a recommendation toward any particular platform.

Evidence before recommendation, every time

We test API maturity, data portability, and real-world extensibility before a single line goes into the recommendation document — not after.

One evaluation framework, applied consistently

The same seven-criteria framework is used on every engagement. Scores are comparable across your shortlist, not improvised per platform.

No handoff between evaluation and recommendation

The senior evaluator who runs the diagnostic is the person who signs the recommendation — you are never re-briefing a different team midway through.

09 Is This The Right Offer?

Plumbline vs. the AI Readiness Assessment

Choose Plumbline when the question is which platform, vendor, or build approach to commit to. Choose the AI Readiness Assessment when the question is whether your organisation — data, governance, and operating model — is ready to adopt AI at all. Many engagements start with a readiness assessment and use Technology Evidence to evaluate the specific platforms it points to.

Frequently asked questions

A vendor demo shows you what the platform is designed to demo well. Plumbline tests the platform against your actual requirements using a fixed seven-criteria framework, and we take zero commission or referral fees from any vendor — so the comparison isn't shaped by who wants the deal most.

A governed, board-ready recommendation document: the target-state architecture or platform recommendation, the trade-off matrix across the options we evaluated, the integration risks, and a migration or adoption roadmap.

It runs as a fixed-fee, 2–4 week diagnostic, scoped to the decision in front of you before work starts. We don't publish a standing price list — every engagement is scoped to its own requirements — but there is no hourly billing and no surprise invoice.

No. The Assess fee is fully creditable against a subsequent Build engagement, so the evidence-gathering work you've already paid for reduces the cost of the build that follows it.

Plumbline answers a platform, vendor, or build question — which technology to commit to. The AI Readiness Assessment answers a different question — whether your organisation's data, governance, and operating model are ready to adopt AI at all. Many clients start with a readiness assessment and use Plumbline to evaluate the specific platforms it points to.

Start your Plumbline assessment.

Book a discovery call

Prefer to read first?

Cover for Get the Plumbline methodology report

Get the Plumbline methodology report

Your data is never shared. We'll send the report and follow up once.