Skip to main content
STRATABook Audit

STRATA insights

The model versus work gap

6 min read

The premise of the last three years of AI procurement has been that the hard part is the model. Pick the right model, prompt it carefully, prove it works on a slice of the operating data, and the rest follows.

Most pilots did not produce the rest. The model worked. The work never shipped. The integration that was supposed to come after the proof of concept stayed on a project plan that nobody owned, funded against a budget that was already spent, executed by an engineering team that had been redirected, against deadlines that quietly slipped.

This is not a model problem. It is a work problem.

What was actually scoped

Pilot scopes circa 2023 to 2025 looked like this:

  • A vendor or internal team pulls a representative sample of the operating data.
  • The team configures a prompt or a fine-tune that produces the desired output on that sample at acceptable accuracy.
  • The team demonstrates the output to the executive sponsor.
  • The pilot is declared a success.

What was not scoped, in roughly nine of ten cases:

  • The integration into the system of record (CRM, AMS, PMS, ledger, ERP) that the operator actually uses to run the business.
  • The write-back of the model output into the workflow that downstream human staff depend on.
  • The exception handling for the 8 to 15 percent of cases the model gets wrong, including the operational surface for a human to override.
  • The audit logging required by the operator's compliance posture.
  • The ongoing monitoring required to detect drift in the underlying data or in the model's accuracy curve.

Each of those line items is itself a project. Each carries an engineering cost roughly equal to the original pilot. Each is the kind of work nobody put on the slide because the slide was about the model.

Why the work did not get done

Four structural reasons:

The budget cycle. The pilot was scoped against an innovation budget. The production work required an operating budget. Innovation budgets fund proofs; operating budgets fund integration. The dollars sat in the wrong column for the work to ship.

The team mandate. The AI team was chartered to prove what was possible. The integration team was chartered to keep what already exists running. Neither team was chartered to do the in-between work where the model becomes a workflow.

The vendor incentive. The vendor was paid for the pilot. The vendor was not paid for the production integration unless a separate Statement of Work was executed. Most pilots ended at the pilot.

The success criteria. Pilots were measured on model accuracy. Production deployments are measured on operational outcomes: revenue recovered, hours reclaimed, retention lifted. The measurement system did not carry across the handoff.

What "AI Operations Integration" actually means

The work that did not get done is the work that defines a category.

It is not consulting. Consultants do not own the production output; they leave the deliverable on the client's side of the handoff.

It is not SaaS. SaaS sells a tool that sits on top of the operating layer; it does not install inside the operating layer.

It is not an automation agency. Automation agencies wire pre-built no-code blocks; they do not write the integration code that handles the 8 to 15 percent of exceptions.

It is the firm that picks a vertical, learns it, maps the operating leaks, installs the layers that close them, measures the result in numbers the operator already tracks, and pauses the engagement if the numbers do not move.

That is the work. That is the category. That is STRATA.


STRATA is an AI Operations Integration firm. Book a Revenue Audit at /audit.