AI governance is breaking down on accountability first

You have probably sat in a meeting where someone proposed an AI pilot, the room nodded, and no one wrote down who would verify the output before it reached a customer. Most enterprises govern AI the way they would any other IT rollout: they deploy dashboards, institute policies and conduct periodic reviews. The tooling matters, but Beena Ammanath, executive director of the Global Deloitte AI Institute, says the real fracture happens earlier. "Accountability usually breaks down first," she notes. "Teams deploy AI faster than their organisations can define who owns risk, approvals, monitoring and outcomes," which produces inconsistent use, fragmented controls and limits on scale.

The numbers confirm the gap. Deloitte's 2026 State of AI in the Enterprise report found that 84% of organisations surveyed have not adjusted jobs for AI, and only 21% have a mature governance framework in place despite rapid adoption. The implication is that enterprises are redesigning tooling without redesigning the work itself, or the people who own it.

What breaks when no one owns the output

Rajesh Arora, chief data and analytics officer at Principal Financial Group, frames the problem as a category error. "Technology can provide visibility and controls, but it can't replace leadership," he says. "The organisations that scale AI most effectively are the ones that treat accountability as a business responsibility, not a technology responsibility." A year ago Principal was building its ethical and responsible AI framework, its inventory and its governance processes to support responsible adoption. Now, Arora says, "Governance is increasingly embedded in those investment and operating decisions, rather than applied as a separate review at the end."

The cost of skipping that embedding shows up in public failures. A 2024 Stanford RegLab study found that AI-assisted research tools offered by LexisNexis and Thomson Reuters hallucinated between 17% and 33% of the time when working on legal queries, while the Damien Charlotin AI Hallucination Cases Database has identified 2,041 cases of fabrications so far. Ammanath's diagnosis applies: these are likely accountability failures, moments when no one actually owned the job of verifying the AI's output before it left the building.

Redesigning workflows, not just adding review gates

The Institute argues that enterprises need to redesign jobs and workflows as well as the tooling. That redesign starts with naming who approves a model for production, who monitors drift, who investigates an anomaly and who decides when to pull the plug. It continues by embedding those people into investment and operating decisions from the start, rather than bolting governance onto the end of a sprint. Arora's phrase, "embedded in those investment and operating decisions", describes the shift from governance as audit to governance as design.

The practical stake for L&D and innovation leaders is that AI literacy programmes will fail if they teach prompt engineering without teaching ownership. A team that knows how to use a model but does not know who is responsible for its output will produce exactly the fragmented controls Ammanath describes. The capability gap is the ability to name an owner, write down what that owner approves and build a workflow that surfaces problems before they compound. If 84% of organisations have not adjusted jobs for AI, the next wave of enablement work is a conversation about who owns the risk when the model is wrong.

Sources:

• CIO