Open navigation menu

Why Trusted Data Is the Foundation of Enterprise AI

Enterprise AI rarely fails at the model. It fails on data nobody certified for the job. The fix is not a clean-everything program but trusted data, earned one use case at a time.

By INVISOMJuly 9, 202611 min read

AI projects stall on data, not on models

Most leadership conversations about AI still start with the model: which vendor, which size, which benchmark. The evidence points somewhere else.

In February 2025 Gartner reported that 63% of organizations either do not have, or are unsure whether they have, the right data management practices for AI, based on a third-quarter 2024 survey of 248 data management leaders. In the same release it predicted that through 2026, organizations will abandon 60% of AI projects that are not supported by AI-ready data. Seven months earlier, Gartner had predicted that at least 30% of generative AI projects would be abandoned after proof of concept by the end of 2025, naming poor data quality first among four causes.

Independent research says the same thing from the practitioner side. RAND interviewed 65 experienced data scientists and engineers for an August 2024 report on why AI projects fail. Of the five root causes it identified, one is that organizations lack the data needed to train an effective model, and another is underinvestment in the infrastructure to manage data and deploy models. The report also notes estimates that more than 80% of AI projects fail, about twice the rate of IT projects without AI.

Figure 1

The data gap, not the model gap, is what stalls AI

Survey findings and analyst predictions on data readiness and AI project abandonment

  • 63%

    of organizations lack, or are unsure they have, the right data management practices for AI

    Survey · Gartner, Q3 2024 survey of 248 data management leaders

  • 60%

    of AI projects unsupported by AI-ready data will be abandoned through 2026

    Prediction · Gartner, February 2025

  • 30%+

    of generative AI projects abandoned after proof of concept by end of 2025, poor data quality cited first

    Prediction · Gartner, July 2024

Practitioner view · RAND, 2024

Interviews with 65 data scientists and engineers found five root causes of AI project failure. Two are about data: lacking the data needed to train an effective model, and underinvesting in the infrastructure to manage data and deploy models.

Sources: Gartner press releases of 29 July 2024 and 26 February 2025; RAND Corporation, RR-A2680-1, August 2024.

Our argument in this article is narrower than "data matters", which nobody disputes. It is this: trusted data is not a property of a data estate. It is a property of a specific dataset for a specific use, and it has to be demonstrated, not assumed. Organizations that treat data readiness as an enterprise-wide cleanup to finish before AI begins will wait forever. Organizations that skip it ship confident wrong answers. The workable path is in between: certify the data each use case depends on, and build the foundation out of those certifications.

What untrusted data has already cost

The failures below were not caused by weak models. Each one came from data that was wrong, stale, inconsistent or miscalculated, and from the absence of controls that would have caught it.

Figure 2

Upstream data failures surface downstream as AI and analytics failures

Four public cases. In none of them was the model the root cause.

  • Unity Software

    2022

    Ad-targeting ML tool lost accuracy; part of the training data lost its value after bad data was ingested from a large customer

    Unvalidated third-party input

    ≈ $110m estimated 2022 revenue impact

  • Citigroup

    2020 and 2024

    Regulators cited long-standing data governance failures, then insufficient progress on data quality management

    Data quality as a governance gap

    $400m (OCC, 2020) plus $135.6m (Fed and OCC, 2024)

  • Equifax

    Mar–Apr 2022

    Coding issue in a legacy environment awaiting cloud migration changed how some credit scores were calculated

    Untested derived data

    <300,000 consumers with score shifts of 25+ points

  • Air Canada

    Feb 2024 ruling

    Website chatbot gave bereavement-fare guidance that contradicted another page of the same website

    No controlled source of truth for content

    Tribunal held the airline liable for its chatbot's answer

Sources: Unity Q1 2022 earnings call; OCC (7 October 2020) and Federal Reserve (10 July 2024) releases; Equifax statement (August 2022); Moffatt v. Air Canada, 2024 BCCRT 149.

Unity Software, 2022. On its first-quarter 2022 earnings call, Unity disclosed a fault that reduced the accuracy of Audience Pinpointer, its machine learning tool for targeting ads, and said it had lost the value of part of its training data, partly by ingesting bad data from a large customer. It estimated the impact at about $110 million of 2022 revenue. Management's own diagnosis was that the platform had been built more for growth than for resilience.

Citigroup, 2020 and 2024. In October 2020 the US Office of the Comptroller of the Currency fined Citibank $400 million, citing a long-standing failure to establish effective risk management and data governance programs. In July 2024 the Federal Reserve fined Citigroup a further $60.6 million, finding insufficient progress in remediating its data quality management problems, and the OCC added $75 million. Data quality became a supervisory matter measured in years and in nine-figure penalties.

Equifax, 2022. Between 17 March and 6 April 2022, a coding issue in a legacy on-premises environment, which was due to be migrated to Equifax's new cloud platform, affected how some credit scores were calculated. Equifax said underlying credit report data did not change, but fewer than 300,000 consumers saw a score shift of 25 points or more, and those scores were supplied to lenders while consumers were applying for credit. The source data was right. The derived data was wrong, and nothing downstream checked it.

Air Canada, 2024. A customer asked the airline's website chatbot about bereavement fares and was told he could apply for the discount after travel. Another page of the same website said the opposite. In February 2024 British Columbia's Civil Resolution Tribunal held the airline responsible for all information on its website, whether it came from a static page or a chatbot, and ordered it to pay damages. The decision does not establish whether the bot invented the answer or drew on inconsistent content. Either way, the organization had no controlled source of truth for its own policy.

The pattern across the four: the data failure was upstream, the damage surfaced downstream in a model, a score or an answer, and there was no point between the two where anyone verified fitness for use.

"AI-ready" means fit for a specific use

Gartner's definition of AI-ready data is useful because it rejects the idea of a single quality bar. Data is AI-ready when it is representative of the use case, including the patterns, errors and outliers the model will meet in production. Gartner stresses in the same release that AI-ready data differs materially from traditional data management. A fraud model needs the anomalies a reporting team would cleanse away. A forecast needs the history a migration project might have truncated.

The clearest regulatory statement of the same idea is Article 10 of the EU AI Act, which applies to high-risk AI systems. It requires training, validation and test data to be relevant, sufficiently representative and, to the best extent possible, free of errors and complete, in view of the intended purpose. It also requires documented governance practices: the origin of the data, preparation steps such as labeling and cleaning, the assumptions about what the data represents, an assessment of availability and suitability, bias examination, and identification of data gaps. Even organizations outside the Act's scope would do well to treat that list as a definition of done.

Three implications follow for leaders:

  • Readiness is assessed per use case. The same customer table can be ready for churn analytics and unfit for credit decisions.
  • Readiness decays. Data that was representative last year may not be after a product launch, a policy change or a system migration. It must be monitored, not certified once.
  • Readiness needs evidence. "The data team says it is fine" is not evidence. Lineage, measured quality against stated thresholds, and a named owner are.

Structured and unstructured data fail differently

Most data quality practice grew up around structured data in rows and columns. Generative AI has moved the risk into documents, policies, emails, contracts and transcripts, where the failure modes are different and the controls are less mature.

Figure 3

Structured and unstructured data fail the same tests in different ways

Six readiness tests, applied to tables and to documents

  • Defined

    Structured

    Business terms agreed once; the same metric means the same thing in every system

    Unstructured

    Each document has a type, an owner and an authoritative status

  • Current

    Structured

    Freshness measured against the decision's needs; history kept, not overwritten

    Unstructured

    Superseded versions removed from the index; effective dates recorded

  • Consistent

    Structured

    Keys join across systems; duplicates resolved, including Arabic name variants

    Unstructured

    Contradicting documents detected before they are retrieved together

  • Representative

    Structured

    Training data covers the outliers and segments the model will meet

    Unstructured

    Corpus covers the questions users actually ask, in the languages they ask them

  • Traceable

    Structured

    Lineage from source to feature, including derived scores and aggregates

    Unstructured

    Every answer cites its source passage and document version

  • Permissioned

    Structured

    Row and column policies follow the data into AI pipelines

    Unstructured

    Source-system permissions carried into the retrieval index

INVISOM framework.

For structured data, the familiar problems still dominate: business terms defined differently in different systems, keys that do not join, history overwritten without trace, and features computed by code nobody has tested since it was written. The Equifax case is a reminder that derived data needs the same scrutiny as source data.

For unstructured data, the hard problems are currency, authority and permission. A retrieval system will happily ground an answer in a superseded policy if the superseded version is still in the index. It will mix two documents that contradict each other, as Air Canada's website did. It may surface content to a user who should never have seen it, because the original file permissions were not carried into the index. None of these is a model defect, and none is fixed by a better model. Our comparison of RAG, fine-tuning and custom models explains why grounding approaches depend so heavily on the quality of the content they retrieve.

Certify data products, don't clean the estate

The instinctive response to all of this is a large, enterprise-wide data quality program that runs ahead of AI. These programs tend to stall, because they have no use case to define what "good enough" means and no business owner to pay for it.

The alternative is to make certification the unit of work. For each AI use case, identify the handful of data assets it depends on, test them against explicit criteria, and record the result where both the AI team and auditors can see it. Each certified asset becomes reusable by the next use case. Over time the trusted foundation is the sum of what has been certified, not a separate project.

Figure 4

Certify the data behind each use case before it reaches production

Score each critical data asset. Red criteria are gates: below “Partial” means not ready.

0 · No / unknown1 · Partial2 · Evidenced
  1. OwnerGateIs a named business owner accountable for this data?
  2. DefinitionGateAre the critical fields or document types defined and agreed?
  3. LineageGateCan we trace it from source to model input or index?
  4. Measured qualityIs quality measured against thresholds set for this use?
  5. RepresentativenessDoes it cover the cases, segments and languages the AI will meet?
  6. AccessDo permissions and classification follow the data into the AI system?
  7. MonitoringWill drift or degradation be detected after go-live?

A certified asset is recorded in the catalog with its score, owner and review date, so the next use case can reuse it instead of repeating the work.

INVISOM framework.

The scorecard is deliberately short. A use case that cannot score at least "partial" on ownership, definition and lineage is not ready for production, however impressive the pilot. Our article on moving from AI experimentation to enterprise value describes the gates at which this check belongs. The detailed mechanics of rules, thresholds and service levels are covered in our companion article, A Practical Framework for Enterprise Data Quality.

Weak signal of trustStrong signal of trust
"The data comes from the system of record"Lineage from system of record to model input, including transformations
A data quality dashboard nobody ownsThresholds per critical element, with a named owner and resolution SLA
A document library indexed for retrievalAn index restricted to current, approved versions, with permissions carried through
Training data selected by the project teamDocumented selection, representativeness check and known gaps
Accuracy measured once at go-liveInput drift and output quality monitored in production

The Gulf view

For Saudi public entities and the partners that handle their data, trusted data is already a compliance obligation. The NDMO Data Management and Personal Data Protection Standards include a full Data Quality domain, from prioritization and an initial assessment through to quality rules, monitoring, issue resolution and service levels, and the National Data Index assesses compliance on evidence. An entity that certifies data for AI use cases in the way described above is producing the same evidence the NDI asks for. Our NDMO implementation guide covers the build order.

Two regional data problems deserve explicit attention in AI readiness reviews. First, Arabic names and addresses are transliterated inconsistently across systems, so customer and citizen records that look distinct are often the same person. Entity resolution has to be tested on Arabic data, not assumed from tools tuned on English. Second, much institutional knowledge sits in scanned Arabic documents, where text extraction errors become retrieval errors. Both are data problems that no choice of model removes.

What to do in the next 90 days

  1. List the data assets behind your top five AI use cases, in production or planned, and name an accountable business owner for each.
  2. Score each asset on the trust scorecard. Treat "unknown" as "fail".
  3. Stop or gate any use case whose critical data has no owner, no agreed definition or no lineage.
  4. Audit your retrieval indexes for superseded documents, duplicates and lost permissions before the next generative AI release.
  5. Add derived data to scope. Features, scores and aggregates need tests, not only source tables.
  6. Publish certification status in your data catalog, so the next team can reuse certified assets instead of starting again.
  7. Set a monitoring cadence for every certified asset, so readiness is re-proven rather than assumed.

Frequently asked questions

What is AI-ready data?

Data that is fit for a specific AI use: representative of the situations the model will face, including outliers and errors, with known lineage, agreed definitions, a named owner and ongoing monitoring. It is defined per use case, not once for the whole organization.

Why do AI projects fail because of data?

Because models amplify whatever they are given. Gartner predicts that through 2026 organizations will abandon 60% of AI projects not supported by AI-ready data, and RAND's interviews with practitioners identify lack of suitable data and underinvestment in data infrastructure among the leading root causes of failure.

Is data quality for AI different from traditional data quality?

Partly. Traditional quality work often removes anomalies; AI may need them, because they are what a fraud or failure model must learn. AI also adds concerns such as representativeness, bias, document currency and permissions in retrieval indexes.

Should we fix all our data before starting AI?

No. Enterprise-wide cleanups without a use case tend to stall. Certify the specific data each priority use case depends on, monitor it, and reuse the certified assets across later use cases.

Sources and further reading

Work with INVISOM

Assess whether your data is ready for your next AI use case

Start a conversation

Related Insights

Continue the Topic

View all insights

Trusted DataImplementation Guide

A Practical Data Quality Framework

Most data quality programs measure everything and fix little. Start from the few dozen data elements that decisions depend on, write rules against them, and run quality as a service with thresholds, owners and resolution times.

Jul 12, 2026 · 11 min read

GovernanceImplementation Guide

Implementing NDMO With DAMA-DMBOK

The NDMO standards tell you what must be true. DAMA-DMBOK tells you how to make it true. Entities that confuse the two end up with 191 documents and very little managed data.

Aug 10, 2026 · 13 min read

Enterprise AIExecutive Guide

Why AI Pilots Rarely Reach the P&L

Most organizations no longer have an adoption problem. They have a conversion problem: pilots that prove a model works, but never prove the business changed.

Aug 27, 2026 · 11 min read