The enterprise data crisis
Organizations struggle to harness their most critical asset. The absence of a unified strategy produces a cascade of failures that erode trust, inhibit analysis and block innovation.
Absence of governance
Without a non-negotiable, machine-readable contract, data ecosystems devolve into a collection of inconsistent, individually invented structures. That is a fragile foundation, and it makes reliable validation impossible.
Semantic ambiguity
The same term, customer, carries different meanings across departments. These semantic gaps are a primary cause of misinterpretation, flawed analysis and failed integrations.
Poor data quality
Real-world data is imperfect: missing, invalid or unknown. Most systems fail to capture why a value is in an exceptional state, which forces guesswork downstream and discards information that was available at the point of capture.
What the failure actually costs
Two figures worth knowing, both from sources you can open. Neither is ours.
A 2019 JAMA analysis of waste in US health care put administrative complexity at $265.6 billion a year, the largest of the six waste domains it identified. It is also the only one for which the authors could name no intervention with demonstrated savings, which is why it appears here as a description of the problem rather than as a number we claim to recover.
The federal rulemaking behind the HIPAA 5010 transition is the closest thing to a measured cost of a semantic version change. It put a version step at 25 to 50 per cent of the original build cost, with testing alone accounting for 60 to 65 per cent of that step. The expense is not writing the software. It is proving that both sides still mean the same thing.
Read these honestly
The JAMA figure is in 2019 dollars and is problem framing, not a savings model. The HIPAA regulatory impact analysis projected net benefits for the transition overall; the migration cost is one side of its ledger. We cite them because they are checkable, not because they are flattering.
The core principle: decoupling syntax from semantics
This is the foundational move, and it avoids the primary failure mode of standards that mix structure and meaning.
- The structural container. A uniquely identified
complexTypeserves as a purely structural vessel. Its name carries no meaning, deliberately. - The conceptual entity. The business meaning is carried solely by a mandatory label element, so meaning is an explicit, separate, machine-readable payload rather than something encoded in a name.
- The result. The combination is a verifiable asset in which the sender's original intent is preserved and understood by the receiver.
The reference model is aligned to BFO 2020 (ISO/IEC 21838-2), the formal ontology standard adopted by the DoD, ODNI and CDAO. Read the alignment →
Handling imperfect data: beyond null
A cornerstone of SDC is the ability to record why data is missing. That turns a
data-quality problem into analyzable information, through the
ExceptionalValueType defined in the reference model and drawn from
ISO 21090.
A null tells you nothing. An exceptional value tells you the measurement was refused, or not applicable, or invalid, or masked for privacy. Those are different facts, and downstream analysis should be allowed to treat them differently.
See it run
The Verifiable Settlement Layer page shows a real
malformed value being quarantined and tagged INV rather than dropped.
A blueprint for verifiable AI
SDC is more than a data standard. It is a pipeline for building neuro-symbolic systems whose outputs can be checked.
The SDC-to-knowledge-graph pipeline
- Model. Create an enriched schema in which structural definitions and semantic meaning are co-located, forming a single source of truth.
- Transform. Deterministically extract those semantics from data instances to populate an RDF knowledge graph.
- Constrain. Translate the business rules in the schema into a SHACL shapes graph, which acts as a formal quality contract for the graph.
The semantic guardrail loop
- Learn. Graph neural networks learn latent patterns from the graph and predict missing facts and relationships.
- Verify. Those predictions are validated against the SHACL shapes. Predictions that violate domain rules are rejected.
- Refine. What survives is added back, so the symbolic rules govern the sub-symbolic model rather than the other way round.