← Perspectives

Data Engineering

Data Mesh: Hype vs Reality

Three years after Zhamak Dehghani's seminal work, what's actually working in enterprise data mesh implementations?9 min read

Data mesh promised to solve the scaling problem that plagued centralized data teams. Decentralize ownership. Treat data as a product. Let domains own their data. Three years into real-world implementations, the results are... complicated.

The Promise That Launched a Thousand Initiatives

When Zhamak Dehghani published "How to Move Beyond a Monolithic Data Lake to a Distributed Data Mesh" in 2019, it struck a nerve. Data teams everywhere recognized the symptoms she diagnosed: bottlenecked central teams, domain experts disconnected from their data, and platforms that couldn't scale with organizational complexity.

The prescription was elegant: apply product thinking to data. Let domains own their data end-to-end. Build a self-serve platform that enables rather than gates. Establish federated governance that balances autonomy with interoperability.

By 2024, we have enough implementations to separate what actually works from what looked good on conference slides.

The Four Principles, Revisited

Data mesh rests on four principles. Let's examine how each has fared in practice.

The Four Principles of Data Mesh 1 Domain Ownership Domains own their data end-to-end, from source to consumption. WORKS WELL 2 Data as Product Data has product managers, SLAs, documentation, and consumers. PARTIALLY WORKS 3 Self-Serve Platform Infrastructure abstractions enable domains to build without tickets. HARD TO DO 4 Federated Governance Global standards with local autonomy for implementation. PARTIALLY WORKS DATA MESH

Figure 1: The four principles of data mesh and their real-world implementation status.

Domain Ownership: The Clear Win

This principle has proven most successful. When domain teams own their data, quality improves dramatically. The people who understand the business context—who know that "customer" means something different in Sales than in Support—are the ones defining and maintaining the data.

The catch? It requires domains to actually want ownership. Many business teams are happy to throw data "over the wall" to IT. Successful implementations invest heavily in change management, embedding data engineers within domains rather than just assigning ownership on paper.

Data as Product: Harder Than It Sounds

The "data as product" mindset resonates intellectually. Who wouldn't want clear ownership, defined SLAs, and consumer-focused design? In practice, most organizations struggle to fund dedicated data product managers.

The Staffing Reality

True data-as-product requires dedicated roles: data product managers who understand both the domain and downstream consumers. Most organizations underestimate this investment, resulting in "product ownership" that's really just a checkbox on someone's existing job.

Self-Serve Platform: The Bottleneck Moves

Building a platform that enables domains to provision infrastructure, create pipelines, and publish data products without tickets is a massive undertaking. Most organizations that claim "self-serve" have really just built slightly better ticketing systems.

True self-serve requires significant platform engineering investment—often larger than the centralized data team it's meant to enable. The irony isn't lost on practitioners: you need a strong central team to enable decentralization.

Federated Governance: The Political Minefield

Federated governance sounds elegant: global standards for interoperability, local autonomy for implementation. In reality, it often devolves into either chaos (no one follows the standards) or recentralization (the governance team becomes the new bottleneck).

Successful implementations invest in tooling that embeds governance automatically—schema validation, lineage tracking, access control—rather than relying on manual compliance.

What Actually Works

After observing dozens of implementations, patterns emerge around what separates success from expensive failure.

Approach Works Doesn't Work
Scope Start with 2–3 domains, expand slowly Big bang transformation
Platform Build incrementally based on demand Build complete platform upfront
Ownership Embed engineers in domains Assign ownership by decree
Governance Automate compliance through tooling Manual review processes
Standards Minimal viable interoperability Comprehensive upfront specification
Metrics Consumer satisfaction, time-to-data Data product count

The Organizational Prerequisites

Data mesh isn't primarily a technology problem—it's an organizational design problem. Before adopting data mesh, honest answers are needed to uncomfortable questions.

We spent eighteen months building a beautiful data mesh platform. Then we realized our domains didn't have anyone who wanted to use it. The technology was the easy part.

— VP of Data, Financial Services Company

Organizations that succeed with data mesh typically share characteristics: strong domain autonomy culture, technical talent distributed across business units, executive sponsorship that understands the investment required, and patience for multi-year transformation.

The Hybrid Reality

The most pragmatic implementations aren't pure data mesh—they're hybrids. A central team maintains the platform and handles cross-domain use cases. Domains own their data products but leverage shared infrastructure. Governance is federated in principle but centrally enabled through tooling.

This hybrid approach acknowledges reality: not every domain wants or can support full ownership. Some data is inherently cross-domain. Platform engineering is a specialized skill that shouldn't be replicated everywhere.

The 70/30 Rule

Successful hybrids often follow a pattern: 70% of data products owned by domains with strong technical capability, 30% maintained centrally for cross-cutting concerns and domains that aren't ready. The ratio shifts over time as capability matures.

When Data Mesh Makes Sense

Data mesh isn't universally applicable. It's designed for specific organizational contexts.

Data Mesh Is Right For You If...

  • Scale demands it: Centralized team genuinely can't keep up with domain needs
  • Domains are ready: Business units have or can hire technical talent
  • Executive commitment: Leadership understands multi-year investment
  • Culture supports it: Organization already operates with domain autonomy
  • Complexity warrants it: Simple data landscapes don't need mesh overhead

The Alternative: Data Mesh Principles Without Full Mesh

Many organizations benefit from data mesh principles without full implementation. Treating data as a product improves quality regardless of organizational structure. Domain involvement in data design catches issues early. Self-serve tooling reduces central team bottlenecks.

The pragmatic approach: adopt the principles incrementally where they add value, without committing to full architectural transformation. This "mesh-inspired" approach delivers 80% of the benefit at 20% of the organizational change management cost.

Looking Forward

Data mesh has matured from revolutionary manifesto to practical framework with known tradeoffs. The hype has subsided, replaced by hard-won implementation wisdom. Organizations starting today benefit from the failures and successes of early adopters.

The question is no longer "should we do data mesh?" but "which data mesh principles apply to our context, and how do we adopt them incrementally?" That's a sign of a maturing discipline.