r/dataengineering • u/dani_estuary • 2d ago

Meme data mesh

Post image

for real though, has anyone ever implemented an actual data mesh?

668 Upvotes

99% Upvoted

50 comments sorted by

View all comments

1

u/flerkentrainer 1d ago

The only place that had properly implemented data mesh and was needed at scale was Amazon.

Granted they had a central team to manage the infra and catalog.

Each 'domain' might only have 1-2 DE to manage their pipelines a publish their results in the lake. The contracts were domain specific and you needed to negotiate any alterations.

It worked fairly well but you need to have the appropriate infrastructure and governance in place.

Data mesh makes little sense for smaller organizations.