Overview

We are witnessing a once-in-a-generation shift in data engineering and processing technology. There is a rapidly growing ecosystem of cloud based services like Snowflake, MongoDB, Looker, Databricks, Kafka, Tableau, etc.to store, process and analyze operational, business intelligence and other structured and semi-structured data. We call this the Data Mesh.

The Data Mesh enables organizations to embrace data democratization and be data driven. It eliminates silos, unlocks new use cases, and helps improve customer experience and company culture.

With the Data Mesh and Infrastructure-as-Code, businesses now have the opportunity to achieve massive gains in speed and efficiency, operate at virtually unlimited scale, and optimize price-for-performance. They can make their data and services readily accessible when and where it is needed, leaving the legacy IT organizations far behind in agility.

The trade-off is that your data is getting dispersed across numerous databases, microservices, data warehouses, analytics tools, and pipelines. And from the biggest business enabler that it should be, your data can quickly turn into the biggest liability. In the traditional architecture, you’d have database activity monitoring, data loss protection and identity access management tools to control who gets to access what. But in the modern data layer world with distributed multi-cloud assets, containers and microservices, these tools are quickly rendered useless, as proven by the ever-growing number of data breaches.

We believe the future of data is in its democratization, where any piece of information is readily available to those who are allowed to access it. In that world, access to data comes with complete visibility and control. Finally, with visibility and access control, there is the ability to immediately know when information is accessed in violation of established rules.