As a 20 year veteran the biggest opportunity in new data space is potential for LLM unstructured data parsing and intelligent api integrations to break silos
This article assumes the business has a logical progression for its plans in question and then makes logical and somewhat rational decisions that lead to a operational estate vs a data estate when in realty it’s about budgets and pet projects and c suite whims and frank got fired after he brought in the last data engineering team who ended up building a data lake with a dashboard that one VP uses and know one else understands
Something gets built =>based on a limited dev budget it leads to something else getting built on top of it maybe if a consultant sells it well to an exec - ultimately it all becomes a complex spaghetti house of cards… or “data mesh”
This article assumes the business has a logical progression for its plans in question and then makes logical and somewhat rational decisions that lead to a operational estate vs a data estate when in realty it’s about budgets and pet projects and c suite whims and frank got fired after he brought in the last data engineering team who ended up building a data lake with a dashboard that one VP uses and know one else understands
Something gets built =>based on a limited dev budget it leads to something else getting built on top of it maybe if a consultant sells it well to an exec - ultimately it all becomes a complex spaghetti house of cards… or “data mesh”