The Data Massagist The Data Massagist by Pablo Junco

Filter by

10 Articles match the selected category: Databricks


Agent-of-Agents: Why AI Future Is Recursive

Agent-of-Agents: Why AI Future Is Recursive

This edition of The Data Massagist explores the rise of agent ecosystems as the next evolution of enterprise AI. Instead of isolated copilots or chatbots, organizations are moving toward Multi-Agent Systems (MAS) where specialized AI agents collaborate, delegate tasks, and consume the outputs of other agents to execute end-to-end workflows. The article explains why this shift is happening now and how enterprises are adopting coordinated intelligence patterns such as triage (intake and prioritization), routing (dynamic task delegation), and orchestration (workflow execution and control). It highlights how industries like telecom, healthcare, manufacturing, and energy are already applying these models, and why the future of AI will depend on building scalable, governed ecosystems of interacting agents rather than standalone tools.

Read it on LinkedIn

Data Agents Databricks MS Fabric MS Foundry Newsletter

Governing AI Responsibly in Modern Analytics Platforms

Governing AI Responsibly in Modern Analytics Platforms

AI adoption is accelerating—projected to reach 1.3B agents by 2028—making siloed approaches ineffective. Chief Data Officers (CDOs) are key to enabling responsible, scalable AI built on modern platforms like Microsoft Fabric, Snowflake, and Databricks, which now serve as both data and AI foundations. While Snowflake and Databricks offer flexibility, they require strong governance; Fabric emphasizes built-in control and compliance. As AI agents grow more autonomous, CDOs must expand from data governance to full AI governance, including models, prompts, and actions. Microsoft Purview emerges as a unified, cross-platform governance layer, enabling visibility, control, and risk management. Ultimately, responsible AI depends on architecture and governance by design—not just principles.

Read it Now

Data Governance Databricks MS Fabric MS Purview Newsletter Responsable AI Snowflake

100+ Articles, One Hub and, FabCon Recap

100+ Articles, One Hub and, FabCon Recap

Edition #8 of The Data Massagist marks two milestones: the launch of thedatamassagist.com and key takeaways from FabCon / SQLCon Atlanta 2026. The new website centralizes 100+ articles from LinkedIn, Forbes, and other platforms into a curated, category-driven experience with AI-generated summaries—built as a hands-on coding project with the author’s 11-year-old son. FabCon/SQLCon highlighted a strategic shift toward convergence: Microsoft Fabric as the data and AI control plane, Azure Databricks as a complementary execution engine, Purview as the governance backbone, and SQL as a modern, AI-ready foundation. The core message: fewer platforms, stronger integration, and architecture focused on outcomes, trust, and intelligence.

Read it Now

Databricks MS Fabric MS SQL Newsletter

The Economics of Modern Data Platforms

The Economics of Modern Data Platforms

This is Edition #7 of the newsletter, focused on how pricing really works in modern data platforms like Microsoft Fabric and Azure Databricks. It explains how compute consumption (CUs vs DBUs) is the main cost driver and why architecture—not pricing tables—ultimately determines spend. The article explores the impact of storage, data movement, and query behavior on total cost, highlighting hidden inefficiencies. It also compares both platforms’ approaches to scalability and performance. Finally, it provides practical strategies for cost optimization through better design, observability, and FinOps discipline.

Read it Now

Databricks MS Fabric Newsletter

From Blank Canvas to Data Architecture: Designing Greenfield Platforms

From Blank Canvas to Data Architecture: Designing Greenfield Platforms

This article explores greenfield data architecture as a rare opportunity to design the future without legacy constraints. Using art as a metaphor, it explains why greenfield platforms demand clarity, responsibility, and strong design principles from day one. It shows how modern architectures converge on lakehouse‑first foundations, open data formats, and built‑in governance, and compares three proven paths: Azure Databricks with Power BI, Microsoft Fabric, or both together. The conclusion is clear: greenfield success is not about tools or speed, but about building an architecture that can evolve, scale, and endure over time.

Read it Now

Databricks MS Fabric Newsletter

Modern Data Platforms Aren’t About Data

Modern Data Platforms Aren’t About Data

In this edition of The Data Massagist, I reflect on recent milestones—from presenting at the Microsoft AI Tour to earning Fabric and Databricks certifications—and use them to explore a deeper truth: data platforms succeed not because of tools alone, but because of structure and clarity. I introduce the seven business layers of a real data platform, showing how Microsoft Fabric simplifies each one—from raw signals to intelligent experiences—while reducing complexity, TCO, and organizational blind spots. Ultimately, great platforms don’t create advantage; clear, shared understanding does.

Read it Now

Databricks MS Fabric Newsletter

Why Azure Databricks Is a Top Priority for Microsoft

Why Azure Databricks Is a Top Priority for Microsoft

Azure Databricks is a first‑party service in Microsoft’s analytics portfolio and a strategic priority, not a competitor to Microsoft Fabric. Customers can choose Fabric, Databricks, or both—without internal Microsoft bias—because sellers are aligned to recommend the best fit. Azure provides the best-performing cloud for Databricks, with proven performance gains, tight security, and deep integration with Microsoft’s ecosystem. Native interoperability with Fabric, Power BI, Azure AI Foundry, Purview, and the Power Platform enables unified, governed lakehouse architectures without data duplication. Together, Microsoft and Databricks deliver an open, scalable, and AI‑ready data platform trusted by enterprises worldwide.

Read it Now

Databricks MS Fabric MS Foundry SAP

Evolving Big Data Strategies With Data Lakehouses And Data Mesh

Evolving Big Data Strategies With Data Lakehouses And Data Mesh

This piece revisits a Forbes article published in August 2023, where Pablo Junco argued that Chief Data Officers should modernize big data strategies by adopting Data Lakehouse and Data Mesh architectures. Ten months later, those recommendations remain highly relevant, reinforced by Microsoft’s announcement of Microsoft Fabric. The article highlights the importance of reducing duplicated data, avoiding costly and unreliable ETL pipelines, and enabling real‑time analysis on operational data. It positions the lakehouse as a unified foundation for analytics and machine learning, while data mesh promotes data democratization across business units. Together with strong governance and modern analytics, these approaches help organizations lower costs, accelerate innovation, and build a sustainable, data‑driven culture.

Read it on Forbes.com

Databricks Forbes MS Fabric

Microsoft & Databricks: Powering the Future of Analytics

Microsoft & Databricks: Powering the Future of Analytics

Microsoft’s Intelligent Data Platform (MIDP) unifies databases, analytics, BI, and governance, strengthening the partnership with Databricks to help organizations scale analytics responsibly. Microsoft Fabric further integrates Azure Data Factory, Synapse, and Power BI, enabling unified data engineering, analytics, and BI with security and privacy. Azure Databricks can access Fabric’s OneLake, supporting the medallion architecture and OneLake Shortcuts for multi-cloud, zero-copy data access. Power BI’s Direct Lake mode allows querying curated data directly, aligning BI and ML workflows. This integration reinforces the Microsoft-Databricks partnership, delivering efficient, flexible, and secure data analytics at scale.

Read it Now

Databricks

Innovate faster by migrating from Hadoop to Azure Databricks

Innovate faster by migrating from Hadoop to Azure Databricks

This article highlights that many organizations still run Hadoop on-premises, wasting time on maintenance instead of innovation. Migrating to the cloud with Azure HDInsight or Azure Databricks improves scalability, agility, and cost efficiency. Azure Databricks offers enterprise security, native Azure integration, compliance, and seamless analytics with Azure Synapse. Organizations can save up to 52% through migration and pre-purchase plans. Junco cites success stories from companies like Daimler, Starbucks, and City of Spokane, showing gains in predictive analytics, machine learning, and operational efficiency, and encourages exploring free migration evaluations to plan future cloud data strategies.

Read it Now

Databricks Migration

Article summary by M365 Copilot


Let’s talk!
Let's have cafecito together.

If you’re a Chief Data Officer (CDO), a data leader, or simply someone who believes in the power of preparing data for AI—you’re already a Data Massagist.

Whether you have an idea, a challenge, or just want a fresh perspective, let’s connect. I’m always open to collaborating, learning, and helping others move forward.

You can find me on LinkedIn (feel free to connect and send me a message), or book time with me directly for a virtual coffee (or "cafecito").