Data Engineering June 2025 News

Summary

News

Akash Manjunath will join onAir Tech corporation on July 10th 2025
onAir Tech, Jeremy PesnerJune 12, 2025

FAIRFAX, VA | We’re pleased to announce that Akash Manjunath will become Director of  Tech Hub Engagement starting from July 10, 2025.

His first project will be focused on the Data Engineering Hub | The URL is data.onair.cc

 

AI Mode in Google Search: Redefining User Interaction and SEO
The AI Journal , Sarah EvansJune 4, 2025

What’s Next? Predictions for the Future of Search and SEO

  • Visibility Shifts from Keywords to Topical Coverage
  • Personalization Becomes Standard
  • Paid Placements and Monetization in AI Mode
  • The Agency Divide: Traditional vs. Modern Approaches
  • New Analytics and Search Console Features
  • Final Thought: Search Is Now a Conversation

As AI Mode evolves from an experiment to a default experience, search will feel less like a transaction and more like an ongoing conversation. Success will go to brands that can be present, relevant, and trusted at every step—no matter how the questions change.

Future-Forward Data Engineering in the age of Agentic AI
Medium, Adnan Masood, PhD. Adnan MasoodJune 9, 2025

The Efficacy of Standardized Interfaces in Reducing Manual Intervention, Improving System Resilience, and Enabling Advanced Governance in Enterprise Data Platforms.

Future Outlook
Agentic AI, MCP, and A2A are poised to reshape enterprise data platforms in the next 3–5 years. We will likely see middleware for agents become mainstream: platform vendors already integrate these protocols. Systems will evolve from static ETL pipelines into adaptive, self-optimizing networks. For instance, future data lakes might auto-tune storage tiers based on usage patterns discovered by agents, or data warehouses could self-partition hot tables. As Microsoft’s announcements highlight, AI is moving toward an “active digital workforce” [33]: think LLMs that don’t just suggest queries, but execute workflows end-to-end. With A2A, agents from different vendors and clouds will interoperate, breaking current silos. Enterprises will embed AI into governance: agentic systems continuously audit for compliance.

We may also see advances in model capabilities driving agentic efficiency — e.g., hybrid systems where a symbolic planner guides LLMs, or LLMs with built-in code execution (like Azure’s CUA) making some MCP calls redundant. Standards (MCP, A2A) will likely expand; Google’s A2A is already collaboration with 50+ partners [40], promising broader interoperability. In short, the data platform of the future could sense, reason, and act: as data patterns shift, agents reconfigure pipelines; when costs spike, agents throttle resources; when new regulations arrive, agents update data handling policies. This vision of an adaptive, self-driving data platform is on the horizon thanks to agentic AI and these new protocols.

Amperity, the AI-powered customer data cloud, today launched Chuck Data, the first AI Agent built specifically for customer data engineering. Chuck uses Amperity’s years of experience and patented identity resolution models, trained on billions of data sets across 400+ enterprise brands, as critical knowledge behind the AI. Chuck runs in the terminal and empowers engineers to quickly understand their data, tag it, and resolve customer identities in minutes – all from within their Databricks lakehouse.

This press release features multimedia. View the full release here: https://www.businesswire.com/news/home/20250609092916/en/

As pressure mounts to deliver business-ready insights quickly, data engineers are hitting a wall: while infrastructure has modernized, the work of preparing customer data still relies on manual code and brittle rules-based systems. Chuck changes that by enabling data engineers to “vibe code” – using natural language prompts to delegate complex engineering tasks to an AI assistant.

Data Engineering Transformation with AI Agents
AIM Research, Manjunatha G May 28, 2025 (12:00)

This session explores how AI agents are transforming data engineering by automating complex workflows such as data ingestion, transformation, and pipeline orchestration. With real-time analytics and intelligent decision-making becoming critical, AI-driven automation is enabling greater efficiency, scalability, and accuracy in data processes.

From automated anomaly detection to schema evolution and performance optimization, discover practical use cases that showcase the power of AI in simplifying and future-proofing data engineering strategies. Ideal for data engineers, architects, and AI enthusiasts, this talk offers insights into leveraging AI agents to reduce operational overhead and stay ahead in the era of intelligent automation.

i
Data Engineering Digest
Data Science Council of America and Aggregage, Data Science Council of America and Aggregage.

Data Engineering Digest brings together the best content for Data Engineering Professionals from the widest variety of industry thought leaders. It is a combined effort of the Data Science Council of America and Aggregage. The goals of the site and newsletter are to:

Collect High Quality Content – The goal of a content community is to provide a high quality destination that highlights the most recent and best content from top quality sources as defined by the community.

Provide an Easy to Navigate Site and Newsletter – Our subscribers are often professionals who are not regular readers of the blogs and other sources. They come to the content community to find information on particular topics of interest to them. This links them across to the sources themselves.

Be a Jump Off Point – To be clear all our sites/newsletters are only jump off points to the sources of the content.

Help Surface Content that Might Not be Found – It’s often hard to find and understand blog content that’s spread across sites. Most of our audience are not regular subscribers to these blogs and other content sources.

Discuss

OnAir membership is required. The lead Moderator for the discussions is Scott Joy. We encourage civil, honest, and safe discourse. For more information on commenting and giving feedback, see our Comment Guidelines.

This is an open discussion on the contents of this post.

Home Forums Open Discussion

Viewing 1 post (of 1 total)
  • Author
    Posts
  • #6335
    Scott Joy
    Participant
Viewing 1 post (of 1 total)
  • You must be logged in to reply to this topic.
Skip to toolbar