AI Workflows: Future of ETL Pipelines
What if, instead of writing pipelines, engineers just described the outcome. Here is my take on how AI Workflows will change the way data engineers build pipeline.
Welcome to Siva's Blog
What if, instead of writing pipelines, engineers just described the outcome. Here is my take on how AI Workflows will change the way data engineers build pipeline.
Explore the landscape of technical documentation tools and strategies for maintaining effective, accessible, and up-to-date documentation without the clutter.
Explore the shift from traditional Centers of Excellence (CoEs) to a Federated CoE model to overcome bottlenecks and enhance organizational agility.
Dive into the strategic minds behind the Money Heist crew with our analysis of 9 key business lessons that can revolutionize your approach to challenges and leadership.
The Databricks Data & AI Summit 2024 marked a pivotal moment in the industry, showcasing new governance tools for secure data environments and a commitment to open-source innovation.
Explore the seamless integration of Databricks notebooks with CI/CD pipelines using GitHub Actions and Azure DevOps, complete with expert insights.
Dive into the art of creating chaos within your company's data platform stack with our tongue-in-cheek guide, brimming with sarcasm and humor.
Embark on the journey to becoming a Cloud Data Engineer with our comprehensive guide, featuring expert insights, a healthy dose of sarcasm, and a pinch of merciless humor.
Discover how we solved five critical platform engineering challenges that derail teams—from Terraform configuration complexity and validation failures to environment drift and cross-system orchestration. Learn practical solutions using YAML, Pydantic validation, Jinja templates, and three-layer architecture that reduced deployment failures and improved maintainability at scale.