Introduction In the first article of this three-part series, we explored recursion—what it is, why it’s crucial for processing hierarchical data, and how it can be implemented in SQL. In the second article, we learned advanced recursion techniques to...
( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, Unstructured Data ) https://bsky.app/profile/paasdev.bsky.social NiFi + AI + AI Data Cloud + Iceberg. https://www.reddit.com/r/DataEngineeringForAI/hot/ https://githu...
Data is the new oil. You’ve probably heard this a million times. But just like crude oil, raw data is messy, unorganised, and pretty much useless on its own. You can't just pour raw data into your business engine and expect it to run. It needs to be ...
This May, Snowflake released the pipe operator which looks like this: ->> Its promise? To revolutionize the CTE/subquery approach to SQL writing. For those of you who are new to writing SQL, there are two competing paradigms in creating production l...
Snowflake offers a unique approach to data storage that provides exceptional query performance, near-instant recovery options, and a flexible cost model. However, to get the most out of Snowflake—and to avoid common pitfalls—it’s important to underst...
If you're building real-time data pipelines or stepping into the world of cloud data engineering, you’ve probably heard about Snowflake—and maybe even come across the term Snowpipe. But what exactly is Snowpipe, and why is it a big deal in today’s fa...
Snowflake is a cloud-based data platform that offers fast, flexible, and secure data storage and processing. It simplifies data warehousing and supports large-scale analytics, all while being fully scalable. Power BI, on the other hand, is Microsoft’...
Loading data efficiently into Snowflake is one of the most important aspects of building a scalable, cost-effective data platform. As Snowflake has matured, it now supports a variety of data loading options — each suited to different types of data, l...
https://bsky.app/profile/paasdev.bsky.social NiFi + AI + AI Data Cloud + Iceberg. my cat + Google AI Whisk https://www.reddit.com/r/DataEngineeringForAI/hot/ https://github.com/sfc-gh-tspann/DataAIDemos/blob/main/airquality.sql https://www.slidesha...
Introduction I’ve just delivered a three-day on-site Snowflake training course during which one candidate dialled in and everyone else attended in person and it got me thinking – does online (remote) training really work? In this article I’ll discuss...
