All Data and AI Weekly #201-04-Aug, 2025

All Data and AI Weekly

( AI, Data, NiFi, Iceberg, Polaris, Streamlit, Flink, Kafka, Python, Java, SQL, Unstructured Data )

#201-04-Aug, 2025

https://bsky.app/profile/paasdev.bsky.social

NiFi + AI + AI Data Cloud + Iceberg.

https://www.reddit.com/r/DataEngineeringForAI/hot/

Monthly NYC and Youtube Events

https://lu.ma/PINSAI

Code and Open Source Projects

AWS New York Summit https://github.com/tspannhw/conferences/tree/main/2025/awsny

Hex + Snowflake Hackathon https://github.com/tspannhw/hackathons/tree/main/2025-07-15

Apache NiFi + AI Agents + Cortex AI + Snowflake AISQL

https://github.com/tspannhw/TrafficAI/tree/main/Agents

https://github.com/tspannhw/transit-ridership

https://github.com/tspannhw/conferences

https://github.com/tspannhw/hackathons/tree/main/2025-07-15

Recent Cool Stuff

Convert your old SQL Server to Snowflake https://www.snowflake.com/en/migrate-to-the-cloud/snowconvert-ai/

Snowflake LLM and RealWorld https://medium.com/@snowflake_ai_research/bridging-the-gap-between-llms-and-real-world-challenges-snowflake-at-acl-2025-73d7e4b79466

Cipher https://github.com/campfirein/cipher

S3 Tables and snowflake with mcp servers https://blog.dataengineerthings.org/dare-3-connecting-s3-tables-and-snowflake-through-mcp-servers-in-cursor-1f102fa3c01f

Local Apache Icerberg + Apache Polaris + Trino + Minio https://medium.com/@gilles.philippart/build-a-data-lakehouse-with-apache-iceberg-polaris-trino-minio-349c534ecd98 https://medium.com/@gilles.philippart/build-a-streaming-data-lakehouse-with-apache-flink-kafka-iceberg-and-polaris-473c47e04525

Build an Agentic App Fast in Snowflake https://quickstarts.snowflake.com/guide/build-agentic-application-in-snowflake/index.html?index=..%2F..index#6

AI Kimi-K2 https://github.com/MoonshotAI/Kimi-K2

GemAO OWASP https://genai.owasp.org/introduction-genai-security-project/

AI Security Cheat Sheet https://genai.owasp.org/resource/ai-security-solution-cheat-sheet-q1-2025/

CursorAI 101 https://www.youtube.com/watch?v=o7g_LNV4kW4&t=1s

• Apache Iceberg with Streaming

• An event focused on the integration of Apache Iceberg with streaming technologies.

• Learn more about the topic and relevant documentation here:

• Snowflake Docs: Snowpipe Streaming with Iceberg

• Snowflake Docs: Iceberg Data Types

• Apache Iceberg Spec: Primitive Types

Articles

• AI-Ready Data Products with Snowflake Internal Marketplace

• Read the official Snowflake blog post on creating AI-ready data products using their internal marketplace.

• Read the article here

• User-Based Security for Tasks

• An introduction to user-based security features for tasks within Snowflake.

• Learn about task security here

Demos

• Building a Modern Data Warehouse

• Watch a demo on building a modern data warehouse architecture.

• Watch on YouTube

• Data Pipelining Best Practices

• A video covering best practices for building robust data pipelines.

• Watch on YouTube

Tools

• Visivo.io

• A new tool for data visualization and analysis.

• Check out the tool

MCP (Most Common Pitfalls / Multi-Cloud Platform)

• Snowflake Labs MCP Guide

• The official GitHub repository from Snowflake Labs for MCP.

• View the GitHub repo

• MCP Snowflake Server

• A specific server implementation for MCP, designed for Snowflake.

• View the GitHub repo

• Cortex Agents for MCP

• A guide on using Cortex agents with the MCP framework.

• View the GitHub repo

Upcoming Events, Conferences, Meetups, Webinars and More

Sept 12 - Community over Code - Minneapolis -

https://communityovercode.org/schedule/

Build Nov 4-6 https://www.snowflake.com/en/build/

November 6, 2025 - NODES Conference - Virtual I will be speaking about Snowflake and Neo4J at their conference.

https://sessionize.com/tspann

https://github.com/timothyspann

© 2020-2025 Tim Spann https://www.youtube.com/@FLaNK-Stack