Feed
Discussions

ETL

ETL

#etl

94 followers·183 articles

ETL

#etl·94 followers·183 articles

ETL

Changelog

New steps component and improved accessibility on Hashnode's blog and docs product.

Nov 05, 2024·

new

Trending Articles

Stonfi SDK: Powering Cross-Chain DeFi with Seamless Integration.

Patience Uyire·70 reads

WiFi Map: Empowering Global Connectivity Through Community and Blockchain Innovation

Goodluck Benjamin·37 reads

Security & Anti-Phishing: How Dmail Protects Your Identity with Web3 Technology

Daniel Johnny·31 reads

Top commenters this week

Writing Challenges

#2Articles1Week Challenge

Become better at technical writing; accept Hashnode's writing challenge for four weeks.

#2Articles1Week Challenge

#WomenWhoTech

Share your story, achievements, or experiences as a woman, non-binary folk in tech or as a #WomenWhoTech ally!

#WomenWhoTech

Self Starter

Publish your first article on Hashnode and become a self starter!

Self Starter

Serial Blogger

Publish an article every day for 7 days and earn a cool serial blogger badge!

Serial Blogger

Talk of the town

Write a story that drives amazing engagement on Hashnode and become the talk of the town!

Talk of the town

Word Warrior

Write an in-depth article on your Hashnode blog that's more than 2000 words and become a word warrior!

Word Warrior

waynekunde

quitzon sandy

GreenFlux

Shreyash Shukla

Shreyash Shukla

ANKIT KUMAR

cocoindex.hashnode.dev·Apr 08, 2025

Apr 08, 2025

Long-running pipelines with continous updates for your ETL

Today, we are excited to announce the support of continuous updates for long-running pipelines in CocoIndex. This powerful feature automatically applies incremental source changes to keep your index up-to-date with minimal latency. With continuous up...

Long-running pipelines with continous updates for your ETL

Discuss·1 read

cocoindex.hashnode.dev·Apr 07, 2025

Apr 07, 2025

Incremental processing to keep low latency sync for your ETL

Incremental processing is one of the core values provided by CocoIndex. In CocoIndex, users declare the transformation, and don't need to worry about the work to keep index and source in sync. CocoIndex creates & maintains an index, and keeps the der...

Incremental processing to keep low latency sync for your ETL

Discuss·1 read

Mario Herrera

marioherrera.hashnode.dev·Mar 21, 2025

Mar 21, 2025

Apache Airflow: 7 Efficient DAG Design Structures

(Due to technical issues, the search service is temporarily unavailable.) Apache Airflow: 7 Efficient DAG Design Structures Designing efficient DAGs (Directed Acyclic Graphs) in Apache Airflow is crucial for building scalable, maintainable, and robus...

Apache Airflow: 7 Efficient DAG Design Structures

Discuss·7 reads

Aditya Khadanga

Aditya Khadanga

adityakhadanga.hashnode.dev·Mar 21, 2025

Mar 21, 2025

Day - 5 | Making Data Useful and Accessible

Imagine a world where you can instantly understand what's happening with your data. That's the power of streaming analytics! In this blog post, we'll explore how Google Cloud's Pub/Sub, Dataflow, and Looker work together to make real-time data analys...

Day - 5 | Making Data Useful and Accessible

Google Cloud Digital Leader Learning Path

Omar Morales

mean2epsilon.blog·Mar 18, 2025

Mar 18, 2025

AI's Impact: Traditional Agile Models

AI is rapidly changing how projects are managed, even “completely disrupt[ing]” traditional Agile and Waterfall approaches ( Issue #8 - How AI is Disrupting Waterfall and Agile Project Management Models – Ricardo Viana Vargas ). Nowhere is this more ...

AI's Impact: Traditional Agile Models

Discuss·8 reads

GitHubOpenSource

GitHubOpenSource

github-open-source.hashnode.dev·Mar 18, 2025

Mar 18, 2025

Unstract: Your No-Code Gateway to Unstructured Data Nirvana

📝 Quick Summary: Unstract is a no-code LLM platform designed to structure unstructured documents. It provides tools to launch APIs and ETL pipelines, enabling users to automate complex business processes involving documents. The platform features a ...

Sukhpreet Singh

Sukhpreet Singh

sukhpreetsingh.hashnode.dev·Mar 05, 2025

Mar 05, 2025

ETL Testing - BRD Mapping

Understanding Business Requirements in ETL Testing When working with ETL (Extract, Transform, Load) testing in a data warehouse project, the first and most important step is understanding the business requirements. Without clear requirements, ETL tes...

Discuss·44 reads

esProc

esproc-desktop.hashnode.dev·Feb 27, 2025

Feb 27, 2025

Flexible Interval Aggregation — From SQL to SPL #5

Problem description & analysis: The range of the ID field in a table of Oracle database is integers 1–2000. Task: Now we need to group IDs into multiple consecutive intervals, sum up the values within each group, and arrange the calculation results ...

Flexible Interval Aggregation — From SQL to SPL #5

Discuss·10 likes·4 reads

Mikuz

mikuz.hashnode.dev·Feb 23, 2025

Feb 23, 2025

ETL vs ELT: Choosing the Right Data Integration Strategy for Modern Analytics

In the world of data integration, two primary approaches have emerged: ETL vs ELT. Both methods aim to make data usable for analytics and reporting, but they differ significantly in their execution. ETL (Extract, Transform, Load) represents the tradi...

Discuss·3 reads

Renjitha K

renjithak.hashnode.dev·Feb 23, 2025

Feb 23, 2025

Transform Your Data Strategy: Mastering Pipelines with Delta Lake

Imagine your company is collecting huge amounts of data—customer transactions, logs, real-time event streams, and even those unnecessary cat videos stored in some forgotten corner of the cloud. You've been asked to organize and make sense of this cha...

Discuss·45 reads

dataengineering