• Feed
  • Discussions
cloud composer

cloud composer

#cloud-composer
0 followers·2 articles

cloud composer

#cloud-composer·0 followers·2 articles
cloud composer
Derrick Qin
Derrick Qin
derrickqin.com·Jul 22, 2023
Jul 22, 2023

Cloud Composer Airflow and BigQuery External Table with Google Sheets

BigQuery has a useful feature which allows the user to create external table with data on Google Sheets. It is very convenient because BigQuery users can query the data from Google Sheets directly. However, as a data engineer, you may need to build p...

Cloud Composer Airflow and BigQuery External Table with Google Sheets
Discuss·286 reads
cloud composer
Derrick Qin
Derrick Qin
derrickqin.com·Jun 24, 2023
Jun 24, 2023

Run dbt with Cloud Composer and Cloud Run

Recently, a client wanted to use dbt core in Cloud Composer Airflow but they encountered Python dependencies issues. To solve this issue, I built a solution to run dbt inside of Cloud Run with Cloud Composer as orchestrator. The workflow looks like: ...

Run dbt with Cloud Composer and Cloud Run
Discuss·164 reads
dbt

Changelog

New steps component and improved accessibility on Hashnode's blog and docs product.

New steps component and improved accessibility on Hashnode's blog and docs product.

Nov 05, 2024·
new

Trending Articles

Life2App: Redefining Engagement in the New Economy.

Patience Uyire·63 reads

Reimagining Mobile Wallets: The Future of Finance in a Decentralized Web3 World.

Patience Uyire·65 reads

🌐 AEON: Empowering the Next Generation of Change-Makers with Web3

Naomi Antia Benson·28 reads

Top commenters this week

Writing Challenges

#2Articles1Week Challenge

Become better at technical writing; accept Hashnode's writing challenge for four weeks.

#2Articles1Week Challenge
#WomenWhoTech

Share your story, achievements, or experiences as a woman, non-binary folk in tech or as a #WomenWhoTech ally!

#WomenWhoTech
Self Starter

Publish your first article on Hashnode and become a self starter!

Self Starter
Serial Blogger

Publish an article every day for 7 days and earn a cool serial blogger badge!

Serial Blogger
Talk of the town

Write a story that drives amazing engagement on Hashnode and become the talk of the town!

Talk of the town
Word Warrior

Write an in-depth article on your Hashnode blog that's more than 2000 words and become a word warrior!

Word Warrior
Melisa Parker
Melisa Parker
Le Li
Le Li
Clarence
Clarence
Mayank Arora
Mayank Arora
Libby Reyes
Libby Reyes