GCP

BigQuery

2 items

Google Cloud Run

Community / Partner supported

The community-supported dagster-contrib-gcp package provides integrations with Google Cloud Platform (GCP) services. It currently includes the following integrations:

Dataproc

Using this integration, you can manage and interact with Google Cloud Platform's Dataproc service directly from Dagster. This integration allows you to create, manage, and delete Dataproc clusters, and submit and monitor jobs on these clusters.

GCS

This integration allows you to interact with Google Cloud Storage (GCS) using Dagster. It provides resources, I/O Managers, and utilities to manage and store data in GCS, making it easier to integrate GCS into your data pipelines.