Skip to main content

Dagster & Prometheus

This integration allows you to push metrics to the Prometheus gateway from within a Dagster pipeline.

Installation​

pip install dagster-prometheus

Example​

from dagster_prometheus import PrometheusResource

import dagster as dg


@dg.asset
def prometheus_metric(prometheus: PrometheusResource):
    prometheus.push_to_gateway(job="my_job_label")


defs = dg.Definitions(
    assets=[prometheus_metric],
    resources={
        "prometheus": PrometheusResource(gateway="http://pushgateway.example.org:9091")
    },
)

About Prometheus​

Prometheus is an open source systems monitoring and alerting toolkit. Originally built at SoundCloud, Prometheus joined the Cloud Native Computing Foundation in 2016 as the second hosted project, after Kubernetes.

Prometheus collects and stores metrics as time series data along with the timestamp at which it was recorded, alongside optional key-value pairs called labels.