Remote Read Meets Streaming
Prometheus Blog

Remote Read Meets Streaming


Summary

Prometheus 2.13.0 introduces a streamed version of the Remote Read API, addressing significant memory usage issues with the previous implementation. The new API utilizes a chunked, iterative approach—similar to how Prometheus processes queries internally—allowing clients to receive data series by series without buffering the entire response in memory. This improvement enables more efficient querying of Prometheus data, especially for large datasets and use cases like seamless upgrades and integration with long-term storage systems like Thanos.
Read the Original Article

This article originally appeared on Prometheus Blog.

Read Full Article on Original Site

Popular from Prometheus Blog

1
When (not) to use varbit chunks
When (not) to use varbit chunks

Björn “Beorn” Rabenstein May 8, 2016 63 views

2
Announcing Prometheus 3.0
Announcing Prometheus 3.0

The Prometheus Team Nov 14, 2024 29 views

3
Interview with Hostinger
Interview with Hostinger

Brian Brazil Feb 6, 2019 29 views

4
Custom service discovery with etcd
Custom service discovery with etcd

Fabian Reinartz Aug 17, 2015 29 views