prometheus/storage/remote
Justin Lei 8ef7dfdeeb
Add a chunk size limit in bytes (#12054)
Add a chunk size limit in bytes

This creates a hard cap for XOR chunks of 1024 bytes.

The limit for histogram chunk is also 1024 bytes, but it is a soft limit as a histogram has a dynamic size, and even a single one could be larger than 1024 bytes.

This also avoids cutting new histogram chunks if the existing chunk has fewer than 10 histograms yet. In that way, we are accepting "jumbo chunks" in order to have at least 10 histograms in a chunk, allowing compression to kick in.

Signed-off-by: Justin Lei <justin.lei@grafana.com>
2023-08-24 15:21:17 +02:00
..
azuread Add Azure AD package for remote write (#11944) 2023-06-01 15:20:10 -06:00
otlptranslator Add OTLP Ingestion endpoint (#12571) 2023-07-28 12:35:28 +02:00
chunked.go (storage): move from github.com/pkg/errors to 'errors' and 'fmt' (#10946) 2022-07-01 18:59:50 +02:00
chunked_test.go Testify: move to require (#8122) 2020-10-29 09:43:23 +00:00
client.go Add Azure AD package for remote write (#11944) 2023-06-01 15:20:10 -06:00
client_test.go remote: Convert to RecoverableError using errors.As (#12103) 2023-03-08 13:58:09 -07:00
codec.go Add OTLP Ingestion endpoint (#12571) 2023-07-28 12:35:28 +02:00
codec_test.go Perform integer/float histogram type checking on conversions, and use a consistent method for determining integer vs float histogram 2023-04-22 02:27:15 +08:00
ewma.go style: Replace else if cascades with switch 2023-04-19 17:22:31 +02:00
intern.go Move away from testutil, refactor imports (#8087) 2020-10-22 11:00:08 +02:00
intern_test.go Testify: move to require (#8122) 2020-10-29 09:43:23 +00:00
max_timestamp.go Remote: Do not collect non-initialized timestamp metrics (#8060) 2020-10-15 23:53:59 +02:00
metadata_watcher.go (storage): move from github.com/pkg/errors to 'errors' and 'fmt' (#10946) 2022-07-01 18:59:50 +02:00
metadata_watcher_test.go (storage): move from github.com/pkg/errors to 'errors' and 'fmt' (#10946) 2022-07-01 18:59:50 +02:00
queue_manager.go remote-write: add http.resend_count tracing attribute 2023-08-11 16:20:12 +00:00
queue_manager_test.go Perform integer/float histogram type checking on conversions, and use a consistent method for determining integer vs float histogram 2023-04-22 02:27:15 +08:00
read.go labels: simplify call to get Labels from Builder 2023-03-22 17:05:20 +00:00
read_handler.go Replace sort.Slice with faster slices.SortFunc 2023-07-02 22:17:08 +00:00
read_handler_test.go Add a chunk size limit in bytes (#12054) 2023-08-24 15:21:17 +02:00
read_test.go Handle native histograms in remote read 2023-03-09 09:13:53 -08:00
storage.go [tsdb] re-implement WAL watcher to read via a "notification" channel (#11949) 2023-05-15 12:31:49 -07:00
storage_test.go Update package storage/remote tests for new labels.Labels type 2022-12-19 15:22:09 +00:00
write.go Add Azure AD package for remote write (#11944) 2023-06-01 15:20:10 -06:00
write_handler.go Add OTLP Ingestion endpoint (#12571) 2023-07-28 12:35:28 +02:00
write_handler_test.go Merge pull request #11688 from damnever/fix/datamodelvalidation-remotewriteapi 2023-07-04 13:52:02 +02:00
write_test.go Add OTLP Ingestion endpoint (#12571) 2023-07-28 12:35:28 +02:00