prometheus/storage/remote
Justin Lei 8ef7dfdeeb
Add a chunk size limit in bytes (#12054)
Add a chunk size limit in bytes

This creates a hard cap for XOR chunks of 1024 bytes.

The limit for histogram chunk is also 1024 bytes, but it is a soft limit as a histogram has a dynamic size, and even a single one could be larger than 1024 bytes.

This also avoids cutting new histogram chunks if the existing chunk has fewer than 10 histograms yet. In that way, we are accepting "jumbo chunks" in order to have at least 10 histograms in a chunk, allowing compression to kick in.

Signed-off-by: Justin Lei <justin.lei@grafana.com>
2023-08-24 15:21:17 +02:00
..
azuread Add Azure AD package for remote write (#11944) 2023-06-01 15:20:10 -06:00
otlptranslator Add OTLP Ingestion endpoint (#12571) 2023-07-28 12:35:28 +02:00
chunked.go
chunked_test.go
client.go Add Azure AD package for remote write (#11944) 2023-06-01 15:20:10 -06:00
client_test.go
codec.go Add OTLP Ingestion endpoint (#12571) 2023-07-28 12:35:28 +02:00
codec_test.go Perform integer/float histogram type checking on conversions, and use a consistent method for determining integer vs float histogram 2023-04-22 02:27:15 +08:00
ewma.go style: Replace else if cascades with switch 2023-04-19 17:22:31 +02:00
intern.go
intern_test.go
max_timestamp.go
metadata_watcher.go
metadata_watcher_test.go
queue_manager.go remote-write: add http.resend_count tracing attribute 2023-08-11 16:20:12 +00:00
queue_manager_test.go Perform integer/float histogram type checking on conversions, and use a consistent method for determining integer vs float histogram 2023-04-22 02:27:15 +08:00
read.go
read_handler.go Replace sort.Slice with faster slices.SortFunc 2023-07-02 22:17:08 +00:00
read_handler_test.go Add a chunk size limit in bytes (#12054) 2023-08-24 15:21:17 +02:00
read_test.go
storage.go [tsdb] re-implement WAL watcher to read via a "notification" channel (#11949) 2023-05-15 12:31:49 -07:00
storage_test.go
write.go Add Azure AD package for remote write (#11944) 2023-06-01 15:20:10 -06:00
write_handler.go Add OTLP Ingestion endpoint (#12571) 2023-07-28 12:35:28 +02:00
write_handler_test.go Merge pull request #11688 from damnever/fix/datamodelvalidation-remotewriteapi 2023-07-04 13:52:02 +02:00
write_test.go Add OTLP Ingestion endpoint (#12571) 2023-07-28 12:35:28 +02:00