Commit graph

531 commits

Author SHA1 Message Date
Callum Styan 934bb2dbc6 wip, rework compression testing after format PR was merged
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-23 19:25:00 -08:00
Nicolás Pazos b15d1c1d81 Pool snappy decompression for minimized request 2023-11-23 16:52:01 -08:00
Nicolás Pazos 6f957dba95 Optimize zstd decompression memory usage 2023-11-23 16:51:44 -08:00
Nicolás Pazos 1abce2acfc Use klauspost's flate 2023-11-23 16:51:32 -08:00
Nicolás Pazos 6afb30a06f Benchmarks refactor and include benchmark with dataset 2023-11-23 16:51:16 -08:00
Nicolás Pazos c62a862aa6 Add FlateDefault option and improve zstd allocs 2023-11-23 16:51:11 -08:00
Nicolás Pazos 7740f35338 Benchmarks rename 2023-11-23 16:50:03 -08:00
Nicolás Pazos a727653618 fix snappy allocations and improve benchmarks 2023-11-23 16:49:52 -08:00
Nicolás Pazos 1ef02aad26 optimize more allocs 2023-11-23 16:49:41 -08:00
Nicolás Pazos 08c3fc6ca9 fix: zstd to correctly reset buffer 2023-11-23 16:49:33 -08:00
Nicolás Pazos 8a4e5769fc Remove gzip option and various alloc optimizations 2023-11-23 16:49:03 -08:00
Nicolás Pazos 32eb50917e No Close method and basic pooling 2023-11-23 16:47:24 -08:00
alexgreenbank 0ab4808153 Add alternative compression algos to experiment 2023-11-23 16:45:10 -08:00
Callum Styan 788dfc8cb4 fix minor lint issue + use labels Range function since it looks like
the tests fail to do `range labels.Labels` on CI

Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-23 11:55:56 -08:00
Callum Styan 63ea815a05 fix test panic
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-23 11:32:45 -08:00
Callum Styan e2acded6ca more cleanup, address review comments
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-23 11:31:10 -08:00
Callum Styan a3c6904243 more cleanup, mostly linting fixes
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-20 17:28:05 -08:00
Callum Styan a0cd7939e2 cleanup; remove some unused functions
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-20 16:51:53 -08:00
Callum Styan c2c45d12cb More cleanup
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-20 16:37:03 -08:00
Callum Styan fb3ed046ac remove more format types we probably won't use
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-20 16:19:42 -08:00
Callum Styan bf773afd57 remove formats we've decided not to use
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-19 19:05:30 -08:00
Callum Styan e444439d59 test additional len and lenbytes formats
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-15 10:04:38 -08:00
Callum Styan 1842c99f2f Add bytes slice (instead of slice of 32bit vars) format for testing
Co-authored-by: Nicolás Pazos <npazosmendez@gmail.com>
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-13 21:53:44 -08:00
Callum Styan 81f2076dde fix label ranging
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-13 16:12:19 -08:00
Callum Styan ed0c3b25c7 refactor new version flag to make it easier to pick a specific format
instead of having multiple flags, plus add new formats for testing

Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-13 15:41:01 -08:00
Nicolás Pazos 4bdb865ae3 minimally-tested exemplar support for rw 1.1
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 17:00:16 -03:00
Nicolás Pazos 34f3f11ee2 remove all code from previous interning approach
the 'minimized' version is now the only v1.1 version

Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 17:00:16 -03:00
Nicolás Pazos f259debb32 fix writeRequestMinimizedFixture
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 16:59:57 -03:00
Nicolás Pazos e2a5ea5397 Use unsafe []byte->string cast to reuse buffer
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 15:08:49 -03:00
Nicolás Pazos c9b6dddef9 manually optimize varint marshaling
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 15:05:16 -03:00
Nicolás Pazos 761efc860e Use two uint32 to encode (offset,leng)
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 15:03:18 -03:00
Nicolás Pazos 7a633a2eb9 fix build for stringlabels tag
Signed-off-by: Nicolás Pazos <npazosmendez@gmail.com>
2023-11-09 11:22:53 -03:00
Callum Styan 2935eab409 update tests
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Callum Styan eb63f30459 fix minor things
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Callum Styan 3e5facc0c0 add functionality for new minimized remote write request format
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Callum Styan 82c1df0aa1 add functions for translating between new proto formats symbol table and
actual prometheus labels

Co-authored-by: Marco Pracucci <marco@pracucci.com>
Signed-off-by: Callum Styan <callumstyan@gmail.com>
2023-11-09 10:35:43 -03:00
Nicolás Pazos 46b84ab3fb lint 2023-11-09 10:18:12 -03:00
Nicolás Pazos cef9891cdd remote write handler to checks version header 2023-11-09 10:18:12 -03:00
Nicolás Pazos e3f27aa2c7 fields rewording in handler 2023-11-09 10:18:12 -03:00
Nicolás Pazos 6f21272ca7 fix NewWriteClient and change new flags wording 2023-11-09 10:18:12 -03:00
alexgreenbank 1cddea1501 gofmt 2023-11-09 10:18:12 -03:00
alexgreenbank 8ab14f2456 Remove config, update proto 2023-11-09 10:18:12 -03:00
alexgreenbank 15c4d45635 Add 1.1 version handling code 2023-11-09 10:18:12 -03:00
Nicolás Pazos 06b486b41e cleanup: remove hardcoded fake url for testing 2023-11-09 10:18:12 -03:00
Nicolás Pazos 44f166d066 Use github.com/golang/snappy 2023-11-09 10:18:12 -03:00
Nicolás Pazos c1593fd35a Improve sender benchmarks and some allocations 2023-11-09 10:18:12 -03:00
Nicolás Pazos b35ab6c080 fix build 2023-11-09 10:18:12 -03:00
Nicolás Pazos 2f815ee3dd refactor queue manager code to remove some duplication 2023-11-09 10:18:12 -03:00
Nicolás Pazos 3be59f0ca6 add sender-side tests and fix failing ones 2023-11-09 10:18:12 -03:00
Nicolás Pazos eebf7ac1fc fix: queue manager to include float histograms in new requests 2023-11-09 10:18:12 -03:00