mudhorn/prometheus
1
0
Fork 0
mirror of https://github.com/prometheus/prometheus.git synced 2024-09-20 07:47:31 -07:00
Code Issues Actions 8 Packages Projects Releases Wiki Activity
10375 commits 211 branches 424 tags 634 MiB
Commit graph

10375 commits

This branch
This branch
All branches
Author SHA1 Message Date
Björn Rabenstein 2915e4960c
Merge pull request #11395 from codesome/histometrics 
Update metrics for histograms
 2022-10-05 18:20:15 +02:00
Björn Rabenstein 83901e7cac
Merge pull request #11402 from codesome/moar-tests 
Add API test for histogram
 2022-10-05 18:12:06 +02:00
Ganesh Vernekar f024d769e7
Add API test for histogram 
Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-10-03 18:53:57 +05:30
Björn Rabenstein dccfb9db4e
histogram: Remove code replication via generics (#11361) 
* histogram: Simplify iterators

We don't really need currLower and currUpper and can calculate it when
needed (as already done for the floatBucketIterator). The calculation
is cheap, while keeping those extra variables around costs RAM
(potentially a lot with many iterators).

* histogram: Convert Bucket/FloatBucket to one generic type

* histogram: Move some bucket iterator code into generic base iterator

* histogram: Remove cumulative iterator for FloatHistogram

We added it in the past for completeness (Histogram has one), but it
has never been used. Plus, even the cumulative iterator for Histogram
is only there for test reasons.

We can always add it back, and then maybe even using generics.

Signed-off-by: beorn7 <beorn@grafana.com>
 2022-10-03 16:45:27 +05:30
Ganesh Vernekar d0a6488c74
Update metrics for histograms 
Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-10-03 13:48:59 +05:30
Björn Rabenstein a01b3d7a14
Merge pull request #11312 from prometheus/beorn7/sparsehistogram 
Compact histograms on ingestion
 2022-09-27 13:38:17 +02:00
beorn7 a7c519930e histograms: Add Compact method to the normal integer Histogram 
And use the new method to call to compact Histograms during
parsing. This happens for both `Histogram` and `FloatHistogram`. In
this way, if targets decide to optimize the exposition size by merging
spans with empty buckets in between, we still get a normalized
results. It will also normalize away any valid but weird
representations like empty spans, spans with offset zero, and empty
buckets at the start or end of a span.

The implementation seemed easy at first as it just turns the
`compactBuckets` helper into a generic function (which now got its own
file). However, the integer Histograms have delta buckets instead of
absolute buckets, which had to be treated specially in the generic
`compactBuckets` function. To make sure it works, I have added plenty
of explicit tests for `Histogram` in addition to the `FloatHistogram`
tests.

I have also updated the doc comment for the `Compact` method.

Based on the insights now expressed in the doc comment, compacting
with a maxEmptyBuckets > 0 is rarely useful. Therefore, this commit
also sets the value to 0 in the two cases we were using 3 so far. We
might still want to reconsider, so I don't want to remove the
maxEmptyBuckets parameter right now.

Signed-off-by: beorn7 <beorn@grafana.com>
 2022-09-27 13:04:16 +02:00
Ganesh Vernekar 758e29258b
Add/Improve unit tests for compaction with histogram Part 2 (#11343) 
Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-09-23 14:01:10 +05:30
Ganesh Vernekar 2474c6fb2c
Error on amending histograms on append (#11308) 
* Error on amending histograms on append

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

* Rename Matches to Equals

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-09-19 13:10:30 +05:30
Björn Rabenstein 7ad36505d5
tsdb: Update comment about a possible space optimization (#11303) 
See also #11195 for the detailed reasoning.

Signed-off-by: beorn7 <beorn@grafana.com>

Signed-off-by: beorn7 <beorn@grafana.com>
 2022-09-15 13:11:57 +05:30
Ganesh Vernekar d354f20c2a
Add a feature flag to control native histogram ingestion (#11253) 
* Add runtime config to control native histogram ingestion

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

* Make the config into a CLI flag

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-09-14 17:38:34 +05:30
Ganesh Vernekar b2d01cbc57
Remove unnecessary code in encoding/decoding histograms (#11252) 
* Remove unnecessary code in encoding/decoding histograms

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

* Fix review comments

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-09-13 19:30:54 +05:30
Björn Rabenstein 4f7f5cdfd7
Merge pull request #11228 from codesome/nh-test5 
Extend createHead in tests to support histograms
 2022-09-07 15:44:06 +02:00
Björn Rabenstein ca42763d71
Merge pull request #11227 from codesome/nh-test4 
Fix count() for histograms and add test case
 2022-09-07 15:37:10 +02:00
Ganesh Vernekar 8f755f8f35
Extend createHead in tests to support histograms 
Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-08-29 20:18:02 +05:30
Ganesh Vernekar 71489d0e3d
Fix count() for histograms and add test case 
Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-08-29 19:57:29 +05:30
Ganesh Vernekar f540c1dbd3
Add support for histograms in WAL checkpointing (#11210) 
* Add support for histograms in WAL checkpointing

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

* Fix review comments

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

* Fix tests

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-08-29 17:38:36 +05:30
Ganesh Vernekar 6383994f3e
Improve WAL/mmap chunks test for histograms (#11208) 
Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-08-29 16:21:32 +05:30
Ganesh Vernekar d209a29a5b
Add unit test for histogram append and various querying scenarios (#11194) 
* Add unit test for histogram append and various querying scenarios

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

* make lint happy

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

* Fix tests

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

* Fix review comments

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-08-29 15:35:03 +05:30
Marc Tudurí f7df3b86ba
histograms: parse float histograms from proto definition (#11149) 
* histograms: parse float histograms from proto definition

Signed-off-by: Marc Tuduri <marctc@protonmail.com>

* Improve comment

Signed-off-by: Marc Tuduri <marctc@protonmail.com>

* Ignore float buckets

Signed-off-by: Marc Tuduri <marctc@protonmail.com>

* Refactor Histogram() function

Signed-off-by: Marc Tuduri <marctc@protonmail.com>

* Fix test_float_histogram

Signed-off-by: Marc Tuduri <marctc@protonmail.com>

* Update model/textparse/protobufparse.go

Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>
Signed-off-by: Marc Tudurí <marctc@protonmail.com>

* Update protobufparse.go

Signed-off-by: Marc Tudurí <marctc@protonmail.com>

* Update scrape.go

Signed-off-by: Marc Tudurí <marctc@protonmail.com>

* Update scrape/scrape.go

Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>
Signed-off-by: Marc Tudurí <marctc@protonmail.com>

Signed-off-by: Marc Tuduri <marctc@protonmail.com>
Signed-off-by: Marc Tudurí <marctc@protonmail.com>
Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>
 2022-08-25 20:37:41 +05:30
Ganesh Vernekar 0f4e5196c4
Implement vertical compaction for native histograms (#11184) 
* Implement vertical compaction for native histograms

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

* Fix typo

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-08-22 19:04:39 +05:30
Ganesh Vernekar 9325caa41c
Remove a TODO that is no longer valid (#11186) 
Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>

Signed-off-by: Ganesh Vernekar <ganeshvern@gmail.com>
 2022-08-18 22:47:12 +05:30
beorn7 c9fd3c235d Merge branch 'main' into sparsehistogram 2022-08-10 17:54:37 +02:00
Levi Harrison fa9bc5184a
Update and fix interface (#11131) 
Signed-off-by: Levi Harrison <git@leviharrison.dev>
 2022-08-10 10:14:52 +02:00
dependabot[bot] d91621890a
build(deps): bump github.com/hetznercloud/hcloud-go (#11096) 
Bumps [github.com/hetznercloud/hcloud-go](https://github.com/hetznercloud/hcloud-go) from 1.35.0 to 1.35.2.
- [Release notes](https://github.com/hetznercloud/hcloud-go/releases)
- [Changelog](https://github.com/hetznercloud/hcloud-go/blob/main/CHANGES.md)
- [Commits](https://github.com/hetznercloud/hcloud-go/compare/v1.35.0...v1.35.2)

---
updated-dependencies:
- dependency-name: github.com/hetznercloud/hcloud-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-06 19:52:14 +02:00
dependabot[bot] c8df08109b
build(deps): bump github.com/go-zookeeper/zk from 1.0.2 to 1.0.3 (#11108) 
Bumps [github.com/go-zookeeper/zk](https://github.com/go-zookeeper/zk) from 1.0.2 to 1.0.3.
- [Release notes](https://github.com/go-zookeeper/zk/releases)
- [Commits](https://github.com/go-zookeeper/zk/compare/v1.0.2...v1.0.3)

---
updated-dependencies:
- dependency-name: github.com/go-zookeeper/zk
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-06 13:38:59 -04:00
dependabot[bot] 583f603387
build(deps): bump google.golang.org/api from 0.90.0 to 0.91.0 (#11129) 
Bumps [google.golang.org/api](https://github.com/googleapis/google-api-go-client) from 0.90.0 to 0.91.0.
- [Release notes](https://github.com/googleapis/google-api-go-client/releases)
- [Changelog](https://github.com/googleapis/google-api-go-client/blob/main/CHANGES.md)
- [Commits](https://github.com/googleapis/google-api-go-client/compare/v0.90.0...v0.91.0)

---
updated-dependencies:
- dependency-name: google.golang.org/api
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-06 19:38:02 +02:00
dependabot[bot] 2773aa2a72
build(deps): bump github.com/go-openapi/strfmt from 0.21.2 to 0.21.3 (#11114) 
Bumps [github.com/go-openapi/strfmt](https://github.com/go-openapi/strfmt) from 0.21.2 to 0.21.3.
- [Release notes](https://github.com/go-openapi/strfmt/releases)
- [Commits](https://github.com/go-openapi/strfmt/compare/v0.21.2...v0.21.3)

---
updated-dependencies:
- dependency-name: github.com/go-openapi/strfmt
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-06 12:21:21 -04:00
dependabot[bot] 998decc55c
build(deps): bump github.com/ionos-cloud/sdk-go/v6 from 6.1.1 to 6.1.2 (#11121) 
Bumps [github.com/ionos-cloud/sdk-go/v6](https://github.com/ionos-cloud/sdk-go) from 6.1.1 to 6.1.2.
- [Release notes](https://github.com/ionos-cloud/sdk-go/releases)
- [Changelog](https://github.com/ionos-cloud/sdk-go/blob/master/docs/CHANGELOG.md)
- [Commits](https://github.com/ionos-cloud/sdk-go/compare/v6.1.1...v6.1.2)

---
updated-dependencies:
- dependency-name: github.com/ionos-cloud/sdk-go/v6
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-06 12:20:55 -04:00
dependabot[bot] eed5b14a13
build(deps): bump github.com/Azure/go-autorest/autorest (#11122) 
Bumps [github.com/Azure/go-autorest/autorest](https://github.com/Azure/go-autorest) from 0.11.27 to 0.11.28.
- [Release notes](https://github.com/Azure/go-autorest/releases)
- [Changelog](https://github.com/Azure/go-autorest/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Azure/go-autorest/compare/autorest/v0.11.27...autorest/v0.11.28)

---
updated-dependencies:
- dependency-name: github.com/Azure/go-autorest/autorest
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-06 12:20:11 -04:00
Chris Sinjakli fba20567c0
Document permissions needed for ec2_sd_configs (#11119) 
Currently, it's not explicitly called out which permissions are needed
for service discovery of EC2 instances. It's not super hard to figure
out, but it did involve a bit of guesswork when I did it yesterday, and
I figure it's worth saving people that effort.

I've also seen examples around the internet where people are granting
much broader permissions than they need to, so maybe we can save on that
by explicitly saying what's needed.

Signed-off-by: Chris Sinjakli <chris@sinjakli.co.uk>
 2022-08-05 15:49:38 +02:00
dependabot[bot] 8bcad096ed
build(deps): bump github.com/digitalocean/godo from 1.81.0 to 1.82.0 (#11117) 
Bumps [github.com/digitalocean/godo](https://github.com/digitalocean/godo) from 1.81.0 to 1.82.0.
- [Release notes](https://github.com/digitalocean/godo/releases)
- [Changelog](https://github.com/digitalocean/godo/blob/main/CHANGELOG.md)
- [Commits](https://github.com/digitalocean/godo/compare/v1.81.0...v1.82.0)

---
updated-dependencies:
- dependency-name: github.com/digitalocean/godo
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-05 14:03:47 +02:00
dependabot[bot] daeb7fe469
build(deps): bump github.com/Azure/go-autorest/autorest/adal (#11110) 
Bumps [github.com/Azure/go-autorest/autorest/adal](https://github.com/Azure/go-autorest) from 0.9.20 to 0.9.21.
- [Release notes](https://github.com/Azure/go-autorest/releases)
- [Changelog](https://github.com/Azure/go-autorest/blob/main/CHANGELOG.md)
- [Commits](https://github.com/Azure/go-autorest/compare/autorest/adal/v0.9.20...autorest/adal/v0.9.21)

---
updated-dependencies:
- dependency-name: github.com/Azure/go-autorest/autorest/adal
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-04 23:54:46 +02:00
dependabot[bot] dd0a11ae7a
build(deps): bump k8s.io/client-go from 0.24.2 to 0.24.3 (#11111) 
Bumps [k8s.io/client-go](https://github.com/kubernetes/client-go) from 0.24.2 to 0.24.3.
- [Release notes](https://github.com/kubernetes/client-go/releases)
- [Changelog](https://github.com/kubernetes/client-go/blob/master/CHANGELOG.md)
- [Commits](https://github.com/kubernetes/client-go/compare/v0.24.2...v0.24.3)

---
updated-dependencies:
- dependency-name: k8s.io/client-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-04 13:44:44 +02:00
Xiaochao Dong 1078081aec
Fix race condition when updating lastSeriesID during loading chunk snapshot (#11099) 
Signed-off-by: Xiaochao Dong (@damnever) <the.xcdong@gmail.com>
 2022-08-04 13:39:14 +05:30
dependabot[bot] 4035b38c59
build(deps): bump golang.org/x/tools from 0.1.11 to 0.1.12 (#11101) 
Bumps [golang.org/x/tools](https://github.com/golang/tools) from 0.1.11 to 0.1.12.
- [Release notes](https://github.com/golang/tools/releases)
- [Commits](https://github.com/golang/tools/compare/v0.1.11...v0.1.12)

---
updated-dependencies:
- dependency-name: golang.org/x/tools
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-03 18:37:01 +05:30
Julien Pivotto 765320d99e
Update opentelemetry (#11105) 
Signed-off-by: Julien Pivotto <roidelapluie@o11y.eu>
 2022-08-03 14:41:44 +02:00
Julius Volz e33720e98e
Add Julius as release shepherd for v2.38 (#11106) 
Signed-off-by: Julius Volz <julius.volz@gmail.com>
 2022-08-03 14:22:44 +02:00
Augustin Husson f486efbb9a
codemirror-promql: add method to fetch flags in prometheus client (#11090) 
Signed-off-by: Augustin Husson <husson.augustin@gmail.com>
 2022-08-03 14:15:32 +02:00
rilehudd d943f39f22 Updates RELEASE.md to include [SECURITY] change log tag 
Signed-off-by: rilehudd <51207004+rilehudd@users.noreply.github.com>
 2022-08-03 12:17:00 +02:00
David Leadbeater d677ec489e
Support using MX records for DNS discovery (#10099) 
It's currently possible to use blackbox_exporter to probe MX records
themselves. However it's not possible to do an end-to-end test, like is
possible with SRV records. This makes it possible to use MX records as a
source of hostnames in the same way as SRV records.

Signed-off-by: David Leadbeater <dgl@dgl.cx>
 2022-08-03 11:19:26 +02:00
Bryan Boreham a7f19b5775 labels: add a test for JSON and YAML marshalling 
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
 2022-08-03 11:18:02 +02:00
Bryan Boreham 10699c37a3 labels: test BytesWithoutLabels does not remove __name__ by default 
Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
 2022-08-03 11:18:02 +02:00
Bryan Boreham d46ef0aa8e labels: tweak BenchmarkLabels_Get() 
So the benchmark works without requiring `Labels` internals to be a slice.

Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
 2022-08-03 11:18:02 +02:00
Bryan Boreham 24ebff9c4a labels: don't test that Hash() works on unordered labels 
Labels are required to be ordered.

Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
 2022-08-03 11:18:02 +02:00
Bryan Boreham fb2d883f1e labels: test Compare without knowing the exact result 
Only the sign of the result is important

Signed-off-by: Bryan Boreham <bjboreham@gmail.com>
 2022-08-03 11:18:02 +02:00
Julien Pivotto a6c6155092
Fix YAML and JSON doc section (#11023) 
Signed-off-by: Julien Pivotto <roidelapluie@o11y.eu>
 2022-08-03 11:09:57 +02:00
dependabot[bot] 7bbc19de75
build(deps): bump k8s.io/apimachinery from 0.24.2 to 0.24.3 (#11097) 
Bumps [k8s.io/apimachinery](https://github.com/kubernetes/apimachinery) from 0.24.2 to 0.24.3.
- [Release notes](https://github.com/kubernetes/apimachinery/releases)
- [Commits](https://github.com/kubernetes/apimachinery/compare/v0.24.2...v0.24.3)

---
updated-dependencies:
- dependency-name: k8s.io/apimachinery
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-03 10:24:06 +02:00
dependabot[bot] a23e950879
build(deps): bump github.com/aws/aws-sdk-go from 1.44.47 to 1.44.67 (#11095) 
Bumps [github.com/aws/aws-sdk-go](https://github.com/aws/aws-sdk-go) from 1.44.47 to 1.44.67.
- [Release notes](https://github.com/aws/aws-sdk-go/releases)
- [Changelog](https://github.com/aws/aws-sdk-go/blob/main/CHANGELOG.md)
- [Commits](https://github.com/aws/aws-sdk-go/compare/v1.44.47...v1.44.67)

---
updated-dependencies:
- dependency-name: github.com/aws/aws-sdk-go
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-02 16:42:00 +02:00
dependabot[bot] 63662fa140
build(deps): bump google.golang.org/grpc from 1.47.0 to 1.48.0 (#11083) 
Bumps [google.golang.org/grpc](https://github.com/grpc/grpc-go) from 1.47.0 to 1.48.0.
- [Release notes](https://github.com/grpc/grpc-go/releases)
- [Commits](https://github.com/grpc/grpc-go/compare/v1.47.0...v1.48.0)

---
updated-dependencies:
- dependency-name: google.golang.org/grpc
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>

Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
 2022-08-02 16:08:39 +02:00