The Prometheus monitoring system and time series database.
Find a file
Oleg Zaytsev b1ed4a0a66
LabelNames API with matchers (#9083)
* Push the matchers for LabelNames all the way into the index.

NB This doesn't actually implement it in the index, just plumbs it through for now...

Signed-off-by: Tom Wilkie <tom@grafana.com>

* Hack it up.  Does not work.

Signed-off-by: Tom Wilkie <tom@grafana.com>

* Revert changes I don't understand

Can't see why do we need to hold a mutex on symbols, and the purpose of
the LabelNamesFor method.

Maybe I'll need to re-add this later.

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Implement LabelNamesFor

This method provides the label names that appear in the postings
provided. We do that deeper than the label values because we know
beforehand that most of the label names we'll be the same across
different postings, and we don't want to go down an up looking up the
same symbols for all different series.

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Mutex on symbols should be unlocked

However, I still don't understand why do we need a mutex here.

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Fix head.LabelNamesFor

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Implement mockIndex LabelNames with matchers

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Nitpick on slice initialisation

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Add tests for LabelNamesWithMatchers

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Fix the mutex mess on head.LabelValues/LabelNames

I still don't see why we need to grab that unrelated mutex, but at least
now we're grabbing it consistently

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Check error after iterating postings

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Use the error from posting when there was en error in postings

Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>
Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Update storage/interface.go comment

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>

* Update tsdb/index/index.go comment

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>

* Update tsdb/index/index.go wrapped error msg

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>

* Update tsdb/index/index.go wrapped error msg

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>

* Update tsdb/index/index.go warpped error msg

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>

* Remove unneeded comment

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Add testcases for LabelNames w/matchers in api.go

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

* Use t.Cleanup() instead of defer in tests

Signed-off-by: Oleg Zaytsev <mail@olegzaytsev.com>

Co-authored-by: Tom Wilkie <tom@grafana.com>
Co-authored-by: Ganesh Vernekar <15064823+codesome@users.noreply.github.com>
2021-07-20 18:08:08 +05:30
.circleci fixes yamllint errors 2021-06-12 12:47:47 +02:00
.github fixes yamllint errors 2021-06-12 12:47:47 +02:00
cmd Exemplar resize (#8974) 2021-07-20 10:22:57 +05:30
config Exemplar resize (#8974) 2021-07-20 10:22:57 +05:30
console_libraries Make React UI the default, keep old UI under /classic (#8142) 2020-11-03 14:51:48 +01:00
consoles Update console template example metric names. (#5678) 2019-06-17 12:13:29 +01:00
discovery hcloud discovery: Add new labelpresent label (#9028) 2021-07-03 01:51:50 +02:00
docs docs: update unit_testing_rules to cover missing and stale samples (#9065) 2021-07-19 15:46:14 +05:30
documentation Fix: Use json.Unmarshal() instead of json.Decoder (#9033) 2021-07-02 09:38:14 +01:00
notifier Fix: Use json.Unmarshal() instead of json.Decoder (#9033) 2021-07-02 09:38:14 +01:00
pkg Return error on NaN and Inf timestamps for OpenMetrics parser 2021-06-28 20:55:04 -04:00
prompb Add Exemplar Remote Write support (#8296) 2021-05-06 13:53:52 -07:00
promql LabelNames API with matchers (#9083) 2021-07-20 18:08:08 +05:30
rules fixes yamllint errors 2021-06-12 12:47:47 +02:00
scrape fix typo in comment for scrape manager (#9094) 2021-07-19 15:55:13 +05:30
scripts Revert "Update sync PRs" (#8998) 2021-06-27 00:29:56 +02:00
storage LabelNames API with matchers (#9083) 2021-07-20 18:08:08 +05:30
template Added external URL access 2021-05-30 23:35:26 -04:00
tsdb LabelNames API with matchers (#9083) 2021-07-20 18:08:08 +05:30
util Exemplar resize (#8974) 2021-07-20 10:22:57 +05:30
web LabelNames API with matchers (#9083) 2021-07-20 18:08:08 +05:30
.dockerignore Add image build for ppc64le architecture 2020-04-06 18:03:58 -03:00
.gitignore add changes per comments, fix tests 2021-03-20 12:38:30 -07:00
.gitpod.yml fixes yamllint errors 2021-06-12 12:47:47 +02:00
.golangci.yml Merge release-2.28 back into main (#9035) 2021-07-01 18:02:13 +02:00
.promu.yml Use CircleCI parallelism 2021-03-21 12:17:20 +01:00
.yamllint avoid glob pattern for key-duplicates 2021-06-12 13:12:47 +02:00
CHANGELOG.md Merge release-2.28 back into main (#9035) 2021-07-01 18:02:13 +02:00
CODE_OF_CONDUCT.md Improve repo sync script 2020-06-17 17:12:36 +02:00
CONTRIBUTING.md Replace freenode with libera.chat 2021-06-13 00:36:28 +02:00
Dockerfile Fix docker image build 2020-12-16 21:21:22 +01:00
go.mod Update Go modules 2021-07-15 15:24:59 +02:00
go.sum Update Go modules 2021-07-15 15:24:59 +02:00
LICENSE Clean up license issues. 2015-01-21 20:07:45 +01:00
MAINTAINERS.md Add @dgl as maintainer of promtool 2021-03-08 20:38:57 +01:00
Makefile increase golang ci lint timeout 2021-06-12 11:43:34 +02:00
Makefile.common Only run if yamllint is installed 2021-06-25 08:03:58 -04:00
NOTICE Add new codemirror-promql-based expression editor (#8634) 2021-03-23 23:55:52 +01:00
README.md Replace godoc.org links 2021-06-17 07:18:51 -04:00
RELEASE.md Fix bold formatting bug in RELEASE.md (#8962) 2021-06-18 15:41:02 +02:00
SECURITY.md Add SECURITY.md file (#8292) 2021-01-09 09:58:53 +01:00
VERSION Merge release-2.28 back into main (#8975) 2021-06-22 00:59:31 +02:00

Prometheus

CircleCI Docker Repository on Quay Docker Pulls Go Report Card CII Best Practices Gitpod ready-to-code Fuzzing Status

Visit prometheus.io for the full documentation, examples and guides.

Prometheus, a Cloud Native Computing Foundation project, is a systems and service monitoring system. It collects metrics from configured targets at given intervals, evaluates rule expressions, displays the results, and can trigger alerts when specified conditions are observed.

The features that distinguish Prometheus from other metrics and monitoring systems are:

  • A multi-dimensional data model (time series defined by metric name and set of key/value dimensions)
  • PromQL, a powerful and flexible query language to leverage this dimensionality
  • No dependency on distributed storage; single server nodes are autonomous
  • An HTTP pull model for time series collection
  • Pushing time series is supported via an intermediary gateway for batch jobs
  • Targets are discovered via service discovery or static configuration
  • Multiple modes of graphing and dashboarding support
  • Support for hierarchical and horizontal federation

Architecture overview

Install

There are various ways of installing Prometheus.

Precompiled binaries

Precompiled binaries for released versions are available in the download section on prometheus.io. Using the latest production release binary is the recommended way of installing Prometheus. See the Installing chapter in the documentation for all the details.

Docker images

Docker images are available on Quay.io or Docker Hub.

You can launch a Prometheus container for trying it out with

$ docker run --name prometheus -d -p 127.0.0.1:9090:9090 prom/prometheus

Prometheus will now be reachable at http://localhost:9090/.

Building from source

To build Prometheus from source code, first ensure that have a working Go environment with version 1.14 or greater installed. You also need Node.js and Yarn installed in order to build the frontend assets.

You can directly use the go tool to download and install the prometheus and promtool binaries into your GOPATH:

$ GO111MODULE=on go get github.com/prometheus/prometheus/cmd/...
$ prometheus --config.file=your_config.yml

However, when using go get to build Prometheus, Prometheus will expect to be able to read its web assets from local filesystem directories under web/ui/static and web/ui/templates. In order for these assets to be found, you will have to run Prometheus from the root of the cloned repository. Note also that these directories do not include the new experimental React UI unless it has been built explicitly using make assets or make build.

An example of the above configuration file can be found here.

You can also clone the repository yourself and build using make build, which will compile in the web assets so that Prometheus can be run from anywhere:

$ mkdir -p $GOPATH/src/github.com/prometheus
$ cd $GOPATH/src/github.com/prometheus
$ git clone https://github.com/prometheus/prometheus.git
$ cd prometheus
$ make build
$ ./prometheus --config.file=your_config.yml

The Makefile provides several targets:

  • build: build the prometheus and promtool binaries (includes building and compiling in web assets)
  • test: run the tests
  • test-short: run the short tests
  • format: format the source code
  • vet: check the source code for common errors
  • assets: build the new experimental React UI

Building the Docker image

The make docker target is designed for use in our CI system. You can build a docker image locally with the following commands:

$ make promu
$ promu crossbuild -p linux/amd64
$ make npm_licenses
$ make common-docker-amd64

NB if you are on a Mac, you will need gnu-tar.

React UI Development

For more information on building, running, and developing on the new React-based UI, see the React app's README.md.

More information

Contributing

Refer to CONTRIBUTING.md

License

Apache License 2.0, see LICENSE.