The Prometheus monitoring system and time series database.
Find a file
Brian Brazil cebe36c7d5 Make head Postings only return series in time range
Series() will fetch all the metadata for a series,
even if it's going to be filtered later due to time ranges.

For 1M series we save ~1.1s if you only needed some of the data, but take an
extra ~.2s if you did want everything.

benchmark                                  old ns/op      new ns/op      delta
BenchmarkHeadSeries/1of1000000-4           1443715987     131553480      -90.89%
BenchmarkHeadSeries/10of1000000-4          1433394040     130730596      -90.88%
BenchmarkHeadSeries/100of1000000-4         1437444672     131360813      -90.86%
BenchmarkHeadSeries/1000of1000000-4        1438958659     132573137      -90.79%
BenchmarkHeadSeries/10000of1000000-4       1438061766     145742377      -89.87%
BenchmarkHeadSeries/100000of1000000-4      1455060948     281659416      -80.64%
BenchmarkHeadSeries/1000000of1000000-4     1633524504     1803550153     +10.41%

benchmark                                  old allocs     new allocs     delta
BenchmarkHeadSeries/1of1000000-4           4000055        28             -100.00%
BenchmarkHeadSeries/10of1000000-4          4000073        87             -100.00%
BenchmarkHeadSeries/100of1000000-4         4000253        630            -99.98%
BenchmarkHeadSeries/1000of1000000-4        4002053        6036           -99.85%
BenchmarkHeadSeries/10000of1000000-4       4020053        60054          -98.51%
BenchmarkHeadSeries/100000of1000000-4      4200053        600074         -85.71%
BenchmarkHeadSeries/1000000of1000000-4     6000053        6000094        +0.00%

benchmark                                  old bytes     new bytes     delta
BenchmarkHeadSeries/1of1000000-4           229192184     2488          -100.00%
BenchmarkHeadSeries/10of1000000-4          229193336     5568          -100.00%
BenchmarkHeadSeries/100of1000000-4         229204856     35536         -99.98%
BenchmarkHeadSeries/1000of1000000-4        229320056     345104        -99.85%
BenchmarkHeadSeries/10000of1000000-4       230472056     3894673       -98.31%
BenchmarkHeadSeries/100000of1000000-4      241992056     40511632      -83.26%
BenchmarkHeadSeries/1000000of1000000-4     357192056     402380440     +12.65%

Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
2020-02-20 22:18:42 +01:00
.circleci Add windows tests for query logger (#6653) 2020-01-20 13:17:11 +00:00
.github Renamed prombench git repo with test-infra (#6847) 2020-02-19 13:39:08 +02:00
cmd Moved tsdbconfig to main. 2020-02-18 11:25:36 +00:00
config discovery/kubernetes: expose label_selector and field_selector 2020-02-15 14:57:56 +01:00
console_libraries Added humanizePercentage formatting to templates (#5670) 2019-06-15 08:59:57 +01:00
consoles Update console template example metric names. (#5678) 2019-06-17 12:13:29 +01:00
discovery discovery/kubernetes: expose label_selector and field_selector 2020-02-15 14:57:56 +01:00
docs discovery/kubernetes: expose label_selector and field_selector 2020-02-15 14:57:56 +01:00
documentation Fix queue in alerts annotation 2020-02-12 12:48:13 +01:00
notifier Spelling (#6517) 2020-01-02 15:54:09 +01:00
pkg Add unit test for func WithoutEmpty in labels.go (#6848) 2020-02-19 11:56:12 +00:00
prompb Don't sort postings if we only have one block. 2020-01-28 09:14:56 +00:00
promql Minor fixes. 2020-02-17 18:03:57 +00:00
rules Unify Iterator interfaces. All point to storage now. 2020-02-17 18:03:54 +00:00
scrape scrape_test: fix send-to-closed-channel bugs (#6849) 2020-02-20 13:40:25 +00:00
scripts React UI: Serve React UI under /new (#6229) 2019-10-28 10:45:53 +01:00
storage Addressed Brian's comments, moved metrics to main.go 2020-02-17 18:03:57 +00:00
template template: remove redundant parentheses. (#5904) 2019-08-16 09:41:01 +01:00
tsdb Make head Postings only return series in time range 2020-02-20 22:18:42 +01:00
util Addressed comments. 2020-02-17 18:03:57 +00:00
vendor web: use chained WithInstrumentation (#6661) 2020-01-19 00:07:10 +00:00
web [format]Js: format checktimedrift() success (#6850) 2020-02-20 11:36:22 +01:00
.dockerignore Revert "Add armv6 docker image (#6605)" 2020-02-05 14:13:14 +01:00
.gitignore Add tsdb/tsdb to .gitignore 2019-11-15 12:41:37 +01:00
.golangci.yml *: enable all default linters (#5504) 2019-05-03 15:11:28 +02:00
.promu.yml Remove Travis as a CI platform (#6369) 2019-11-25 14:59:26 +01:00
CHANGELOG.md Release 2.16.0 (#6817) 2020-02-13 15:33:53 -08:00
code-of-conduct.md Add CNCF code of conduct as the Prometheus code of conduct 2016-10-19 21:39:19 +02:00
CONTRIBUTING.md *: bump Go version to 1.13 (#6020) 2019-09-13 13:55:18 +01:00
Dockerfile Integrate beginning of React UI (#5694) 2019-10-17 14:38:09 +02:00
fuzzit.sh Fix fuzzit job (#6005) 2019-09-11 09:08:20 +02:00
go.mod web: use chained WithInstrumentation (#6661) 2020-01-19 00:07:10 +00:00
go.sum web: use chained WithInstrumentation (#6661) 2020-01-19 00:07:10 +00:00
LICENSE Clean up license issues. 2015-01-21 20:07:45 +01:00
MAINTAINERS.md Update and re-work maintainers file. 2019-11-28 19:01:35 +00:00
Makefile Revert "Add armv6 docker image (#6605)" 2020-02-05 14:13:14 +01:00
Makefile.common Bump golangci-lint to v1.18.0 (#6004) 2019-09-10 17:40:08 +02:00
NOTICE Integrate beginning of React UI (#5694) 2019-10-17 14:38:09 +02:00
README.md Update README.md 2020-01-27 18:10:08 +02:00
RELEASE.md Volunteer roidelapluie as 2.17 release shepherd 2020-02-17 20:53:37 +01:00
VERSION Release 2.16.0 (#6817) 2020-02-13 15:33:53 -08:00

Prometheus

CircleCI Docker Repository on Quay Docker Pulls Go Report Card CII Best Practices fuzzit

Visit prometheus.io for the full documentation, examples and guides.

Prometheus, a Cloud Native Computing Foundation project, is a systems and service monitoring system. It collects metrics from configured targets at given intervals, evaluates rule expressions, displays the results, and can trigger alerts if some condition is observed to be true.

Prometheus's main distinguishing features as compared to other monitoring systems are:

  • a multi-dimensional data model (timeseries defined by metric name and set of key/value dimensions)
  • a flexible query language to leverage this dimensionality
  • no dependency on distributed storage; single server nodes are autonomous
  • timeseries collection happens via a pull model over HTTP
  • pushing timeseries is supported via an intermediary gateway
  • targets are discovered via service discovery or static configuration
  • multiple modes of graphing and dashboarding support
  • support for hierarchical and horizontal federation

Architecture overview

Install

There are various ways of installing Prometheus.

Precompiled binaries

Precompiled binaries for released versions are available in the download section on prometheus.io. Using the latest production release binary is the recommended way of installing Prometheus. See the Installing chapter in the documentation for all the details.

Debian packages are available.

Docker images

Docker images are available on Quay.io or Docker Hub.

You can launch a Prometheus container for trying it out with

$ docker run --name prometheus -d -p 127.0.0.1:9090:9090 prom/prometheus

Prometheus will now be reachable at http://localhost:9090/.

Building from source

To build Prometheus from the source code yourself you need to have a working Go environment with version 1.13 or greater installed. You will also need to have Node.js and Yarn installed in order to build the frontend assets.

You can directly use the go tool to download and install the prometheus and promtool binaries into your GOPATH:

$ go get github.com/prometheus/prometheus/cmd/...
$ prometheus --config.file=your_config.yml

However, when using go get to build Prometheus, Prometheus will expect to be able to read its web assets from local filesystem directories under web/ui/static and web/ui/templates. In order for these assets to be found, you will have to run Prometheus from the root of the cloned repository. Note also that these directories do not include the new experimental React UI unless it has been built explicitly using make assets or make build.

An example of the above configuration file can be found here.

You can also clone the repository yourself and build using make build, which will compile in the web assets so that Prometheus can be run from anywhere:

$ mkdir -p $GOPATH/src/github.com/prometheus
$ cd $GOPATH/src/github.com/prometheus
$ git clone https://github.com/prometheus/prometheus.git
$ cd prometheus
$ make build
$ ./prometheus --config.file=your_config.yml

The Makefile provides several targets:

  • build: build the prometheus and promtool binaries (includes building and compiling in web assets)
  • test: run the tests
  • test-short: run the short tests
  • format: format the source code
  • vet: check the source code for common errors
  • docker: build a docker container for the current HEAD

React UI Development

For more information on building, running, and developing on the new React-based UI, see the React app's README.md.

More information

  • The source code is periodically indexed: Prometheus Core.
  • You will find a CircleCI configuration in .circleci/config.yml.
  • See the Community page for how to reach the Prometheus developers and users on various communication channels.

Contributing

Refer to CONTRIBUTING.md

License

Apache License 2.0, see LICENSE.