The Prometheus monitoring system and time series database.
Find a file
Julien Pivotto e96d786fb8
Stop CMUX and GRPC servers even with stale connections (#7810)
I have received a recent report for a user which confirms that sometime
the GRPC server does not stop propery.

It appears that there are 2 issues:

1. The cmux server can refuse to stop if there are stale connections.
For that we set the ReadTimeout.
2. The GRPC server graceful stop can never finish.

What this PR avoids is:

```
goroutine 227 [semacquire, 2 minutes]:
sync.runtime_Semacquire(0xc00059a75c)
    /usr/local/go/src/runtime/sema.go:56 +0x42
sync.(*WaitGroup).Wait(0xc00059a75c)
    /usr/local/go/src/sync/waitgroup.go:130 +0x64
google.golang.org/grpc.(*Server).GracefulStop(0xc00059a600)
```

This PR stops the GRPC server after 15s. Related to the go routing dumps
in #6747.

Signed-off-by: Julien Pivotto <roidelapluie@inuits.eu>
2020-08-17 09:50:32 +01:00
.circleci Update to go 1.15 (#7798) 2020-08-15 23:49:11 +02:00
.github Issue template: Remove kind/bug label added by default (#7813) 2020-08-17 00:49:03 +02:00
cmd Make file permissions set to allow for wider umask options. (#7782) 2020-08-12 23:23:17 +02:00
config Add per scrape-config targets limit (#7554) 2020-07-30 14:20:24 +02:00
console_libraries Update various UI components (#7807) 2020-08-15 22:31:30 +02:00
consoles Update console template example metric names. (#5678) 2019-06-17 12:13:29 +01:00
discovery Merge pull request #6838 from brancz/endpointslice 2020-08-12 16:42:49 +02:00
docs Human-friendly durations in PromQL (#7713) 2020-08-04 21:12:41 +02:00
documentation Add per scrape-config targets limit (#7554) 2020-07-30 14:20:24 +02:00
notifier Replace sync/atomic with uber-go/atomic (#7683) 2020-07-30 13:15:42 +05:30
pkg Add fmt rule check: labels with the name __name__ are invalid (#7787) 2020-08-12 23:37:31 +02:00
prompb tsdb: Added ChunkQueryable implementations to db; unified MergeSeriesSets and vertical to single struct. (#7069) 2020-07-31 16:03:02 +01:00
promql Hints: Separating out the range and offsets of PromQL subqueries (#7667) 2020-08-11 07:21:39 +01:00
rules rules: add evaluationTimestamp when copy state. (#7775) 2020-08-14 09:42:13 +01:00
scrape Use SAN in test certificate (#7789) 2020-08-12 23:15:38 +02:00
scripts Update go deps + use exclude directive (#7624) 2020-07-27 11:08:38 +02:00
storage Apply gofmt -s on storage/remote/write_test.go (#7791) 2020-08-12 19:55:42 -06:00
template Add unit test case to improve test coverage for template.go (#7537) 2020-07-09 09:43:32 +01:00
tsdb tsdb: simplify code. (#7792) 2020-08-14 15:15:08 +05:30
util Add more Go leak tests (#7652) 2020-07-24 10:10:20 +01:00
vendor Human-friendly durations in PromQL (#7713) 2020-08-04 21:12:41 +02:00
web Stop CMUX and GRPC servers even with stale connections (#7810) 2020-08-17 09:50:32 +01:00
.dockerignore Add image build for ppc64le architecture 2020-04-06 18:03:58 -03:00
.gitignore add tsdb cmds into promtool (#6088) 2020-07-23 19:35:50 +01:00
.gitpod.yml Gitpod config (#7749) 2020-08-14 17:23:55 +02:00
.golangci.yml Enable golint in CI 2020-03-23 15:32:37 +01:00
.promu.yml Update to go 1.15 (#7798) 2020-08-15 23:49:11 +02:00
CHANGELOG.md Cut v2.20.1 2020-08-05 18:26:14 +02:00
CODE_OF_CONDUCT.md Improve repo sync script 2020-06-17 17:12:36 +02:00
CONTRIBUTING.md Gitpod config (#7749) 2020-08-14 17:23:55 +02:00
Dockerfile Integrate beginning of React UI (#5694) 2019-10-17 14:38:09 +02:00
fuzzit.sh Fix fuzzit job (#6005) 2019-09-11 09:08:20 +02:00
go.mod Human-friendly durations in PromQL (#7713) 2020-08-04 21:12:41 +02:00
go.sum Human-friendly durations in PromQL (#7713) 2020-08-04 21:12:41 +02:00
LICENSE Clean up license issues. 2015-01-21 20:07:45 +01:00
MAINTAINERS.md Add Bartek as maintainer for TSDB (#7690) 2020-07-29 20:25:14 +05:30
Makefile Merge pull request #7067 from carlosedp/ppc64le 2020-08-05 18:16:59 +02:00
Makefile.common Makefile.common: add 'update-go-deps' target (#7259) 2020-05-18 11:43:45 +02:00
NOTICE Update NOTICE for the XORChunk (#7415) 2020-06-18 15:12:35 +05:30
README.md Gitpod config (#7749) 2020-08-14 17:23:55 +02:00
RELEASE.md Next release shepherds (#7570) 2020-07-14 10:58:03 +02:00
VERSION Cut v2.20.1 2020-08-05 18:26:14 +02:00

Prometheus

CircleCI Docker Repository on Quay Docker Pulls Go Report Card CII Best Practices fuzzit Gitpod ready-to-code

Visit prometheus.io for the full documentation, examples and guides.

Prometheus, a Cloud Native Computing Foundation project, is a systems and service monitoring system. It collects metrics from configured targets at given intervals, evaluates rule expressions, displays the results, and can trigger alerts if some condition is observed to be true.

Prometheus's main distinguishing features as compared to other monitoring systems are:

  • a multi-dimensional data model (timeseries defined by metric name and set of key/value dimensions)
  • PromQL, a powerful and flexible query language to leverage this dimensionality
  • no dependency on distributed storage; single server nodes are autonomous
  • timeseries collection happens via a pull model over HTTP
  • pushing timeseries is supported via an intermediary gateway
  • targets are discovered via service discovery or static configuration
  • multiple modes of graphing and dashboarding support
  • support for hierarchical and horizontal federation

Architecture overview

Install

There are various ways of installing Prometheus.

Precompiled binaries

Precompiled binaries for released versions are available in the download section on prometheus.io. Using the latest production release binary is the recommended way of installing Prometheus. See the Installing chapter in the documentation for all the details.

Debian packages are available.

Docker images

Docker images are available on Quay.io or Docker Hub.

You can launch a Prometheus container for trying it out with

$ docker run --name prometheus -d -p 127.0.0.1:9090:9090 prom/prometheus

Prometheus will now be reachable at http://localhost:9090/.

Building from source

To build Prometheus from the source code yourself you need to have a working Go environment with version 1.13 or greater installed. You will also need to have Node.js and Yarn installed in order to build the frontend assets.

You can directly use the go tool to download and install the prometheus and promtool binaries into your GOPATH:

$ go get github.com/prometheus/prometheus/cmd/...
$ prometheus --config.file=your_config.yml

However, when using go get to build Prometheus, Prometheus will expect to be able to read its web assets from local filesystem directories under web/ui/static and web/ui/templates. In order for these assets to be found, you will have to run Prometheus from the root of the cloned repository. Note also that these directories do not include the new experimental React UI unless it has been built explicitly using make assets or make build.

An example of the above configuration file can be found here.

You can also clone the repository yourself and build using make build, which will compile in the web assets so that Prometheus can be run from anywhere:

$ mkdir -p $GOPATH/src/github.com/prometheus
$ cd $GOPATH/src/github.com/prometheus
$ git clone https://github.com/prometheus/prometheus.git
$ cd prometheus
$ make build
$ ./prometheus --config.file=your_config.yml

The Makefile provides several targets:

  • build: build the prometheus and promtool binaries (includes building and compiling in web assets)
  • test: run the tests
  • test-short: run the short tests
  • format: format the source code
  • vet: check the source code for common errors
  • docker: build a docker container for the current HEAD

React UI Development

For more information on building, running, and developing on the new React-based UI, see the React app's README.md.

More information

  • The source code is periodically indexed: Prometheus Core.
  • You will find a CircleCI configuration in .circleci/config.yml.
  • See the Community page for how to reach the Prometheus developers and users on various communication channels.

Contributing

Refer to CONTRIBUTING.md

License

Apache License 2.0, see LICENSE.