Fabian Reinartz
33e9bdf403
WAL refactoring and truncation fixes and test
2017-09-06 14:59:25 +02:00
Johannes 'fish' Ziemke
75aec7d970
k8s: Use versioned struct for ingress discovery
2017-09-06 12:47:03 +02:00
Fabian Reinartz
c36d574290
Replace single head lock with granular locks
...
This adds various new locks to replace the single big lock on
the head. All parts now must be COW as they may be held by clients
after initial retrieval.
Series by ID and hashes are now held in a stripe lock to reduce
contention and total holding time during GC. This should reduce
starvation of readers.
2017-09-05 14:41:39 +02:00
Krasi Georgiev
153cb0cbe3
scraping errors will show in the log when debug mode is enabled ( #3135 )
...
Signed-off-by: Krasi Georgiev <krasi.root@gmail.com>
2017-09-05 11:55:14 +01:00
Fabian Reinartz
1ddedf2b30
Change series ID from uint32 to uint64
2017-09-04 16:08:38 +02:00
Fabian Reinartz
af2c2f9674
Re-enable head block delet test
2017-09-04 15:07:30 +02:00
Goutham Veeramachaneni
1698c516ad
[WIP]: WAL implementation
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-09-04 14:52:40 +02:00
Fabian Reinartz
87918f3097
Merge branch 'master' into dev-2.0
2017-09-04 14:09:21 +02:00
Fabian Reinartz
c70379e1c7
Merge branch 'dev-2.0' of github.com:prometheus/prometheus into dev-2.0
2017-09-04 13:10:50 +02:00
Johannes 'fish' Ziemke
70f3d1e9f9
k8s: Support discovery of ingresses ( #3111 )
...
* k8s: Support discovery of ingresses
* Move additional labels below allocation
This makes it more obvious why the additional elements are allocated.
Also fix allocation for node where we only set a single label.
* k8s: Remove port from ingress discovery
* k8s: Add comment to ingress discovery example
2017-09-04 13:10:44 +02:00
Fabian Reinartz
fffe51fb03
Add mutex and block profiling via envvar
2017-09-04 13:10:32 +02:00
Tobias Schmidt
29fff1eca4
Merge pull request #2966 from alkalinecoffee/consul-node-metadata
...
Add support for consul's node metadata
2017-09-02 18:43:25 +02:00
Fabian Reinartz
9f41d9fd3c
Instrument chunks on level 1 compactions
2017-09-01 16:10:10 +02:00
Fabian Reinartz
893b6ec506
Add tests for GC and chunk truncation
2017-09-01 14:38:49 +02:00
Fabian Reinartz
4f037da462
Remove defer statement in hot path
2017-09-01 12:09:29 +02:00
Fabian Reinartz
4cc37eecab
Refactor and add tests for compactor
2017-09-01 11:50:58 +02:00
Fabian Reinartz
5cf2662074
Refactor WAL into Head and misc improvements
2017-09-01 11:50:58 +02:00
Fabian Reinartz
8209e3ec23
Add various metrics
2017-09-01 11:50:58 +02:00
Fabian Reinartz
3901b6e70b
Remove multiple heads
...
This changes the structure to a single WAL backed by a single head
block.
Parts of the head block can be compacted. This relieves us from any head
amangement and greatly simplifies any consistency and isolation concerns
by just having a single head.
2017-09-01 11:50:58 +02:00
Fabian Reinartz
0fe67df9f2
Merge pull request #135 from alin-amana/fix_eval_blocking_on_fsync
...
Don't do blocking disk I/O under mutex blocking scrape and eval
2017-09-01 11:49:25 +02:00
Alin Sinpalean
8f7934d025
Take the fdatasync() syscall out from under mutex lock to (mostly) avoid scrape and eval from blocking on disk I/O.
2017-09-01 09:45:54 +02:00
Tobias Schmidt
d0a02703a2
Merge pull request #3105 from sak0/dev
...
discovery openstack: support discovery hypervisors, add rule option.
2017-08-31 14:08:16 +02:00
CuiHaozhi
b1c18bf29b
discovery openstack: support discovery hosts, add rule option.
...
Signed-off-by: CuiHaozhi <cuihz@wise2c.com>
2017-08-29 10:14:00 -04:00
Julius Volz
aa5cdcb11e
Remove extra space in log output
2017-08-29 15:24:00 +02:00
gdmello
35c952e344
Added logging for remote storage adapter ( #3106 )
...
* Added logging for remote storage adapter on startup and on any error condition during /read or /write.
* CR feedback.
2017-08-29 15:22:56 +02:00
Lynn Lin
1bf25dc1b2
fix issues reported by gofmt and spelling typo ( #3127 )
2017-08-29 09:00:11 +01:00
Ben Kochie
59aca4138b
Fix staticcheck issues.
2017-08-28 17:29:01 +02:00
Ben Kochie
0fcfe3209f
Add staticcheck to build.
2017-08-28 17:29:01 +02:00
Matt Bostock
64973f5c65
cmd/prometheus: Fix capitalisation in log line ( #3123 )
...
Change 'Ready' to 'ready'.
2017-08-28 11:03:25 +01:00
Matt Bostock
d31c068ae4
api.go: Fix typo in comment ( #3122 )
2017-08-28 11:03:07 +01:00
Fabian Reinartz
215a856f34
Just check for general error in WAL test
...
Go 1.9 changed the returned error. Checking the exact message is too
fragile.
2017-08-27 16:57:43 +02:00
Brian Brazil
78205b76e9
Update Prometheus console template example for 2.0 ( #3100 )
2017-08-26 21:46:12 +01:00
Richard Hartmann
923be6a418
Merge pull request #3113 from prometheus/RichiH-patch-1
...
Point help to docs, not main Prometheus website
2017-08-26 20:18:13 +02:00
Fabian Reinartz
1b86bbb48a
Merge pull request #130 from mdlayher/crc32-once
...
Add newCRC32 function to simplify hash initialization
2017-08-26 18:18:48 +02:00
Matt Layher
78b15c3434
Add newCRC32 function to simplify hash initialization
2017-08-26 12:04:00 -04:00
Goutham Veeramachaneni
e2e2947ee8
Merge pull request #128 from Gouthamve/expose-types
...
Expose types for easier interface implementations.
2017-08-25 21:29:53 +05:30
Goutham Veeramachaneni
c463b0c8c8
Expose NewMergedSeriesSet for merging SeriesSets
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-08-25 19:36:24 +05:30
Goutham Veeramachaneni
5b242f35ba
Expose a Querier with manually passed in readers.
...
Allows people to not copy the querying code.
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-08-25 16:06:45 +05:30
Goutham Veeramachaneni
7438ed7035
Expose Intervals type for use by TombstoneReader.
...
TombstoneReader is exposed but Intervals is not.
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-08-25 16:06:36 +05:30
Richard Hartmann
aa3fb1e7c4
Point help to docs, not main Prometheus website
...
No matter how we refactor docs, `/docs/` will stay the prefix, so there's not long-term risk in changing this.
One we version docs, we should probably try and keep link & version in sync.
2017-08-25 10:53:36 +02:00
Tobias Schmidt
3a4ee617e0
Merge pull request #3062 from cstyan/callum-1553
...
check if file_sd files exists in checkConfig
2017-08-24 13:35:07 +02:00
Tobias Schmidt
d6a0f46baf
Fix formatting of GitHub issue template
...
There is actually an easier way to format comments, which doesn't
require a hack and also fixes the dispay in non-monospace fonts.
2017-08-24 13:33:16 +02:00
Fabian Reinartz
0c81d5f719
storage: instantiate correct block ranges
2017-08-24 12:36:07 +02:00
Tobias Schmidt
57a9de4a9a
Merge pull request #3076 from Colstuwjx/fix/nil-target-group
...
Fix target group foreach nil bug.
2017-08-24 01:00:44 +02:00
Mark Adams
77c816b309
Fix pprof endpoints when -web.route-prefix or -web.external-url is used ( #3054 )
...
Whenever a route prefix is applied, the router prepends the prefix to
the URL path on the request. For most handlers, this is not an issue
because the request's path is only used for routing and is not actually
needed by the handler itself. However, Prometheus delegates the handling
of the /debug/* endpoints to the http.DefaultServeMux which has it's own
routing logic that depends on the url.Path. As a result, whenever a
prefix is applied, the prefixed URL is passed to the DefaultServeMux
which has no awareness of the prefix and returns a 404.
This change fixes the issue by creating a new serveDebug handler which
routes requests /debug/* requests to appropriate net/http/pprof handler
and removing the net/http/pprof import in cmd/prometheus since it is no
longer necessary.
Fixes #2183 .
2017-08-23 00:00:56 +01:00
Callum Styan
8912f81ffe
check if file_sd files exist in checkConfig
2017-08-22 15:25:30 -07:00
Goutham Veeramachaneni
79dc0ed420
Merge pull request #126 from ankon/pr/issue-125
...
Log the directory when the WAL cannot be opened
2017-08-22 14:52:30 +05:30
Andreas Kohn
4003da0fdd
Log the directory when the WAL cannot be opened
...
Fixes #125
2017-08-22 11:17:07 +02:00
Colstuwjx
2b49df2c61
Fix target group foreach nil bug, directly return err.
2017-08-22 08:37:39 +08:00
Tobias Schmidt
32a951ec89
Add a big notice header to the github issue template header ( #3103 )
...
Trying to prevent usage questions in Github issue, this change adds a
multi-line notice header directing people to the mailing list.
2017-08-22 00:46:49 +01:00