Krasi Georgiev
5d8f93a22a
now using only github.com/gogo/protobuf
...
bumped all grpc-gateway packages to v1.2.2
updated and run the denproto.sh script
2017-11-02 11:31:57 +00:00
Tom Wilkie
1af3ef431d
s/TestRemoveLabels/TestSeriesSetFilter/
2017-10-26 13:50:39 +01:00
Tom Wilkie
9c3c98e8de
Revert "Port 'Don't disable HTTP keep-alives for remote storage connections.' to 2.0 (see #3173 )"
...
This reverts commit 0997191b18
.
2017-10-26 13:43:48 +01:00
Tom Wilkie
746752b946
Merge external labels in order.
2017-10-26 11:44:49 +01:00
Tom Wilkie
6e4d4ea402
Initialise some counters in remote storage API.
2017-10-26 11:09:45 +01:00
Tom Wilkie
2ae04d0e79
Add license header.
2017-10-26 11:09:16 +01:00
Tom Wilkie
e8c264e47a
Add comment.
2017-10-26 11:09:16 +01:00
Tom Wilkie
ee011d906d
Port remote read server to 2.0.
2017-10-26 11:09:14 +01:00
Bryan Boreham
0997191b18
Port 'Don't disable HTTP keep-alives for remote storage connections.' to 2.0 (see #3173 )
...
Removes configurability introduced in #3160 in favour of hard-coding,
per advice from @brian-brazil.
2017-10-26 11:08:33 +01:00
Tom Wilkie
56820726fa
Move a couple of the encoding/decoding functions into codec.go
2017-10-26 11:08:33 +01:00
Conor Broderick
08b7328669
Port Metric name validation to 2.0 (see #2975 )
2017-10-26 11:08:33 +01:00
Tom Wilkie
8fe0212ff7
Port 'Make queue manager configurable.' to 2.0, see #2991
2017-10-26 11:08:33 +01:00
Tom Wilkie
3760f56c0c
remote: Expose ClientConfig type (see #3165 )
2017-10-26 11:08:33 +01:00
Tom Wilkie
16f71a7723
Port codec.go over form 1.8 branch.
2017-10-26 11:08:33 +01:00
Julius Volz
099df0c5f0
Migrate "golang.org/x/net/context" -> "context" ( #3333 )
...
In some places, where ctxhttp or gRPC are concerned, we still need to use the
old contexts.
2017-10-24 21:21:42 -07:00
Julius Volz
c3d6abc8e6
Fix some lint errors ( #3334 )
...
I left the promql ones and some others untouched as I remember that @fabxc
prefers them that way.
2017-10-23 14:57:30 +01:00
Julius Volz
2846d62573
Fix staticcheck issue in test ( #3331 )
...
staticcheck fails with:
storage/remote/read_test.go:199:27: do not pass a nil Context, even if a function permits it; pass context.TODO if you are unsure about which Context to use (SA1012)
2017-10-23 11:51:48 +01:00
Brian Brazil
4a50f547c8
removeLabels needs a pointer to work. ( #3326 )
2017-10-21 08:29:03 +01:00
Thibault Chataigner
bf4a279a91
Remote storage reads based on oldest timestamp in primary storage ( #3129 )
...
Currently all read queries are simply pushed to remote read clients.
This is fine, except for remote storage for wich it unefficient and
make query slower even if remote read is unnecessary.
So we need instead to compare the oldest timestamp in primary/local
storage with the query range lower boundary. If the oldest timestamp
is older than the mint parameter, then there is no need for remote read.
This is an optionnal behavior per remote read client.
Signed-off-by: Thibault Chataigner <t.chataigner@criteo.com>
2017-10-18 12:08:14 +01:00
Julius Volz
9ef8518b37
Remove "package remote" garbage from license headers ( #3304 )
2017-10-17 02:26:38 +01:00
Brian Brazil
73dc96e7f5
Fix leak of ticker in remote storage queue manager.
2017-10-09 19:44:03 +01:00
Brian Brazil
ee88f0d222
Ensure all values are used or _
2017-10-09 19:44:03 +01:00
Brian Brazil
37ec2d5283
Fix off by one error in concreteSeriesSet ( #3262 )
2017-10-09 13:37:58 +01:00
Marc Sluiter
6a633eece1
Added go-conntrack for monitoring http connections ( #3241 )
...
Added metrics for in- and outgoing traffic with go-conntrack.
2017-10-06 11:22:19 +01:00
Julius Volz
f7e8348a88
Re-add contexts to storage.Storage.Querier() ( #3230 )
...
* Re-add contexts to storage.Storage.Querier()
These are needed when replacing the storage by a multi-tenant
implementation where the tenant is stored in the context.
The 1.x query interfaces already had contexts, but they got lost in 2.x.
* Convert promql.Engine to use native contexts
2017-10-04 21:04:15 +02:00
Fabian Reinartz
d21f149745
*: migrate to go-kit/log
2017-09-08 22:01:51 +05:30
Fabian Reinartz
0efecea6d4
Adapt storage APIs to uint64 references
2017-09-07 14:14:41 +02:00
Tom Wilkie
b11bc8ae24
Fix some comments.
2017-08-01 11:19:35 +01:00
Tom Wilkie
ec999ff397
Prevent number of remote write shards from going negative.
...
This can happen in the situation where the system scales up the number of shards massively (to deal with some backlog), then scales it down again as the number of samples sent during the time period is less than the number received.
2017-07-19 16:32:09 +01:00
Tom Wilkie
a09acdcc5b
Make concreteSeriersIterator behave.
2017-07-13 18:33:08 +01:00
Tom Wilkie
b568ace7ce
Move protos to ./prompb
2017-07-12 22:06:35 +01:00
Tom Wilkie
db8128ceeb
Add label set as first parameter to AddFast, ingored by TSDB adapter.
2017-07-12 15:20:12 +01:00
Tom Wilkie
2dda5775e3
Initial port of remote storage to v2.
2017-07-12 12:27:57 +01:00
Fabian Reinartz
8ffc851147
Merge branch 'master' into dev-2.0
2017-04-04 15:17:56 +02:00
Julius Volz
5a896033e3
Add remote read external label handling ( #2555 )
...
* Add remote read external label handling
This implements rule 1 and 2 from
https://docs.google.com/document/d/188YauRgfF0J4CYMigLsVNN34V_kUwKnApBs2dQMfBbs/edit
* Use more descriptive example labels in read test
* Add comment for querier.addExternalLabels()
* Make argument naming in removeLabels() more generic
2017-04-02 17:48:15 +02:00
Julius Volz
3f23aa2cc7
Add headers to indicate remote read/write version
...
Also add Content-Type header.
2017-03-24 17:39:51 +01:00
Julius Volz
94acd3f1d8
Add fanin tests and fix uncovered bugs
2017-03-21 00:08:17 +01:00
Julius Volz
9b33cfc457
Fix/unify context-based remote storage timeouts
2017-03-20 14:17:06 +01:00
Julius Volz
815762a4ad
Move retrieval.NewHTTPClient -> httputil.NewClientFromConfig
2017-03-20 14:17:04 +01:00
Julius Volz
eb14678a25
Make remote read/write use config.HTTPClientConfig
2017-03-20 13:37:50 +01:00
Julius Volz
406b65d0dc
Rename remote.Storage to remote.Writer
2017-03-20 13:15:28 +01:00
Julius Volz
02395a224d
[WIP] Remote Read
2017-03-20 13:13:44 +01:00
Tom Wilkie
75bb0f3253
Review feedback
2017-03-13 21:24:49 +00:00
Tom Wilkie
77cce900b8
Fix tests
2017-03-13 15:21:59 +00:00
Tom Wilkie
b48799a01e
Add license stanza
2017-03-13 14:50:15 +00:00
Tom Wilkie
9d22f030cf
Dynamically reshard the QueueManager based on observed load.
2017-03-13 14:41:16 +00:00
Tom Wilkie
1ab893c6ec
Limit 'discarding sample' logs to 1 every 10s ( #2446 )
...
* Limit 'discarding sample' logs to 1 every 10s
* Include the vendored library
* Review feedback
2017-02-23 19:20:39 +01:00
Julius Volz
2f39dbc8b3
Rename StorageQueueManager -> QueueManager
2017-02-21 21:45:43 +01:00
Julius Volz
e9476b35d5
Re-add multiple remote writers
...
Each remote write endpoint gets its own set of relabeling rules.
This is based on the (yet-to-be-merged)
https://github.com/prometheus/prometheus/pull/2419 , which removes legacy
remote write implementations.
2017-02-20 13:23:12 +01:00
Julius Volz
beb3c4b389
Remove legacy remote storage implementations
...
This removes legacy support for specific remote storage systems in favor
of only offering the generic remote write protocol. An example bridge
application that translates from the generic protocol to each of those
legacy backends is still provided at:
documentation/examples/remote_storage/remote_storage_bridge
See also https://github.com/prometheus/prometheus/issues/10
The next step in the plan is to re-add support for multiple remote
storages.
2017-02-14 17:52:05 +01:00