Commit graph

683 commits

Author SHA1 Message Date
Fabian Reinartz f6c76078f5
Merge pull request #288 from krasi-georgiev/tests-cleanup-tmps
Tests cleanup tmps
2018-02-26 15:03:14 +01:00
Krasi Georgiev eb6cdbcb5b some test funcitons didn't cleanup after themselves. 2018-02-23 18:45:59 +02:00
Fabian Reinartz 88ddcab17c Merge branch 'master' of github.com:prometheus/tsdb 2018-02-21 21:11:26 +01:00
Fabian Reinartz 3f06121dd0 Add Version getter for index reader 2018-02-21 21:06:19 +01:00
Matt Bostock bc97c6c6be Misc fixes (#285)
* Fix typo in head.go

pralellize -> paralellize

* Remove commented out code

It's dead code, remove it.

* Correct reference to sample buffer
2018-02-21 16:38:59 +01:00
Fabian Reinartz 494acd3070
Merge pull request #273 from Gouthamve/large-idx-reader
Fix reader for large index files.
2018-02-15 12:29:47 +01:00
Fabian Reinartz cc673dc167
Merge pull request #282 from codesome/goroutine-stack-overflow
Change recursion into iteration for removedPostings.Next()
2018-02-15 12:20:47 +01:00
Ganesh Vernekar 0fb73ed622 Changed recursion into iteration for removedPostings.Next() 2018-02-14 19:27:35 +05:30
Fabian Reinartz bc49a665d1
Merge pull request #281 from prometheus/indexversion
Indexversion
2018-02-12 11:58:46 +01:00
Fabian Reinartz a345231a0e Add test for block meta version and comments 2018-02-12 11:46:22 +01:00
Fabian Reinartz 04d5ac5aae Add repair test 2018-02-09 13:43:42 +01:00
Fabian Reinartz d09283f60a Add repair of bad index version 2018-02-09 13:11:03 +01:00
Fabian Reinartz 72d61bcf4e
Merge pull request #257 from mattbostock/remove_unused_field
Remove unused field from xorAppender
2018-02-09 12:30:10 +01:00
Fabian Reinartz 5b26bd5f6f
Merge pull request #252 from simonpasquier/add-cuttoff-metrics
Count the total & failed numbers of block cutoffs
2018-02-09 12:28:22 +01:00
Fabian Reinartz ffe73cd0a6
Merge pull request #246 from nipuntalukdar/fixatest
fixed an issue in TestWALRestoreCorrupted
2018-02-05 17:47:31 +01:00
Goutham Veeramachaneni 6c62437101 Fix metric unit (#275)
Fixes #274

Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-02-05 08:36:18 +00:00
Goutham Veeramachaneni bb0e74b343
Fix reader for large index files.
Currently the offsets are cast into uint32 even though the index can
grow larger than 4GiB.

Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-02-05 13:51:22 +05:30
Goutham Veeramachaneni 44dd5e1202
Merge pull request #269 from Gouthamve/fix-reloads
Fix extra reloads.
2018-01-26 20:24:38 +05:30
Goutham Veeramachaneni b7bea04e62
Fix extra reloads.
Previously we reloaded every 1 minute irrespective of whether there are
deleted blocks or not.

Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-01-26 19:33:59 +05:30
Goutham Veeramachaneni ad0fdaf436
Merge pull request #265 from simonpasquier/fix-nil-index-writer
Fix panic on nil index writer
2018-01-24 20:28:35 +05:30
Simon Pasquier 5d47710f8a Fix panic on nil index writer 2018-01-24 15:55:04 +01:00
Goutham Veeramachaneni 467948f3c3
Merge pull request #262 from cstyan/callum-249
Reduce index file size caused by symbol references by using indicies rather than offsets
2018-01-18 14:02:54 +05:30
Callum Styan cd67584817 we don't want to write to index file in older version formats 2018-01-17 22:46:22 -08:00
Callum Styan 87a9415bf1 update docs for symbols indexing change 2018-01-17 14:00:06 -08:00
Fabian Reinartz c7e30f9211
Merge pull request #261 from Gouthamve/corrupt-patch
Add block ULID to index reader errors
2018-01-17 10:51:45 +01:00
Callum Styan 4792d2bbd1 handle v1 vs v2 for symbol offset vs index changes 2018-01-16 20:37:57 -08:00
Callum Styan a515b16299 use an incrementing index rather than an offset for symbols table 2018-01-16 20:07:59 -08:00
Goutham Veeramachaneni 2c3400ab4e Add block ULID to index reader errors
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-01-16 23:48:58 +05:30
Matt Bostock 2023d8a798 Remove unused field from xorAppender
This field is not used, remove it.
2018-01-13 20:57:12 +00:00
Matt Bostock 50211e89ad Fix typos in comments (#254)
a the -> the
timestmap -> timestamp
badded -> padded
its -> it is
callers -> caller's
2018-01-13 17:51:50 +00:00
Goutham Veeramachaneni 8d373c763b
Merge pull request #248 from shubheksha/fix/238
Align series to 8/16 byte padding to increase addressable space
2018-01-13 12:25:28 +05:30
Shubheksha Jalan 618bceadb4 move version check into newReader() 2018-01-13 00:36:20 +05:30
Goutham Veeramachaneni d0982ac4d5
Merge pull request #253 from Gouthamve/fix-ocd-comment
Fix comment formatting
2018-01-12 10:17:31 +05:30
Goutham Veeramachaneni 1ffc916c1a Fix comment formatting
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-01-11 18:20:04 +05:30
Simon Pasquier e9fc37be61 Count the total and failed block cutoffs 2018-01-11 10:22:59 +01:00
Shubheksha Jalan faecfac2fa update docs, rename docs folder, add error condition 2018-01-11 14:06:49 +05:30
Shubheksha Jalan 7b27dc2109 address review comments, fix index tests 2018-01-11 13:20:42 +05:30
Shubheksha Jalan 510dc17066 fix tests, set version when initializing the index writer 2018-01-11 01:03:20 +05:30
Shubheksha Jalan 44052bc937 Make version for index format configurable 2018-01-11 00:49:16 +05:30
Nipun 6537ee832c Incorporated review comments 2018-01-09 10:09:23 +05:30
Shubheksha Jalan 129773b41a merge BlockMeta and blockMeta struct, implement v1 and v2 index readers 2018-01-08 23:03:35 +05:30
Nipun cadae47522 fixed an issue in TestWALRestoreCorrupted 2018-01-07 08:05:50 +05:30
Shubheksha Jalan 77eb9fb56e add padding for series offsets 2018-01-05 18:28:09 +05:30
Goutham Veeramachaneni d45b595a1d
Merge pull request #239 from shubheksha/fix-index-format-doc
Fix docs for index
2017-12-28 13:37:38 +05:30
Shubheksha Jalan 6eb0fb7f91 clarify storage of timestamps and refs in the index 2017-12-28 13:27:30 +05:30
Fabian Reinartz 07ef80820e
Merge pull request #219 from prometheus/refactorpkg
Move index and chunk encoders to own packages
2017-12-22 15:44:41 +01:00
Fabian Reinartz 1e55b7987f Improve comments, handle allPostingsKey properly 2017-12-22 09:43:34 +01:00
Fabian Reinartz da9614fa54 Allow tombstone file to not exist 2017-12-21 12:07:27 +01:00
Fabian Reinartz 7087f68647 Return new block ULID in compactor 2017-12-21 12:02:05 +01:00
Fabian Reinartz b945098e3a index: extract decoder type 2017-12-21 12:02:05 +01:00