Commit graph

870 commits

Author SHA1 Message Date
Goutham Veeramachaneni bb0e74b343
Fix reader for large index files.
Currently the offsets are cast into uint32 even though the index can
grow larger than 4GiB.

Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-02-05 13:51:22 +05:30
Goutham Veeramachaneni 44dd5e1202
Merge pull request #269 from Gouthamve/fix-reloads
Fix extra reloads.
2018-01-26 20:24:38 +05:30
Goutham Veeramachaneni b7bea04e62
Fix extra reloads.
Previously we reloaded every 1 minute irrespective of whether there are
deleted blocks or not.

Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-01-26 19:33:59 +05:30
Goutham Veeramachaneni ad0fdaf436
Merge pull request #265 from simonpasquier/fix-nil-index-writer
Fix panic on nil index writer
2018-01-24 20:28:35 +05:30
Simon Pasquier 5d47710f8a Fix panic on nil index writer 2018-01-24 15:55:04 +01:00
Goutham Veeramachaneni 467948f3c3
Merge pull request #262 from cstyan/callum-249
Reduce index file size caused by symbol references by using indicies rather than offsets
2018-01-18 14:02:54 +05:30
Callum Styan cd67584817 we don't want to write to index file in older version formats 2018-01-17 22:46:22 -08:00
Callum Styan 87a9415bf1 update docs for symbols indexing change 2018-01-17 14:00:06 -08:00
Fabian Reinartz c7e30f9211
Merge pull request #261 from Gouthamve/corrupt-patch
Add block ULID to index reader errors
2018-01-17 10:51:45 +01:00
Callum Styan 4792d2bbd1 handle v1 vs v2 for symbol offset vs index changes 2018-01-16 20:37:57 -08:00
Callum Styan a515b16299 use an incrementing index rather than an offset for symbols table 2018-01-16 20:07:59 -08:00
Goutham Veeramachaneni 2c3400ab4e Add block ULID to index reader errors
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-01-16 23:48:58 +05:30
Simon Pasquier 7206a8456f Fix minor typos in comments 2018-01-15 14:27:49 +01:00
Simon Pasquier bbd69b04cc Fix minor typos in the documentation 2018-01-15 14:27:49 +01:00
Matt Bostock ab15f64ff8 Add default benchmark output dir to .gitignore 2018-01-14 11:07:52 +00:00
Matt Bostock 2023d8a798 Remove unused field from xorAppender
This field is not used, remove it.
2018-01-13 20:57:12 +00:00
Matt Bostock 50211e89ad Fix typos in comments (#254)
a the -> the
timestmap -> timestamp
badded -> padded
its -> it is
callers -> caller's
2018-01-13 17:51:50 +00:00
Goutham Veeramachaneni 8d373c763b
Merge pull request #248 from shubheksha/fix/238
Align series to 8/16 byte padding to increase addressable space
2018-01-13 12:25:28 +05:30
Shubheksha Jalan 618bceadb4 move version check into newReader() 2018-01-13 00:36:20 +05:30
Goutham Veeramachaneni d0982ac4d5
Merge pull request #253 from Gouthamve/fix-ocd-comment
Fix comment formatting
2018-01-12 10:17:31 +05:30
Goutham Veeramachaneni 1ffc916c1a Fix comment formatting
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-01-11 18:20:04 +05:30
Simon Pasquier e9fc37be61 Count the total and failed block cutoffs 2018-01-11 10:22:59 +01:00
Shubheksha Jalan faecfac2fa update docs, rename docs folder, add error condition 2018-01-11 14:06:49 +05:30
Shubheksha Jalan 7b27dc2109 address review comments, fix index tests 2018-01-11 13:20:42 +05:30
Shubheksha Jalan 510dc17066 fix tests, set version when initializing the index writer 2018-01-11 01:03:20 +05:30
Shubheksha Jalan 44052bc937 Make version for index format configurable 2018-01-11 00:49:16 +05:30
Nipun 6537ee832c Incorporated review comments 2018-01-09 10:09:23 +05:30
Shubheksha Jalan 129773b41a merge BlockMeta and blockMeta struct, implement v1 and v2 index readers 2018-01-08 23:03:35 +05:30
Nipun cadae47522 fixed an issue in TestWALRestoreCorrupted 2018-01-07 08:05:50 +05:30
Shubheksha Jalan 77eb9fb56e add padding for series offsets 2018-01-05 18:28:09 +05:30
Goutham Veeramachaneni d45b595a1d
Merge pull request #239 from shubheksha/fix-index-format-doc
Fix docs for index
2017-12-28 13:37:38 +05:30
Shubheksha Jalan 6eb0fb7f91 clarify storage of timestamps and refs in the index 2017-12-28 13:27:30 +05:30
Fabian Reinartz 07ef80820e
Merge pull request #219 from prometheus/refactorpkg
Move index and chunk encoders to own packages
2017-12-22 15:44:41 +01:00
Fabian Reinartz 1e55b7987f Improve comments, handle allPostingsKey properly 2017-12-22 09:43:34 +01:00
Fabian Reinartz da9614fa54 Allow tombstone file to not exist 2017-12-21 12:07:27 +01:00
Fabian Reinartz 7087f68647 Return new block ULID in compactor 2017-12-21 12:02:05 +01:00
Fabian Reinartz b945098e3a index: extract decoder type 2017-12-21 12:02:05 +01:00
Fabian Reinartz 6dd2b83a7a index: don't use concatenated string for posting table 2017-12-21 12:02:05 +01:00
Fabian Reinartz 54205903f7 Move index and chunk encoders to own packages 2017-12-21 12:02:05 +01:00
Fabian Reinartz adb6be73dd move label read function int labels pkg 2017-12-21 11:55:58 +01:00
Fabian Reinartz 67f0ca8f0e Move index and chunk encoders to own packages 2017-12-21 11:27:54 +01:00
Goutham Veeramachaneni fe67d2f16a
Merge pull request #229 from Gouthamve/remove-log
Remove verbose log line that is causing travis issues
2017-12-21 12:19:10 +05:30
Goutham Veeramachaneni e6e3fa566a Remove verbose log line that is causing travis issues
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2017-12-21 12:16:11 +05:30
Goutham Veeramachaneni 239cbae154
Merge pull request #228 from Gouthamve/not-matchers
Select series with label unset for != and !~
2017-12-21 12:10:51 +05:30
Goutham Veeramachaneni 9f2935c5cf
Merge pull request #224 from Gouthamve/fix-214
Make sure gc'ed chunks are handled properly
2017-12-21 12:10:24 +05:30
Fabian Reinartz 17917be844
Merge pull request #226 from cstyan/callum-decouple-prom-pkg
decouple tsdb main.go (and tests) from prometheus/pkg
2017-12-20 08:02:21 +01:00
Goutham Veeramachaneni 3158b03e6c Select series with label unset for != and !~
Fixes https://github.com/prometheus/prometheus/issues/3575

Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
2017-12-19 02:47:31 +00:00
Callum Styan bcde61b237 we shouldn't assume we'll receive the labels in sorted order 2017-12-18 15:32:39 -08:00
Callum Styan 8326e410d0 decouple tsdb main.go (and tests) from prometheus/pkg 2017-12-18 15:26:16 -08:00
Goutham Veeramachaneni 05d62ca842 Make sure gc'ed chunks are handled properly
Signed-off-by: Goutham Veeramachaneni <gouthamve@gmail.com>
2017-12-14 19:48:39 +00:00