Krasi Georgiev
b4a2103a12
Release v0.3.0 ( #464 )
2018-12-04 16:50:11 +03:00
Brian Brazil
fc99b8bb3a
Make index reader postings nested.
...
This reduces memory by only having to store the string's 16
bytes+map overheard once per label name, rather than duplicating it in every
entry for the label value.
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
2018-11-22 09:36:39 +00:00
Brian Brazil
c93e261466
Reduce memory taken up by posting/symbol tables.
...
Reuse the string already allocated for symbols
in the posting tables.
Use a slice for symbols in v2 format.
Move symbol size logic into the index code.
Avoid duplication of lookupSymbol logic.
Signed-off-by: Brian Brazil <brian.brazil@robustperception.io>
2018-11-22 09:36:39 +00:00
Ganesh Vernekar
3a08a71d86
LabelNames() method to get all unique label names ( #369 )
...
* LabelNames() method to get all unique label names
Signed-off-by: Ganesh Vernekar <cs15btech11018@iith.ac.in>
2018-11-07 17:52:41 +02:00
Kautilya Tripathi
3fd6d2f920
more meaningful names for serializedStringTuples and stringTuples ( #377 )
...
more meaningful names for serializedStringTuples and stringTuples structs
Signed-off-by: knrt10 <tripathi.kautilya@gmail.com>
Co-authored-by: Krasi Georgiev <kgeorgie@redhat.com>
2018-10-02 21:03:12 +03:00
Julius Volz
5ae6c60d39
Handle a bunch of unchecked errors ( #365 )
...
As discovered by "gosec".
Signed-off-by: Julius Volz <julius.volz@gmail.com>
2018-09-20 11:33:52 +03:00
Simon Pasquier
e8fc6c8774
index: fix another Uvarint() return check
...
Signed-off-by: Simon Pasquier <spasquie@redhat.com>
2018-06-08 14:42:24 +02:00
Mario Trangoni
09142e4dd1
fix unconvert issues: unnecessary conversion
2018-03-21 22:39:14 +01:00
Fabian Reinartz
3f06121dd0
Add Version getter for index reader
2018-02-21 21:06:19 +01:00
Fabian Reinartz
494acd3070
Merge pull request #273 from Gouthamve/large-idx-reader
...
Fix reader for large index files.
2018-02-15 12:29:47 +01:00
Fabian Reinartz
a345231a0e
Add test for block meta version and comments
2018-02-12 11:46:22 +01:00
Fabian Reinartz
d09283f60a
Add repair of bad index version
2018-02-09 13:11:03 +01:00
Goutham Veeramachaneni
bb0e74b343
Fix reader for large index files.
...
Currently the offsets are cast into uint32 even though the index can
grow larger than 4GiB.
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-02-05 13:51:22 +05:30
Goutham Veeramachaneni
467948f3c3
Merge pull request #262 from cstyan/callum-249
...
Reduce index file size caused by symbol references by using indicies rather than offsets
2018-01-18 14:02:54 +05:30
Callum Styan
cd67584817
we don't want to write to index file in older version formats
2018-01-17 22:46:22 -08:00
Callum Styan
4792d2bbd1
handle v1 vs v2 for symbol offset vs index changes
2018-01-16 20:37:57 -08:00
Callum Styan
a515b16299
use an incrementing index rather than an offset for symbols table
2018-01-16 20:07:59 -08:00
Goutham Veeramachaneni
2c3400ab4e
Add block ULID to index reader errors
...
Signed-off-by: Goutham Veeramachaneni <cs14btech11014@iith.ac.in>
2018-01-16 23:48:58 +05:30
Shubheksha Jalan
618bceadb4
move version check into newReader()
2018-01-13 00:36:20 +05:30
Shubheksha Jalan
faecfac2fa
update docs, rename docs folder, add error condition
2018-01-11 14:06:49 +05:30
Shubheksha Jalan
7b27dc2109
address review comments, fix index tests
2018-01-11 13:20:42 +05:30
Shubheksha Jalan
510dc17066
fix tests, set version when initializing the index writer
2018-01-11 01:03:20 +05:30
Shubheksha Jalan
44052bc937
Make version for index format configurable
2018-01-11 00:49:16 +05:30
Shubheksha Jalan
129773b41a
merge BlockMeta and blockMeta struct, implement v1 and v2 index readers
2018-01-08 23:03:35 +05:30
Shubheksha Jalan
77eb9fb56e
add padding for series offsets
2018-01-05 18:28:09 +05:30
Fabian Reinartz
b945098e3a
index: extract decoder type
2017-12-21 12:02:05 +01:00
Fabian Reinartz
6dd2b83a7a
index: don't use concatenated string for posting table
2017-12-21 12:02:05 +01:00
Fabian Reinartz
67f0ca8f0e
Move index and chunk encoders to own packages
2017-12-21 11:27:54 +01:00
Fabian Reinartz
6f93a699e6
wipe
2016-12-02 17:49:05 +01:00
Fabian Reinartz
342aa82505
Fix pages and index package
2016-11-15 15:53:48 +01:00