JakeHillion/storj
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
f2cd7b0928
storj/satellite/metabase
History
Michal Niewrzal f2cd7b0928 satellite/overlay: refactor Reliable to be used with repair checker 
Currently we are using Reliable to get missing pieces for repair
checker. The issue is that now checker is looking at more things than
just missing pieces (clumped/off, placement pieces) and using only node
ID is not enough. We have issue where we are skipping offline nodes from
clumped and off placement pieces check.

Reliable was refactored to get data (e.g. country, lastNet) about all
reliable nodes. List is split into online and offline. This data will be
cached for quick use by repair checker. It will be also possible to
check nodes metadata like country code or lastNet.

We are also slowly moving `RepairExcludedCountryCodes` config from
overlay to repair which makes more sens for it.

This this first part of changes.

https://github.com/storj/storj/issues/5998

Change-Id: If534342488c0e440affc2894a8fbda6507b8959d
2023-07-05 10:56:31 +02:00
..
metabasetest satellite/metainfo: drop MultipleVersions config flag 2023-03-29 13:45:09 +00:00
rangedloop satellite/overlay: refactor Reliable to be used with repair checker 2023-07-05 10:56:31 +02:00
zombiedeletion satellite/metabase: remove AOST from deleteInactiveObjectsAndSegments 2023-06-28 13:24:14 +00:00
alias_test.go ci: fix lint errors 2021-05-17 13:37:31 +00:00
alias.go satellite/metabase,cmd/tools/segment-verify: simplify interface 2022-10-06 13:42:00 +00:00
aliascache_test.go satellite/metabase: expose ConvertNodesToAliases and ConvertAliasesToNodes 2022-09-15 13:56:10 +00:00
aliascache.go cmd/tools/segment-verify: tool for checking duplicate net 2022-12-15 22:58:36 +00:00
aliaspiece_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
aliaspiece.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
bench_expired_test.go all: fix nolint directives 2022-10-11 18:31:20 +00:00
bench_test.go all: fix nolint directives 2022-10-11 18:31:20 +00:00
commit_object_test.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
commit_object.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
commit_test.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
commit.go satellite/metabase: fix error message 2023-05-02 13:53:57 +00:00
common_test.go satellite/metabase: add piece size calculation to segment 2023-02-22 11:04:02 +00:00
common.go satellite/metainfo: fix duplicates while listing committed objects 2023-02-14 14:47:27 +01:00
consts_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
copy_object_test.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
copy_object.go satellite/metabase: convert bucket name to bytes for queries 2023-06-29 10:43:35 +00:00
db_internal_test.go satellite/metabase/segmentloop: limit max interval 2021-06-10 17:06:33 +00:00
db_test.go satellite/metabase: drop alias migration code 2021-05-07 12:13:28 +03:00
db.go go.mod: bump to pgx/v5 2023-06-14 18:32:54 +03:00
delete_bucket_test.go satellite/metainfo: stop sending delete requests to SN 2023-06-14 10:46:02 +00:00
delete_bucket.go satellite/metainfo: stop sending delete requests to SN 2023-06-14 10:46:02 +00:00
delete_objects_test.go satellite/metabase: remove AOST from deleteInactiveObjectsAndSegments 2023-06-28 13:24:14 +00:00
delete_objects.go satellite/metabase: remove AOST from deleteInactiveObjectsAndSegments 2023-06-28 13:24:14 +00:00
delete_test.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
delete.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
encoding.go satellite/metabase: deletion query as explicit transaction 2022-03-31 11:40:36 +00:00
get_test.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
get.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
iterator_test.go satellite/metabase: make UploadID stable for different options 2022-11-10 17:35:36 +00:00
iterator_util_test.go satellite/metabase: fix listing prefixes with cursor set 2021-07-07 14:30:46 +00:00
iterator.go satellite/metabase: make UploadID stable for different options 2022-11-10 17:35:36 +00:00
list_objects_test.go satellite/metabase: ListObjects 2022-09-20 11:15:44 +00:00
list_objects.go satellite/metabase: convert bucket name to bytes for queries 2023-06-29 10:43:35 +00:00
list_segments_test.go satellite/meta{base,info}: reduce db round trips for download 2023-04-03 16:49:00 +00:00
list_segments.go satellite/orders: filter nodes based on segment placement 2023-06-05 13:56:22 -04:00
list_verify_segments_test.go satellite/metabase: add logic for verifying segments in given buckets 2022-12-08 09:45:15 +00:00
list_verify_segments.go satellite/metabase: convert bucket name to bytes for queries 2023-06-29 10:43:35 +00:00
list.go satellite/metabase: drop IterateObjectsAllVersions 2022-05-26 14:12:20 +00:00
loop_test.go satellite/accounting/tally: save tallies in a batches 2023-06-22 17:02:26 +00:00
loop.go satellite/accounting/tally: handle well bucket names with escape char 2023-06-21 15:04:14 +00:00
metadata_test.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
metadata.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
migrate_test.go metabase: use predefined snapshot for unit tests avoid migration 2022-06-01 12:07:00 +00:00
move_object_test.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
move_object.go satellite/metabase: define a local ErrObjectNotFound 2023-04-19 12:03:01 +00:00
raw.go satellite/metabase/metabasetest: detect full scan table queries 2023-01-23 19:40:20 +00:00
stats_test.go satellite/metabase: use table stats if are up to date 2023-03-13 14:54:13 +00:00
stats.go satellite/metabase: sort stats by creation time not number of entries 2023-03-30 12:31:45 +00:00
streamstat_test.go satellite/metabase: handle copies with GetStreamPieceCountByNodeID 2022-12-13 12:32:56 +01:00
streamstat.go satellite/metabase: fix GetStreamPieceCountByNodeID full table scan 2023-01-10 23:35:22 +00:00
update_test.go storage: move errors to better locations 2023-04-06 17:26:29 +03:00
update.go storage: move errors to better locations 2023-04-06 17:26:29 +03:00
util.go satellite/metabase: add intLimitRange 2021-07-19 07:51:16 +00:00