JakeHillion/storj
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
9640cc2c06
storj/satellite/metabase
History
Egon Elbre 9640cc2c06 satellite/metabase/segmentloop: verify processed count 
This adds verification for the processed count and before and after
segment/objects table counts.

This adds new flag:

  metainfo.segment-loop.suspicious-processed-ratio: 0.03

This defaults to 3%, which at 100M segments is 3M segments.

Change-Id: I5ee03e913ddc4e67e94010ced126a2a9ea51f41b
2021-06-17 19:46:55 +03:00
..
metabasetest satellite/metabase: add method to get table statistics 2021-06-16 18:34:55 +03:00
metaloop satellite/metabase/metaloop: verify processed count 2021-06-17 15:23:53 +03:00
segmentloop satellite/metabase/segmentloop: verify processed count 2021-06-17 19:46:55 +03:00
alias_test.go ci: fix lint errors 2021-05-17 13:37:31 +00:00
alias.go satellite/metabase: drop alias migration code 2021-05-07 12:13:28 +03:00
aliascache_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
aliascache.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
aliaspiece_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
aliaspiece.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
bench_expired_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
bench_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
commit_object_test.go satellite/metainfo: fix setting object ZombieDeletionDeadline 2021-05-11 07:26:42 +00:00
commit_object.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
commit_test.go satellite/metabase: set expires_at while committing segment 2021-06-10 16:32:28 +00:00
commit.go satellite/metabase: set expires_at while committing segment 2021-06-10 16:32:28 +00:00
common_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
common.go satellite/{metabase,metainfo}: use ObjectStream as argument 2021-05-04 15:30:59 +00:00
consts_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
db_internal_test.go satellite/metabase/segmentloop: limit max interval 2021-06-10 17:06:33 +00:00
db_test.go satellite/metabase: drop alias migration code 2021-05-07 12:13:28 +03:00
db.go satellite/metabase: add method to get table statistics 2021-06-16 18:34:55 +03:00
delete_bucket_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
delete_bucket.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
delete_objects_test.go satellite/metabase: set expires_at while committing segment 2021-06-10 16:32:28 +00:00
delete_objects.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
delete_part_test.go satellite/metabase: add DeletePart method 2021-05-11 22:45:43 +02:00
delete_part.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
delete_test.go satellite/metainfo: fix setting object ZombieDeletionDeadline 2021-05-11 07:26:42 +00:00
delete.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
encoding.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
get_test.go satellite/metabase: set Segment.ExpiresAt while getting segment 2021-06-15 13:57:51 +00:00
get.go satellite/metabase: set Segment.ExpiresAt while getting segment 2021-06-15 13:57:51 +00:00
iterator_test.go satellite/metainfo: fix setting object ZombieDeletionDeadline 2021-05-11 07:26:42 +00:00
iterator_util_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
iterator.go satellite/metabase: capture iterator errors 2021-06-04 22:46:30 +03:00
list_segments_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
list_segments.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
list.go satellite/metainfo: fix setting object ZombieDeletionDeadline 2021-05-11 07:26:42 +00:00
loop_test.go satellite/metabase: expose expires_at with loops 2021-06-11 16:51:37 +00:00
loop.go satellite/metaloop: missing monitoring on observers 2021-06-15 13:39:13 +00:00
raw.go satellite/metabase: add expires_at column to segments 2021-06-07 19:11:20 +00:00
stats_test.go satellite/metabase: add method to get table statistics 2021-06-16 18:34:55 +03:00
stats.go satellite/metabase: add method to get table statistics 2021-06-16 18:34:55 +03:00
streamstat_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
streamstat.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
update_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
update.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
util.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00