JakeHillion/storj
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
a89c0763a0
storj/satellite/metabase
History
Michał Niewrzał 1f5fbbd24a satellite/metabase: while deleting bucket objects delete pieces in batches 
It's possible that single object will have a lot of segments and
at the moment we are trying to collect all pieces at once and
send to storage nodes information about deletion. Such
approach my lead to using extensive amount of memory. This
change is handling this problem by calling DeletePieces
function multiple times with only part of pieces to delete for
a single call.

Change-Id: Ie1e66cd9d86d130eb89a61cf6e23f38b8cb8859e
2021-06-25 13:27:00 +00:00
..
metabasetest satellite/metabase: add method to get table statistics 2021-06-16 18:34:55 +03:00
metaloop satellite/metabase/metaloop: add as of system interval to stats 2021-06-17 23:43:41 +03:00
segmentloop satellite/metabase/metaloop: add as of system interval to stats 2021-06-17 23:43:41 +03:00
alias_test.go ci: fix lint errors 2021-05-17 13:37:31 +00:00
alias.go satellite/metabase: drop alias migration code 2021-05-07 12:13:28 +03:00
aliascache_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
aliascache.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
aliaspiece_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
aliaspiece.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
bench_expired_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
bench_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
commit_object_test.go satellite/metainfo: fix setting object ZombieDeletionDeadline 2021-05-11 07:26:42 +00:00
commit_object.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
commit_test.go satellite/metabase: set expires_at while committing segment 2021-06-10 16:32:28 +00:00
commit.go satellite/metabase: set expires_at while committing segment 2021-06-10 16:32:28 +00:00
common_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
common.go satellite/{metabase,metainfo}: use ObjectStream as argument 2021-05-04 15:30:59 +00:00
consts_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
db_internal_test.go satellite/metabase/segmentloop: limit max interval 2021-06-10 17:06:33 +00:00
db_test.go satellite/metabase: drop alias migration code 2021-05-07 12:13:28 +03:00
db.go satellite/metabase: add method to get table statistics 2021-06-16 18:34:55 +03:00
delete_bucket_test.go satellite/metabase: while deleting bucket objects delete pieces in batches 2021-06-25 13:27:00 +00:00
delete_bucket.go satellite/metabase: while deleting bucket objects delete pieces in batches 2021-06-25 13:27:00 +00:00
delete_objects_test.go satellite/metabase: set expires_at while committing segment 2021-06-10 16:32:28 +00:00
delete_objects.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
delete_part_test.go satellite/metabase: add DeletePart method 2021-05-11 22:45:43 +02:00
delete_part.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
delete_test.go satellite/metainfo: fix setting object ZombieDeletionDeadline 2021-05-11 07:26:42 +00:00
delete.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
encoding.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
get_test.go satellite/metabase: set Segment.ExpiresAt while getting segment 2021-06-15 13:57:51 +00:00
get.go satellite/metabase: set Segment.ExpiresAt while getting segment 2021-06-15 13:57:51 +00:00
iterator_test.go satellite/metainfo: fix setting object ZombieDeletionDeadline 2021-05-11 07:26:42 +00:00
iterator_util_test.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
iterator.go satellite/metabase: capture iterator errors 2021-06-04 22:46:30 +03:00
list_segments_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
list_segments.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
list.go satellite/metainfo: fix setting object ZombieDeletionDeadline 2021-05-11 07:26:42 +00:00
loop_test.go satellite/metabase: expose expires_at with loops 2021-06-11 16:51:37 +00:00
loop.go satellite/metaloop: missing monitoring on observers 2021-06-15 13:39:13 +00:00
raw.go satellite/metabase: add expires_at column to segments 2021-06-07 19:11:20 +00:00
stats_test.go satellite/metabase: add method to get table statistics 2021-06-16 18:34:55 +03:00
stats.go satellite/metabase: add method to get table statistics 2021-06-16 18:34:55 +03:00
streamstat_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
streamstat.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
update_test.go satellite/metabase/metabasetest: move test utils to a separate package 2021-04-26 13:12:58 +03:00
update.go satellite/metabase: add monitoring for objects and segments 2021-06-04 20:01:10 +03:00
util.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00