storj/satellite/gc
Michal Niewrzal 98562d06c8 satellite/gc/bloomfilter: add sync observer
Current observer used with ranged loop is using massive amount of
memory because each range is generating separate set of bloom filters.
Each bloom filter can be up to 2MB of memory. That's a lot.

This change is initial change to reduce used memory by sharing bloom
filters between ranges and just synchronize access to them. This
implementation is rather simple and even naive but maybe it will be
enough without doing something more complex.

https://github.com/storj/storj/issues/5803

Change-Id: Ie62d19276aa9023076b1c97f712b788bce963cbe
2023-04-28 07:40:56 +00:00
..
bloomfilter satellite/gc/bloomfilter: add sync observer 2023-04-28 07:40:56 +00:00
sender satellite/gc: improve comments 2023-03-08 13:15:13 +00:00
doc.go satellite/gc: improve comments 2023-03-08 13:15:13 +00:00
gc_test.go storagenode/blobstore: move blob store logic 2023-04-05 18:06:20 +00:00