storj/scripts
Michal Niewrzal 98562d06c8 satellite/gc/bloomfilter: add sync observer
Current observer used with ranged loop is using massive amount of
memory because each range is generating separate set of bloom filters.
Each bloom filter can be up to 2MB of memory. That's a lot.

This change is initial change to reduce used memory by sharing bloom
filters between ranges and just synchronize access to them. This
implementation is rather simple and even naive but maybe it will be
enough without doing something more complex.

https://github.com/storj/storj/issues/5803

Change-Id: Ie62d19276aa9023076b1c97f712b788bce963cbe
2023-04-28 07:40:56 +00:00
..
deploy build: use specific tag for nightly deployments 2022-11-02 17:57:20 +00:00
testdata satellite/gc/bloomfilter: add sync observer 2023-04-28 07:40:56 +00:00
tests scripts/tests: fix rollingupgrade test even more 2023-03-13 15:49:07 +00:00
waitlist Waitlist script (#573) 2018-11-06 18:43:20 +01:00
build-wasm.sh satellite/admin/ui: avoid needing an additional copy 2022-03-25 11:42:22 +02:00
cert-gating.sh Delete Bootstrap and Kademlia (#2974) 2019-10-04 16:48:41 -04:00
changelog.py scripts/changelog.py: a few fixes (#5293) 2022-11-08 16:44:28 +02:00
check-package-lock.sh web/: add check for change to eslint import 2021-12-21 15:59:23 +00:00
deploy-storagenode.sh scripts: Change Storagenode arm32v6 to arm32v5 2022-06-21 11:54:38 +00:00
deploy-watchtower.sh Script for deploying the Docker manifest for watchtower (#3015) 2019-09-12 17:38:48 +03:00
draft-release.sh scripts/draft-release.sh: update to python3 2023-03-09 10:59:31 +01:00
gerrit-cla.py gerrit: add cla 2019-06-19 18:28:53 +00:00
gerrit-status.sh build: premerge/verify Jenkinsfile (subsets of Jenkinsifle.public) 2022-06-23 09:15:43 +02:00
lint.go ci: add check-downgrades checks 2022-09-23 11:15:27 +00:00
pg-to-crdb.go all: fix deprecated ioutil commands 2022-10-11 15:27:29 +00:00
release.sh scripts/release.sh: making clear if builing a production or development version (#4304) 2021-12-09 12:38:23 +01:00
tag-release.sh private/version: minimal fix for tag-release.sh 2020-04-01 13:46:45 +00:00
test-certificates.sh fix certificates auth export command (#3110) 2019-09-24 10:38:18 -06:00
test-network-stalls.go all: replace deprecated ioutil 2022-10-31 15:50:41 +00:00
test-wasm-size.sh go.mod: bump storj.io/private 2023-04-05 14:46:59 +03:00
test-wasm.sh build: fix conditional run of web builds 2022-08-11 14:34:44 +00:00
update-access.go all: fix linting issues 2022-03-21 15:26:42 +00:00
utils.sh cmd/uplink: add ranged download to uplink cli 2021-10-25 13:13:33 +00:00
validate-jenkinsfile.sh build: premerge/verify Jenkinsfile (subsets of Jenkinsifle.public) 2022-06-23 09:15:43 +02:00