storj/scripts
stefanbenten c6c8b923af satellite/dbcleanup: run cleanup more frequently
As the tables that get cleaned up by this job get a lot of inserts and deletes over the course of a day, the autovacuum process on PostgreSQL struggles fairly easily/quickly.
Due to its limitation, it can only delete 180,000,000 tuples in one go, before it has to rescan the entire table/index.

With the current load, the most busy satellites accumulate about 1,000,000,000 tuples per day (consumed_serials). With our current 24h interval that results in ~6-7 scans, slowing the entire database down for a quite long time.
This PR reduces the interval to 4 hours, which under a constant load, results in less than 180,000,000 entries per run.
That way, we do not scan twice for only a small gain over said amount. Reducing the interval further would also increase the DB load unnecessary, as each run scans the entire tables at least once.

For future reference, we might need to adjust the interval, if the load is significantly changing.

Change-Id: I18fdd45d93d468cff126e719c8380c29a49f43dd
2020-06-10 18:32:15 +00:00
..
testdata satellite/dbcleanup: run cleanup more frequently 2020-06-10 18:32:15 +00:00
tests scripts/tests: use the same version for storj-sim as satellites 2020-06-05 13:17:17 -04:00
waitlist Waitlist script (#573) 2018-11-06 18:43:20 +01:00
cert-gating.sh Delete Bootstrap and Kademlia (#2974) 2019-10-04 16:48:41 -04:00
check-satellite-config-lock.sh Update Notification Text to new process (#2120) 2019-06-04 22:43:07 -04:00
deploy-storagenode.sh scripts/deploy-storagenode: tag docker image as latest (#3858) 2020-04-18 11:59:56 +02:00
deploy-watchtower.sh Script for deploying the Docker manifest for watchtower (#3015) 2019-09-12 17:38:48 +03:00
gerrit-cla.py gerrit: add cla 2019-06-19 18:28:53 +00:00
install-awscli.sh Travis with go1.11 and modules (#479) 2018-10-16 20:02:00 +03:00
pg-to-crdb.go scripts: Add script that filters postgres plaintext backup to cockroachdb compat. 2019-12-16 22:11:16 +00:00
postgres-dev.sh scripts: update postgres helper script to set password 2020-02-27 10:33:37 +00:00
release.sh storj: remove storj/private/version package which was moved to 2020-03-24 14:31:33 +00:00
tag-release.sh private/version: minimal fix for tag-release.sh 2020-04-01 13:46:45 +00:00
test-backwards.sh scripts: reduce file size for backward compatibility tests 2020-05-27 13:21:55 +00:00
test-certificates.sh fix certificates auth export command (#3110) 2019-09-24 10:38:18 -06:00
test-network-stalls.go common: separate repository 2019-12-27 14:11:15 +02:00
test-sim-backwards-dev.sh scripts: use postgres script with all tests (#3404) 2019-10-31 07:03:54 -07:00
test-sim-backwards.sh scripts: reduce file size for backward compatibility tests 2020-05-27 13:21:55 +00:00
test-sim-dev.sh scripts: use postgres script with all tests (#3404) 2019-10-31 07:03:54 -07:00
test-sim.sh scripts: reduce segment size for integration tests 2020-04-20 15:13:05 +02:00
test-uplink-share.sh scripts/tests: uplink no longer respects --client.segment-size 2020-03-22 17:48:57 +00:00
test-uplink.sh scripts: reduce segment size for integration tests 2020-04-20 15:13:05 +02:00
update-access.go scripts: remove lib/uplink from update-access 2020-05-29 13:35:10 +03:00
update-satellite-config-lock.sh scripts: Fix warn message update sat config lock (#3029) 2019-09-12 18:10:22 +02:00
utils.sh cmd/certificates: auth export improvements & certificates test script (#2897) 2019-09-04 19:58:38 +02:00