storj/satellite/audit
paul cannon b612ded9af satellite/audit: help performance of pushing to audit queue
The audit chore will be pushing a large number of segments to be
audited, and the db might choke on that large insert when under load.

This change divides the insert up into batches, which can be sized
however is optimal for the backing database. It also arranges for
segments to be inserted in the order of the primary key, which helps
performance on some systems.

Refs: https://github.com/storj/storj/issues/5228

Change-Id: I941f580f690d681b80c86faf4abca2995e37135d
2022-11-29 15:37:49 +00:00
..
audit_test.go satellite/audit: use db for auditor queue 2022-11-22 14:04:00 +00:00
chore.go satellite/audit: help performance of pushing to audit queue 2022-11-29 15:37:49 +00:00
collector_test.go satellite/audit: optimize loop observer 2022-10-02 22:24:37 +00:00
collector.go satellite/audit: optimize loop observer 2022-10-02 22:24:37 +00:00
containment_test.go satellite/{audit, reputation}: fix potential nodes reputation status 2022-01-06 21:05:59 +00:00
containment.go satellite/audit: migrate to new segment_pending_audit table 2021-06-28 13:19:49 +02:00
cryptosource.go all: fix dots 2020-07-16 14:58:28 +00:00
disqualification_test.go all: reformat comments as required by gofmt 1.19 2022-08-10 18:24:55 +00:00
getshare_test.go satellite/audit: use db for auditor queue 2022-11-22 14:04:00 +00:00
integration_test.go satellite/audit: use db for auditor queue 2022-11-22 14:04:00 +00:00
pieces_test.go satellite/repair: update audit records during repair 2021-09-24 00:48:13 +00:00
pieces.go satellite/repair: move over audit.Pieces 2022-09-22 16:43:03 +00:00
queue_test.go satellite/audit: move to segmentloop 2021-06-28 11:32:00 +00:00
queue.go satellite/audit: help performance of pushing to audit queue 2022-11-29 15:37:49 +00:00
reporter_test.go satellite/reputation: reconfigure lambda and alpha 2022-08-17 18:52:53 +00:00
reporter.go satellite/{repair,audit}: simplify reputation reporter 2022-05-10 14:04:43 +00:00
reservoir_test.go satellite/audit: optimize loop observer 2022-10-02 22:24:37 +00:00
reservoir.go satellite/audit: optimize loop observer 2022-10-02 22:24:37 +00:00
reverifier_test.go satellite/audit: new ReverifyPiece implementation 2022-10-27 16:06:21 +00:00
reverifier.go satellite/audit: new ReverifyPiece implementation 2022-10-27 16:06:21 +00:00
reverify_test.go satellite/audit: use db for auditor queue 2022-11-22 14:04:00 +00:00
verifier_test.go satellite/audit: use db for auditor queue 2022-11-22 14:04:00 +00:00
verifier_unit_test.go satellite/audit: move to segmentloop 2021-06-28 11:32:00 +00:00
verifier.go mod: bump dependencies 2022-10-19 17:01:53 +00:00
worker.go satellite/audit: help performance of pushing to audit queue 2022-11-29 15:37:49 +00:00