storj/satellite/satellitedb
Cameron Ayer c2525ba2b5 satellite/{repair,satellitedb}: clean up healthy segments from repair queue at end of checker iteration
Repair workers prioritize the most unhealthy segments. This has the consequence that when we
finally begin to reach the end of the queue, a good portion of the remaining segments are
healthy again as their nodes have come back online. This makes it appear that there are more
injured segments than there actually are.

solution:
Any time the checker observes an injured segment it inserts it into the repair queue or
updates it if it already exists. Therefore, we can determine which segments are no longer
injured if they were not inserted or updated by the last checker iteration. To do this we
add a new column to the injured segments table, updated_at, which is set to the current time
when a segment is inserted or updated. At the end of the checker iteration, we can delete any
items where updated_at < checker start.

Change-Id: I76a98487a4a845fab2fbc677638a732a95057a94
2020-09-29 20:38:22 +00:00
..
dbx satellite/accounting: add cache for getting project storage and bw limits 2020-09-25 16:28:49 +00:00
satellitedbtest all: fix dots 2020-07-16 14:58:28 +00:00
testdata satellite/satellitedb: enable multiple projects existing users 2020-09-23 18:17:38 +02:00
apikeys.go all: fix dots 2020-07-16 14:58:28 +00:00
attribution_test.go all: remove old uuid 2020-04-02 19:30:36 +03:00
attribution.go all: fix dots 2020-07-16 14:58:28 +00:00
audithistory_test.go satellite/{overlay,satellitedb}: Create database functionality for updating audit history 2020-08-20 17:34:27 +00:00
audithistory.go satellite/{overlay,satellitedb}: Create database functionality for updating audit history 2020-08-20 17:34:27 +00:00
buckets.go satellite/orders: add bucket id to order limit 2020-09-03 10:50:11 +03:00
coinpaymentstxs_test.go satellite/satellitedb: Coinpayments repeat insert bug fix 2020-07-20 20:21:35 +00:00
coinpaymentstxs.go satellite/satellitedb: Coinpayments repeat insert bug fix 2020-07-20 20:21:35 +00:00
compensation.go all: fix dots 2020-07-16 14:58:28 +00:00
consoledb_test.go satellite/satellitedb/satellitedbtest: pass ctx as an argument 2020-01-20 16:35:42 +02:00
consoledb.go satellite/payments: fix promotional coupons 2020-01-29 16:40:43 +02:00
containment.go all: fix dots 2020-07-16 14:58:28 +00:00
coupons.go all: fix dots 2020-07-16 14:58:28 +00:00
customers.go all: replace == comparison with errors.Is 2020-07-14 15:50:25 +00:00
database.go storagenode: heldamount renamed to payouts, renamed some methods and structs to more meaningful names. grouped estimated payout with pathouts 2020-09-16 14:57:35 +00:00
downtime.go satellite/satellitedb/dbx: name the package dbx 2020-01-15 15:16:39 -07:00
gracefulexit.go go.mod: update pgx to v4.9.0 2020-09-29 19:03:08 +00:00
invoiceprojectrecords.go satellite/payments: delete credits and credits_spendings db tables 2020-07-30 12:19:57 +03:00
irreparabledb.go satellite/repair: use metabase.SegmentKey type in repair package 2020-09-08 19:35:20 +00:00
migrate_test.go satellite/satellitedb: separate cockroach for migration tests 2020-09-29 09:31:33 +00:00
migrate.go satellite/satellitedb: enable multiple projects existing users 2020-09-23 18:17:38 +02:00
nodeapiversion.go all: use jackc/pgx in place of lib/pq 2020-07-13 15:54:41 +00:00
nodeselection.go go.mod: update pgx to v4.9.0 2020-09-29 19:03:08 +00:00
offers.go all: add missing dots 2020-08-11 17:50:01 +03:00
orders.go go.mod: update pgx to v4.9.0 2020-09-29 19:03:08 +00:00
overlaycache_test.go satellite/satellitedb: uses vetted_at field to select for reputable nodes 2020-09-04 16:45:32 +00:00
overlaycache.go satellite/satellitedb: uses vetted_at field to select for reputable nodes 2020-09-04 16:45:32 +00:00
payout.go storagenode: heldamount renamed to payouts, renamed some methods and structs to more meaningful names. grouped estimated payout with pathouts 2020-09-16 14:57:35 +00:00
peeridentities.go all: fix dots 2020-07-16 14:58:28 +00:00
projectaccounting.go go.mod: update pgx to v4.9.0 2020-09-29 19:03:08 +00:00
projectmembers_test.go web/satellite: project members sorting fixed (#3231) 2019-10-15 15:24:53 +03:00
projectmembers.go all: fix dots 2020-07-16 14:58:28 +00:00
projects_test.go satellite/satellitedb/dbx: name the package dbx 2020-01-15 15:16:39 -07:00
projects.go satellite: make limits be nullable 2020-09-21 19:34:19 +00:00
regtokens.go all: fix dots 2020-07-16 14:58:28 +00:00
repairqueue.go satellite/{repair,satellitedb}: clean up healthy segments from repair queue at end of checker iteration 2020-09-29 20:38:22 +00:00
resetpasstokens.go all: fix dots 2020-07-16 14:58:28 +00:00
revocation_test.go satellite: Check macaroon revocation 2020-06-22 13:50:07 -06:00
revocation.go all: fix dots 2020-07-16 14:58:28 +00:00
storagenodeaccounting.go satellite/storageusage: Group accounting rollups at_rest_total by day 2020-08-10 15:03:15 +00:00
stripecoinpaymentsdb.go satellite/payments: delete credits and credits_spendings db tables 2020-07-30 12:19:57 +03:00
usercredits.go all: fix dots 2020-07-16 14:58:28 +00:00
users_test.go satellite/satellitedb/dbx: name the package dbx 2020-01-15 15:16:39 -07:00
users.go all: fix dots 2020-07-16 14:58:28 +00:00