JakeHillion/storj
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
033006403f
storj/satellite/satellitedb
History
Ivan Fraixedes 7fb86617fc satellite/satellitedb: Use CRDB AS OF SYSTEM & batch for GE 
Use the 'AS OF SYSTEM TIME' Cockroach DB clause for the Graceful Exit
(a.k.a GE) queries that count the delete the GE queue items of nodes
which have already exited the network.

Split the subquery used for deleting all the transfer queue items of
nodes which has exited when CRDB is used and batch the queries because
CRDB struggles when executing in a single query unlike Postgres.

The new test which has been added to this commit to verify the CRDB
batch logic for deleting all the transfer queue items of the exited
nodes has raised that the Enqueue method has to run in baches when CRDB
is used otherwise CRDB has return the error "driver: bad connection"
when a big a amount of items are passed to be enqueued. This error
didn't happen with the current test implementation it was with an
initial one that it was creating a big amount of exited nodes and
transfer queue items for those nodes.

Change-Id: I6a099cdbc515a240596bc93141fea3182c2e50a9
2021-05-07 13:09:19 -04:00
..
dbx satellite/satellitedb: Add missing indexes 2021-04-29 15:34:46 +00:00
satellitedbtest private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
testdata satellite/satellitedb: Add missing indexes 2021-04-29 15:34:46 +00:00
apikeys.go pkg/,private/: merge with private package 2021-04-23 16:37:28 +03:00
attribution.go satellite/metainfo: avoid error on inserting existing attribution 2021-04-02 08:18:17 +00:00
audithistory.go satellite/{overlay, satellitedb}: Refactor audit history 2020-12-29 18:50:22 +00:00
bucketsdb.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
coinpaymentstxs.go satellite/satellitedb: Coinpayments repeat insert bug fix 2020-07-20 20:21:35 +00:00
compensation.go satellite/compensation: smaller txns for RecordPeriod 2021-03-02 20:14:25 +00:00
consoledb_test.go satellite/satellitedb/satellitedbtest: pass ctx as an argument 2020-01-20 16:35:42 +02:00
consoledb.go pkg/,private/: merge with private package 2021-04-23 16:37:28 +03:00
containment.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
coupons.go satellite/payments: Populate new coupons during invoice generation 2021-04-28 18:07:05 +00:00
customers.go satellite/billing: make stripe invoice generation work with multiregion satellites 2021-05-06 11:51:03 -06:00
database.go satellite/satellitedb: Use CRDB AS OF SYSTEM & batch for GE 2021-05-07 13:09:19 -04:00
gracefulexit.go satellite/satellitedb: Use CRDB AS OF SYSTEM & batch for GE 2021-05-07 13:09:19 -04:00
invoiceprojectrecords.go satellite/payments: delete credits and credits_spendings db tables 2020-07-30 12:19:57 +03:00
irreparabledb.go satellite/metabase: move package one level higher 2021-04-21 15:54:22 +03:00
migrate_gen.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
migrate_test.go satellite/satellitedb: Add missing indexes 2021-04-29 15:34:46 +00:00
migrate.go satellite/satellitedb: Add missing indexes 2021-04-29 15:34:46 +00:00
migratez.go satellite/satellitedb: Add missing indexes 2021-04-29 15:34:46 +00:00
nodeapiversion.go all: use jackc/pgx in place of lib/pq 2020-07-13 15:54:41 +00:00
nodeselection.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
orders.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
overlaycache.go satellite/satellitedb: don't remove offline nodes from containment 2021-05-03 16:05:55 +00:00
payouts.go satellite/compensation: smaller txns for RecordPeriod 2021-03-02 20:14:25 +00:00
peeridentities.go all: fix dots 2020-07-16 14:58:28 +00:00
projectaccounting.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
projectmembers_test.go web/satellite: project members sorting fixed (#3231) 2019-10-15 15:24:53 +03:00
projectmembers.go all: fix linter complaints 2020-10-13 15:59:01 +03:00
projects_test.go satellite/satellitedb/dbx: name the package dbx 2020-01-15 15:16:39 -07:00
projects.go satellite/console: change default project and usage limits 2021-03-24 14:24:27 +00:00
regtokens.go all: fix dots 2020-07-16 14:58:28 +00:00
repairqueue.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
resetpasstokens.go all: fix dots 2020-07-16 14:58:28 +00:00
revocation.go pkg/,private/: merge with private package 2021-04-23 16:37:28 +03:00
storagenodeaccounting.go private/dbutil: use dbutil and tagsql from storj.io/private 2021-04-23 14:36:52 +03:00
stripecoinpaymentsdb.go satellite/payments: delete credits and credits_spendings db tables 2020-07-30 12:19:57 +03:00
users_test.go satellite/satellitedb/dbx: name the package dbx 2020-01-15 15:16:39 -07:00
users.go satellite/satellitedb: add employee size column to users 2021-02-12 09:15:15 -05:00